Multi-modal sign icon retrieval for augmentative communication

Chung Hsien Wu, Yu Hsien Chiu, Kung Wei Cheng

研究成果: Conference contribution

2 引文 斯高帕斯(Scopus)

摘要

This paper addresses a multi-modal sign icon retrieval and prediction technology for generating sentences from ill-formed Taiwanese sign language (TSL) for people with speech or hearing impairments. The design and development of this PC-based TSL augmented and alternative communication (AAC) system aims to improve the input rate and accuracy of communication aids. This study focuses on 1) developing an effective TSL icon retrieval method, 2) investigating TSL prediction strategies for input rate enhancement, 3) using a predictive sentence template (PST) tree for sentence generation. The proposed system assists people with language disabilities in sentence formation. To evaluate the performance of our approach, a pilot study for clinical evaluation and education training was undertaken. The evaluation results show that the retrieval rate and subjective satisfactory level for sentence generation was significantly improved.

原文English
主出版物標題Advances in Multimedia Information Processing - PCM 2001 - 2nd IEEE Pacific Rim Conference on Multimedia, Proceedings
編輯Shih-Fu Chang, Heung-Yeung Shum, Mark Liao
發行者Springer Verlag
頁面598-605
頁數8
ISBN(列印)3540426809, 9783540426806
出版狀態Published - 2001 1月 1
事件2nd IEEE Pacific-Rim Conference on Multimedia, IEEE-PCM 2001 - Beijing, China
持續時間: 2001 10月 242001 10月 26

出版系列

名字Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
2195
ISSN(列印)0302-9743
ISSN(電子)1611-3349

Other

Other2nd IEEE Pacific-Rim Conference on Multimedia, IEEE-PCM 2001
國家/地區China
城市Beijing
期間01-10-2401-10-26

All Science Journal Classification (ASJC) codes

  • 理論電腦科學
  • 電腦科學(全部)

指紋

深入研究「Multi-modal sign icon retrieval for augmentative communication」主題。共同形成了獨特的指紋。

引用此