An articulation training system with intelligent interface and multimode feedbacks to articulation disorders

Yeou Jiunn Chen, Jiunn-Liang Wu, Hui Mei Yang, Chung-Hsien Wu, Chih Chang Chen, Shan Shan Ju

研究成果: Conference contribution

1 引文 斯高帕斯(Scopus)

摘要

Articulation training with many kinds of stimulus and messages such as visual, voice, and articulatory information can teach user to pronounce correctly and improve user's articulatory ability. In this paper, an articulation training system with intelligent interface and multimode feedbacks is proposed to improve the performance of articulation training. Dependent network is designed to model clinical knowledge of speech-language pathologists used in speech evaluation Automatic speech recognition with dependent network is then apply to identify the pronunciation errors. Besides, hierarchical Bayesian network is proposed to recognize user's emotion from speeches. With the information of pronunciation errors and user's emotion, the articulation training sentences can be dynamically selected. Finally, a 3D facial animation is provided to teach users to pronounce a sentence by using speech, lip motion, and tongue motion. Experimental results reveal the usefulness of proposed method and system.

原文English
主出版物標題2009 International Conference on Asian Language Processing
主出版物子標題Recent Advances in Asian Language Processing, IALP 2009
頁面3-6
頁數4
DOIs
出版狀態Published - 2009 十二月 1
事件2009 International Conference on Asian Language Processing: Recent Advances in Asian Language Processing, IALP 2009 - Singapore, Singapore
持續時間: 2009 十二月 72009 十二月 9

出版系列

名字2009 International Conference on Asian Language Processing: Recent Advances in Asian Language Processing, IALP 2009

Other

Other2009 International Conference on Asian Language Processing: Recent Advances in Asian Language Processing, IALP 2009
國家/地區Singapore
城市Singapore
期間09-12-0709-12-09

All Science Journal Classification (ASJC) codes

  • 語言與語言學
  • 語言和語言學

指紋

深入研究「An articulation training system with intelligent interface and multimode feedbacks to articulation disorders」主題。共同形成了獨特的指紋。

引用此