An articulation training system with intelligent interface and multimode feedbacks to articulation disorders

Yeou Jiunn Chen, Jiunn-Liang Wu, Hui Mei Yang, Chung-Hsien Wu, Chih Chang Chen, Shan Shan Ju

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Articulation training with many kinds of stimulus and messages such as visual, voice, and articulatory information can teach user to pronounce correctly and improve user's articulatory ability. In this paper, an articulation training system with intelligent interface and multimode feedbacks is proposed to improve the performance of articulation training. Dependent network is designed to model clinical knowledge of speech-language pathologists used in speech evaluation Automatic speech recognition with dependent network is then apply to identify the pronunciation errors. Besides, hierarchical Bayesian network is proposed to recognize user's emotion from speeches. With the information of pronunciation errors and user's emotion, the articulation training sentences can be dynamically selected. Finally, a 3D facial animation is provided to teach users to pronounce a sentence by using speech, lip motion, and tongue motion. Experimental results reveal the usefulness of proposed method and system.

Original languageEnglish
Title of host publication2009 International Conference on Asian Language Processing
Subtitle of host publicationRecent Advances in Asian Language Processing, IALP 2009
Pages3-6
Number of pages4
DOIs
Publication statusPublished - 2009 Dec 1
Event2009 International Conference on Asian Language Processing: Recent Advances in Asian Language Processing, IALP 2009 - Singapore, Singapore
Duration: 2009 Dec 72009 Dec 9

Publication series

Name2009 International Conference on Asian Language Processing: Recent Advances in Asian Language Processing, IALP 2009

Other

Other2009 International Conference on Asian Language Processing: Recent Advances in Asian Language Processing, IALP 2009
Country/TerritorySingapore
CitySingapore
Period09-12-0709-12-09

All Science Journal Classification (ASJC) codes

  • Language and Linguistics
  • Linguistics and Language

Fingerprint

Dive into the research topics of 'An articulation training system with intelligent interface and multimode feedbacks to articulation disorders'. Together they form a unique fingerprint.

Cite this