Mixmodel driven 3D facial synthesis to computer-aided articulation training

Yeou Jiunn Chen, F. C. Liao, J. L. Wu, H. M. Yang, C. H. Wu

研究成果: Conference contribution

摘要

3D facial animation had been widely used in many multimedia applications and could be applied to help articulation disorders in articulatory training. In this paper, a mixmodel driven 3D facial synthesis including lip and tongue animation is proposed to provide multi-model feedback such as speech signal, lip motion, and tongue motion. Text-to-speech can generate the speech signal of arbitrary text and provide syllable boundaries. Contextual knowledge based phoneme segmentation is applied to estimate the phoneme boundaries in a syllable and the number of 3D facial models can be effectively reduced. Parametric 3D tongue and lip movement models are smoothed by B-spline to eliminate the jerkiness and synthesize the 3D facial with tongue and lip animation. Integrating boundary information, the speech-synching can be easily accomplished. The mult-model feedbacks in 3D facial animation are used to improve the efficiency of articulatory training. The preliminary experimental results show that this method is feasible.

原文English
主出版物標題4th Kuala Lumpur International Conference on Biomedical Engineering 2008, Biomed 2008
發行者Springer Verlag
頁面56-60
頁數5
版本1
ISBN(列印)9783540691389
DOIs
出版狀態Published - 2008

出版系列

名字IFMBE Proceedings
號碼1
21 IFMBE
ISSN(列印)1680-0737

All Science Journal Classification (ASJC) codes

  • 生物工程
  • 生物醫學工程

指紋

深入研究「Mixmodel driven 3D facial synthesis to computer-aided articulation training」主題。共同形成了獨特的指紋。

引用此