Emotion recognition of affective speech based on multiple classifiers using acoustic-prosodic information and semantic labels (Extended abstract)

Chung Hsien Wu, Wei Bin Liang

研究成果: Conference contribution

10 引文 斯高帕斯(Scopus)

摘要

This work presents an approach to emotion recognition of affective speech based on multiple classifiers using acoustic-prosodic information (AP) and semantic labels (SLs). For AP-based recognition, acoustic and prosodic features are extracted from the detected emotional salient segments of the input speech. Three types of models GMMs, SVMs, and MLPs are adopted as the base-level classifiers. A Meta Decision Tree (MDT) is then employed for classifier fusion to obtain the AP-based emotion recognition confidence. For SL-based recognition, semantic labels are used to automatically extract Emotion Association Rules (EARs) from the recognized word sequence of the affective speech. The maximum entropy model (MaxEnt) is thereafter utilized to characterize the relationship between emotional states and EARs for emotion recognition. Finally, a weighted product fusion method is used to integrate the AP-based and SL-based recognition results for final emotion decision. For evaluation, 2,033 utterances for four emotional states were collected. The experimental results reveal that the emotion recognition performance for AP-based recognition using MDT achieved 80.00%. On the other hand, an average recognition accuracy of 80.92% was obtained for SL-based recognition. Finally, combining AP information and SLs achieved 83.55% accuracy for emotion recognition.

原文English
主出版物標題2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015
發行者Institute of Electrical and Electronics Engineers Inc.
頁面477-483
頁數7
ISBN(電子)9781479999538
DOIs
出版狀態Published - 2015 12月 2
事件2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015 - Xi'an, China
持續時間: 2015 9月 212015 9月 24

出版系列

名字2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015

Other

Other2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015
國家/地區China
城市Xi'an
期間15-09-2115-09-24

All Science Journal Classification (ASJC) codes

  • 人工智慧
  • 電腦視覺和模式識別
  • 人機介面
  • 軟體

指紋

深入研究「Emotion recognition of affective speech based on multiple classifiers using acoustic-prosodic information and semantic labels (Extended abstract)」主題。共同形成了獨特的指紋。

引用此