Emotion recognition with consideration of facial expression and physiological signals

Chuan Yu Chang, Jeng Shiun Tsai, Chi-Jen Wang, Pau-Choo Chung

研究成果: Conference contribution

34 引文 (Scopus)

摘要

An emotion recognition system with consideration of facial expression and physiological signals is proposed in this paper. A specific designed mood induction experiment is performed to collect facial expressing images and physiological signals of subjects. We detected 14 feature points and extracted 12 facial features from facial expression images. Meanwhile, we measure the skin conductivity, finger temperature and heart rate from the subject. Both facial and physiological features are adopted to train the classifiers. Two learning vector quantization (LVQ) neural networks were applied to classify four emotions: love, joy, surprise and fear. Experimental results show the proposed recognition system is able to identify four emotions by facial expressions, physiological signals, and both of them.

原文English
主出版物標題2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings
頁面278-283
頁數6
DOIs
出版狀態Published - 2009 七月 20
事件2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Nashville, TN, United States
持續時間: 2009 三月 302009 四月 2

出版系列

名字2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings

Other

Other2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009
國家United States
城市Nashville, TN
期間09-03-3009-04-02

指紋

Facial Expression
Vector quantization
Skin
Emotions
Classifiers
Neural networks
Experiments
Temperature
Love
Fingers
Fear
Heart Rate
Learning
Recognition (Psychology)

All Science Journal Classification (ASJC) codes

  • Biochemistry, Genetics and Molecular Biology(all)
  • Artificial Intelligence
  • Computational Theory and Mathematics

引用此文

Chang, C. Y., Tsai, J. S., Wang, C-J., & Chung, P-C. (2009). Emotion recognition with consideration of facial expression and physiological signals. 於 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings (頁 278-283). [4925739] (2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings). https://doi.org/10.1109/CIBCB.2009.4925739
Chang, Chuan Yu ; Tsai, Jeng Shiun ; Wang, Chi-Jen ; Chung, Pau-Choo. / Emotion recognition with consideration of facial expression and physiological signals. 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings. 2009. 頁 278-283 (2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings).
@inproceedings{9718d1263183426393b94781caab8b9a,
title = "Emotion recognition with consideration of facial expression and physiological signals",
abstract = "An emotion recognition system with consideration of facial expression and physiological signals is proposed in this paper. A specific designed mood induction experiment is performed to collect facial expressing images and physiological signals of subjects. We detected 14 feature points and extracted 12 facial features from facial expression images. Meanwhile, we measure the skin conductivity, finger temperature and heart rate from the subject. Both facial and physiological features are adopted to train the classifiers. Two learning vector quantization (LVQ) neural networks were applied to classify four emotions: love, joy, surprise and fear. Experimental results show the proposed recognition system is able to identify four emotions by facial expressions, physiological signals, and both of them.",
author = "Chang, {Chuan Yu} and Tsai, {Jeng Shiun} and Chi-Jen Wang and Pau-Choo Chung",
year = "2009",
month = "7",
day = "20",
doi = "10.1109/CIBCB.2009.4925739",
language = "English",
isbn = "9781424427567",
series = "2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings",
pages = "278--283",
booktitle = "2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings",

}

Chang, CY, Tsai, JS, Wang, C-J & Chung, P-C 2009, Emotion recognition with consideration of facial expression and physiological signals. 於 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings., 4925739, 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings, 頁 278-283, 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009, Nashville, TN, United States, 09-03-30. https://doi.org/10.1109/CIBCB.2009.4925739

Emotion recognition with consideration of facial expression and physiological signals. / Chang, Chuan Yu; Tsai, Jeng Shiun; Wang, Chi-Jen; Chung, Pau-Choo.

2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings. 2009. p. 278-283 4925739 (2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings).

研究成果: Conference contribution

TY - GEN

T1 - Emotion recognition with consideration of facial expression and physiological signals

AU - Chang, Chuan Yu

AU - Tsai, Jeng Shiun

AU - Wang, Chi-Jen

AU - Chung, Pau-Choo

PY - 2009/7/20

Y1 - 2009/7/20

N2 - An emotion recognition system with consideration of facial expression and physiological signals is proposed in this paper. A specific designed mood induction experiment is performed to collect facial expressing images and physiological signals of subjects. We detected 14 feature points and extracted 12 facial features from facial expression images. Meanwhile, we measure the skin conductivity, finger temperature and heart rate from the subject. Both facial and physiological features are adopted to train the classifiers. Two learning vector quantization (LVQ) neural networks were applied to classify four emotions: love, joy, surprise and fear. Experimental results show the proposed recognition system is able to identify four emotions by facial expressions, physiological signals, and both of them.

AB - An emotion recognition system with consideration of facial expression and physiological signals is proposed in this paper. A specific designed mood induction experiment is performed to collect facial expressing images and physiological signals of subjects. We detected 14 feature points and extracted 12 facial features from facial expression images. Meanwhile, we measure the skin conductivity, finger temperature and heart rate from the subject. Both facial and physiological features are adopted to train the classifiers. Two learning vector quantization (LVQ) neural networks were applied to classify four emotions: love, joy, surprise and fear. Experimental results show the proposed recognition system is able to identify four emotions by facial expressions, physiological signals, and both of them.

UR - http://www.scopus.com/inward/record.url?scp=67650348192&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67650348192&partnerID=8YFLogxK

U2 - 10.1109/CIBCB.2009.4925739

DO - 10.1109/CIBCB.2009.4925739

M3 - Conference contribution

AN - SCOPUS:67650348192

SN - 9781424427567

T3 - 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings

SP - 278

EP - 283

BT - 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings

ER -

Chang CY, Tsai JS, Wang C-J, Chung P-C. Emotion recognition with consideration of facial expression and physiological signals. 於 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings. 2009. p. 278-283. 4925739. (2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings). https://doi.org/10.1109/CIBCB.2009.4925739