Emotion recognition with consideration of facial expression and physiological signals

Chuan Yu Chang, Jeng Shiun Tsai, Chi-Jen Wang, Pau-Choo Chung

Research output: Chapter in Book/Report/Conference proceedingConference contribution

34 Citations (Scopus)

Abstract

An emotion recognition system with consideration of facial expression and physiological signals is proposed in this paper. A specific designed mood induction experiment is performed to collect facial expressing images and physiological signals of subjects. We detected 14 feature points and extracted 12 facial features from facial expression images. Meanwhile, we measure the skin conductivity, finger temperature and heart rate from the subject. Both facial and physiological features are adopted to train the classifiers. Two learning vector quantization (LVQ) neural networks were applied to classify four emotions: love, joy, surprise and fear. Experimental results show the proposed recognition system is able to identify four emotions by facial expressions, physiological signals, and both of them.

Original languageEnglish
Title of host publication2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings
Pages278-283
Number of pages6
DOIs
Publication statusPublished - 2009 Jul 20
Event2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Nashville, TN, United States
Duration: 2009 Mar 302009 Apr 2

Publication series

Name2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings

Other

Other2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009
CountryUnited States
CityNashville, TN
Period09-03-3009-04-02

Fingerprint

Facial Expression
Vector quantization
Skin
Emotions
Classifiers
Neural networks
Experiments
Temperature
Love
Fingers
Fear
Heart Rate
Learning
Recognition (Psychology)

All Science Journal Classification (ASJC) codes

  • Biochemistry, Genetics and Molecular Biology(all)
  • Artificial Intelligence
  • Computational Theory and Mathematics

Cite this

Chang, C. Y., Tsai, J. S., Wang, C-J., & Chung, P-C. (2009). Emotion recognition with consideration of facial expression and physiological signals. In 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings (pp. 278-283). [4925739] (2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings). https://doi.org/10.1109/CIBCB.2009.4925739
Chang, Chuan Yu ; Tsai, Jeng Shiun ; Wang, Chi-Jen ; Chung, Pau-Choo. / Emotion recognition with consideration of facial expression and physiological signals. 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings. 2009. pp. 278-283 (2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings).
@inproceedings{9718d1263183426393b94781caab8b9a,
title = "Emotion recognition with consideration of facial expression and physiological signals",
abstract = "An emotion recognition system with consideration of facial expression and physiological signals is proposed in this paper. A specific designed mood induction experiment is performed to collect facial expressing images and physiological signals of subjects. We detected 14 feature points and extracted 12 facial features from facial expression images. Meanwhile, we measure the skin conductivity, finger temperature and heart rate from the subject. Both facial and physiological features are adopted to train the classifiers. Two learning vector quantization (LVQ) neural networks were applied to classify four emotions: love, joy, surprise and fear. Experimental results show the proposed recognition system is able to identify four emotions by facial expressions, physiological signals, and both of them.",
author = "Chang, {Chuan Yu} and Tsai, {Jeng Shiun} and Chi-Jen Wang and Pau-Choo Chung",
year = "2009",
month = "7",
day = "20",
doi = "10.1109/CIBCB.2009.4925739",
language = "English",
isbn = "9781424427567",
series = "2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings",
pages = "278--283",
booktitle = "2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings",

}

Chang, CY, Tsai, JS, Wang, C-J & Chung, P-C 2009, Emotion recognition with consideration of facial expression and physiological signals. in 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings., 4925739, 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings, pp. 278-283, 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009, Nashville, TN, United States, 09-03-30. https://doi.org/10.1109/CIBCB.2009.4925739

Emotion recognition with consideration of facial expression and physiological signals. / Chang, Chuan Yu; Tsai, Jeng Shiun; Wang, Chi-Jen; Chung, Pau-Choo.

2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings. 2009. p. 278-283 4925739 (2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Emotion recognition with consideration of facial expression and physiological signals

AU - Chang, Chuan Yu

AU - Tsai, Jeng Shiun

AU - Wang, Chi-Jen

AU - Chung, Pau-Choo

PY - 2009/7/20

Y1 - 2009/7/20

N2 - An emotion recognition system with consideration of facial expression and physiological signals is proposed in this paper. A specific designed mood induction experiment is performed to collect facial expressing images and physiological signals of subjects. We detected 14 feature points and extracted 12 facial features from facial expression images. Meanwhile, we measure the skin conductivity, finger temperature and heart rate from the subject. Both facial and physiological features are adopted to train the classifiers. Two learning vector quantization (LVQ) neural networks were applied to classify four emotions: love, joy, surprise and fear. Experimental results show the proposed recognition system is able to identify four emotions by facial expressions, physiological signals, and both of them.

AB - An emotion recognition system with consideration of facial expression and physiological signals is proposed in this paper. A specific designed mood induction experiment is performed to collect facial expressing images and physiological signals of subjects. We detected 14 feature points and extracted 12 facial features from facial expression images. Meanwhile, we measure the skin conductivity, finger temperature and heart rate from the subject. Both facial and physiological features are adopted to train the classifiers. Two learning vector quantization (LVQ) neural networks were applied to classify four emotions: love, joy, surprise and fear. Experimental results show the proposed recognition system is able to identify four emotions by facial expressions, physiological signals, and both of them.

UR - http://www.scopus.com/inward/record.url?scp=67650348192&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67650348192&partnerID=8YFLogxK

U2 - 10.1109/CIBCB.2009.4925739

DO - 10.1109/CIBCB.2009.4925739

M3 - Conference contribution

AN - SCOPUS:67650348192

SN - 9781424427567

T3 - 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings

SP - 278

EP - 283

BT - 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings

ER -

Chang CY, Tsai JS, Wang C-J, Chung P-C. Emotion recognition with consideration of facial expression and physiological signals. In 2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings. 2009. p. 278-283. 4925739. (2009 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB 2009 - Proceedings). https://doi.org/10.1109/CIBCB.2009.4925739