Emotion-Specific Facial Activation Maps Based on Infrared Thermal Image Sequences

Bo Lin Jian, Chieh-Li Chen, Min Wei Huang, Her Terng Yau

Research output: Contribution to journalArticle

Abstract

Research on emotion recognition has recently started to gain increased attention. Inner emotions or thought activity can be determined by analyzing facial expression, behavioral responses, audio, and physiological signals. Facial expression is now recognized as an important form of non-verbal interaction. In this paper, emotion-specific activation maps were constructed to establish infrared thermal facial image sequences as an alternative approach to the determination of the correlation between emotional triggers and changes in facial temperature. During the testing process, data stored in the International Affective Picture System were used to create emotional clips that triggered three different types of emotion in the subjects, and their infrared thermal facial image sequences were simultaneously recorded. For processing, an image calibration protocol was first employed to reduce the variance produced by irregular micro-shifts in the faces of the subjects, followed by independent component analysis and statistical analysis protocols to create the facial emotional activation maps. The test results showed that the problem of selecting local regions when analyzing frame temperature had been resolved. The emotion-specific facial activation maps provide visualized results that facilitate the observation and understanding of information.

Original languageEnglish
Article number8679994
Pages (from-to)48046-48052
Number of pages7
JournalIEEE Access
Volume7
DOIs
Publication statusPublished - 2019 Jan 1

Fingerprint

Chemical activation
Infrared radiation
Independent component analysis
Statistical methods
Image processing
Calibration
Temperature
Testing
Hot Temperature

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Cite this

Jian, Bo Lin ; Chen, Chieh-Li ; Huang, Min Wei ; Yau, Her Terng. / Emotion-Specific Facial Activation Maps Based on Infrared Thermal Image Sequences. In: IEEE Access. 2019 ; Vol. 7. pp. 48046-48052.
@article{16b1639a859e43e6a83565ae5b1981a3,
title = "Emotion-Specific Facial Activation Maps Based on Infrared Thermal Image Sequences",
abstract = "Research on emotion recognition has recently started to gain increased attention. Inner emotions or thought activity can be determined by analyzing facial expression, behavioral responses, audio, and physiological signals. Facial expression is now recognized as an important form of non-verbal interaction. In this paper, emotion-specific activation maps were constructed to establish infrared thermal facial image sequences as an alternative approach to the determination of the correlation between emotional triggers and changes in facial temperature. During the testing process, data stored in the International Affective Picture System were used to create emotional clips that triggered three different types of emotion in the subjects, and their infrared thermal facial image sequences were simultaneously recorded. For processing, an image calibration protocol was first employed to reduce the variance produced by irregular micro-shifts in the faces of the subjects, followed by independent component analysis and statistical analysis protocols to create the facial emotional activation maps. The test results showed that the problem of selecting local regions when analyzing frame temperature had been resolved. The emotion-specific facial activation maps provide visualized results that facilitate the observation and understanding of information.",
author = "Jian, {Bo Lin} and Chieh-Li Chen and Huang, {Min Wei} and Yau, {Her Terng}",
year = "2019",
month = "1",
day = "1",
doi = "10.1109/ACCESS.2019.2908819",
language = "English",
volume = "7",
pages = "48046--48052",
journal = "IEEE Access",
issn = "2169-3536",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

Emotion-Specific Facial Activation Maps Based on Infrared Thermal Image Sequences. / Jian, Bo Lin; Chen, Chieh-Li; Huang, Min Wei; Yau, Her Terng.

In: IEEE Access, Vol. 7, 8679994, 01.01.2019, p. 48046-48052.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Emotion-Specific Facial Activation Maps Based on Infrared Thermal Image Sequences

AU - Jian, Bo Lin

AU - Chen, Chieh-Li

AU - Huang, Min Wei

AU - Yau, Her Terng

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Research on emotion recognition has recently started to gain increased attention. Inner emotions or thought activity can be determined by analyzing facial expression, behavioral responses, audio, and physiological signals. Facial expression is now recognized as an important form of non-verbal interaction. In this paper, emotion-specific activation maps were constructed to establish infrared thermal facial image sequences as an alternative approach to the determination of the correlation between emotional triggers and changes in facial temperature. During the testing process, data stored in the International Affective Picture System were used to create emotional clips that triggered three different types of emotion in the subjects, and their infrared thermal facial image sequences were simultaneously recorded. For processing, an image calibration protocol was first employed to reduce the variance produced by irregular micro-shifts in the faces of the subjects, followed by independent component analysis and statistical analysis protocols to create the facial emotional activation maps. The test results showed that the problem of selecting local regions when analyzing frame temperature had been resolved. The emotion-specific facial activation maps provide visualized results that facilitate the observation and understanding of information.

AB - Research on emotion recognition has recently started to gain increased attention. Inner emotions or thought activity can be determined by analyzing facial expression, behavioral responses, audio, and physiological signals. Facial expression is now recognized as an important form of non-verbal interaction. In this paper, emotion-specific activation maps were constructed to establish infrared thermal facial image sequences as an alternative approach to the determination of the correlation between emotional triggers and changes in facial temperature. During the testing process, data stored in the International Affective Picture System were used to create emotional clips that triggered three different types of emotion in the subjects, and their infrared thermal facial image sequences were simultaneously recorded. For processing, an image calibration protocol was first employed to reduce the variance produced by irregular micro-shifts in the faces of the subjects, followed by independent component analysis and statistical analysis protocols to create the facial emotional activation maps. The test results showed that the problem of selecting local regions when analyzing frame temperature had been resolved. The emotion-specific facial activation maps provide visualized results that facilitate the observation and understanding of information.

UR - http://www.scopus.com/inward/record.url?scp=85065192902&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065192902&partnerID=8YFLogxK

U2 - 10.1109/ACCESS.2019.2908819

DO - 10.1109/ACCESS.2019.2908819

M3 - Article

AN - SCOPUS:85065192902

VL - 7

SP - 48046

EP - 48052

JO - IEEE Access

JF - IEEE Access

SN - 2169-3536

M1 - 8679994

ER -