Automated facial expression recognition based on FACS action units

James Jenn-Jier Lien, Jeffrey F. Cohn, Takeo Kanade, Ching Chung Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

103 Citations (Scopus)

Abstract

Automated recognition of facial expression is an important addition to computer vision research because of its relevance to the study of psychological phenomena and the development of human-computer interaction (HCI). We developed a computer vision system that automatically recognizes individual action units or action unit combinations in the upper face using hidden Markov models (HMMs). Our approach to facial expression recognition is based an the Facial Action Coding System (FACS), which separates expressions into upper and lower face action. We use three approaches to extract facial expression information: (1) facial feature point tracking; (2) dense flow tracking with principal component analysis (PCA); and (3) high gradient component detection (i.e. furrow detection). The recognition results of the upper face expressions using feature point tracking, dense flow tracking, and high gradient component detection are 85%, 93% and 85%, respectively.

Original languageEnglish
Title of host publicationProceedings - 3rd IEEE International Conference on Automatic Face and Gesture Recognition, FG 1998
PublisherIEEE Computer Society
Pages390-395
Number of pages6
ISBN (Print)0818683449, 9780818683442
DOIs
Publication statusPublished - 1998 Jan 1
Event3rd IEEE International Conference on Automatic Face and Gesture Recognition, FG 1998 - Nara, Japan
Duration: 1998 Apr 141998 Apr 16

Publication series

NameProceedings - 3rd IEEE International Conference on Automatic Face and Gesture Recognition, FG 1998

Other

Other3rd IEEE International Conference on Automatic Face and Gesture Recognition, FG 1998
CountryJapan
CityNara
Period98-04-1498-04-16

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Automated facial expression recognition based on FACS action units'. Together they form a unique fingerprint.

  • Cite this

    Lien, J. J-J., Cohn, J. F., Kanade, T., & Li, C. C. (1998). Automated facial expression recognition based on FACS action units. In Proceedings - 3rd IEEE International Conference on Automatic Face and Gesture Recognition, FG 1998 (pp. 390-395). [670980] (Proceedings - 3rd IEEE International Conference on Automatic Face and Gesture Recognition, FG 1998). IEEE Computer Society. https://doi.org/10.1109/AFGR.1998.670980