Subtly different facial expression recognition and expression intensity estimation

James Jenn-Jier Lien, Jeffrey F. Cohn, Takeo Kanade, Ching Chung Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

70 Citations (Scopus)

Abstract

We have developed a computer vision system, including both facial feature extraction and recognition, that automatically discriminates among subtly different facial expressions. Expression classification is based on Facial Action Coding System (FACS) action units (AUs), and discrimination is performed using Hidden Markov Models (HMMs). Three methods are developed to extract facial expression information for automatic recognition. The first method is facial feature point tracking using a coarse-to-fine pyramid method. This method is sensitive to subtle feature motion and is capable of handling large displacements with sub-pixel accuracy. The second method is dense flow tracking together with principal component analysis (PCA), where the entire facial motion information per frame is compressed to a low-dimensional weight vector. The third method is high gradient component (i.e., furrow) analysis in the spatio-temporal domain, which exploits the transient variation associated with the facial expression. Upon extraction of the facial information, non-rigid facial expression is separated from the rigid head motion component, and the face images are automatically aligned and normalized using an affine transformation. This system also provides expression intensity estimation, which has significant effect on the actual meaning of the expression.

Original languageEnglish
Title of host publicationProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Pages853-859
Number of pages7
DOIs
Publication statusPublished - 1998 Dec 1
EventProceedings of the 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Santa Barbara, CA, USA
Duration: 1998 Jun 231998 Jun 25

Publication series

NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
ISSN (Print)1063-6919

Other

OtherProceedings of the 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
CitySanta Barbara, CA, USA
Period98-06-2398-06-25

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering
  • Computer Vision and Pattern Recognition
  • Software
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'Subtly different facial expression recognition and expression intensity estimation'. Together they form a unique fingerprint.

  • Cite this

    Lien, J. J-J., Cohn, J. F., Kanade, T., & Li, C. C. (1998). Subtly different facial expression recognition and expression intensity estimation. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (pp. 853-859). (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition). https://doi.org/10.1109/CVPR.1998.698704