Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification

Qian Bei Hong, Chung Hsien Wu, Ming Hsiang Su, Kun Yi Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In clinical diagnosis of mood disorder, a large portion of bipolar disorder patients (BDs) are misdiagnosed as unipolar depression (UDs). Clinicians have confirmed that BDs generally show ''reduced affect'' during clinical treatment. Thus, it is expected to build an objective and one-time diagnosis system for diagnosis assistance by using machine-learning techniques. In this study, facial expressions of BD, UD and control group (C) elicited by emotional video clips are collected for exploring temporal fluctuation characteristics of intensities of facial muscles expression among the three groups. The differences of facial expressions among mood disorders are investigated by observing macroscopic fluctuations. To deal with these problems, the corresponding methods for feature extraction and modeling are proposed. From the viewpoint of macroscopic facial expression, action unit (AU) is applied for describing the temporal transformation of muscles. Then, modulation spectrum is used for extracting short-term variation of AU. The multilayer perceptron (MLP)-based disorder prediction model is then applied to obtain the prediction results. For evaluation of the proposed method, 12 subjects for three group are included in the K-fold (K=12) cross validation experiments. The experiment results reached 61.1\% classification accuracy, and outperformed the other baseline methods.

Original languageEnglish
Title of host publication2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538653111
DOIs
Publication statusPublished - 2018 Sep 21
Event1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018 - Beijing, China
Duration: 2018 May 202018 May 22

Publication series

Name2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018

Other

Other1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018
CountryChina
CityBeijing
Period18-05-2018-05-22

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Signal Processing
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification'. Together they form a unique fingerprint.

  • Cite this

    Hong, Q. B., Wu, C. H., Su, M. H., & Huang, K. Y. (2018). Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification. In 2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018 [8470337] (2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ACIIAsia.2018.8470337