Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification

Qian Bei Hong, Chung Hsien Wu, Ming Hsiang Su, Kun Yi Huang

研究成果: Conference contribution

1 引文 (Scopus)

摘要

In clinical diagnosis of mood disorder, a large portion of bipolar disorder patients (BDs) are misdiagnosed as unipolar depression (UDs). Clinicians have confirmed that BDs generally show ''reduced affect'' during clinical treatment. Thus, it is expected to build an objective and one-time diagnosis system for diagnosis assistance by using machine-learning techniques. In this study, facial expressions of BD, UD and control group (C) elicited by emotional video clips are collected for exploring temporal fluctuation characteristics of intensities of facial muscles expression among the three groups. The differences of facial expressions among mood disorders are investigated by observing macroscopic fluctuations. To deal with these problems, the corresponding methods for feature extraction and modeling are proposed. From the viewpoint of macroscopic facial expression, action unit (AU) is applied for describing the temporal transformation of muscles. Then, modulation spectrum is used for extracting short-term variation of AU. The multilayer perceptron (MLP)-based disorder prediction model is then applied to obtain the prediction results. For evaluation of the proposed method, 12 subjects for three group are included in the K-fold (K=12) cross validation experiments. The experiment results reached 61.1\% classification accuracy, and outperformed the other baseline methods.

原文English
主出版物標題2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018
發行者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子)9781538653111
DOIs
出版狀態Published - 2018 九月 21
事件1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018 - Beijing, China
持續時間: 2018 五月 202018 五月 22

出版系列

名字2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018

Other

Other1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018
國家China
城市Beijing
期間18-05-2018-05-22

指紋

Muscle
Multilayer neural networks
Learning systems
Feature extraction
Experiments
Modulation

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Signal Processing
  • Artificial Intelligence

引用此文

Hong, Q. B., Wu, C. H., Su, M. H., & Huang, K. Y. (2018). Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification. 於 2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018 [8470337] (2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ACIIAsia.2018.8470337
Hong, Qian Bei ; Wu, Chung Hsien ; Su, Ming Hsiang ; Huang, Kun Yi. / Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification. 2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018. Institute of Electrical and Electronics Engineers Inc., 2018. (2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018).
@inproceedings{01dc37c775a14fe5a67252182840ea49,
title = "Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification",
abstract = "In clinical diagnosis of mood disorder, a large portion of bipolar disorder patients (BDs) are misdiagnosed as unipolar depression (UDs). Clinicians have confirmed that BDs generally show ''reduced affect'' during clinical treatment. Thus, it is expected to build an objective and one-time diagnosis system for diagnosis assistance by using machine-learning techniques. In this study, facial expressions of BD, UD and control group (C) elicited by emotional video clips are collected for exploring temporal fluctuation characteristics of intensities of facial muscles expression among the three groups. The differences of facial expressions among mood disorders are investigated by observing macroscopic fluctuations. To deal with these problems, the corresponding methods for feature extraction and modeling are proposed. From the viewpoint of macroscopic facial expression, action unit (AU) is applied for describing the temporal transformation of muscles. Then, modulation spectrum is used for extracting short-term variation of AU. The multilayer perceptron (MLP)-based disorder prediction model is then applied to obtain the prediction results. For evaluation of the proposed method, 12 subjects for three group are included in the K-fold (K=12) cross validation experiments. The experiment results reached 61.1\{\%} classification accuracy, and outperformed the other baseline methods.",
author = "Hong, {Qian Bei} and Wu, {Chung Hsien} and Su, {Ming Hsiang} and Huang, {Kun Yi}",
year = "2018",
month = "9",
day = "21",
doi = "10.1109/ACIIAsia.2018.8470337",
language = "English",
series = "2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018",
address = "United States",

}

Hong, QB, Wu, CH, Su, MH & Huang, KY 2018, Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification. 於 2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018., 8470337, 2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018, Institute of Electrical and Electronics Engineers Inc., 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018, Beijing, China, 18-05-20. https://doi.org/10.1109/ACIIAsia.2018.8470337

Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification. / Hong, Qian Bei; Wu, Chung Hsien; Su, Ming Hsiang; Huang, Kun Yi.

2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018. Institute of Electrical and Electronics Engineers Inc., 2018. 8470337 (2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018).

研究成果: Conference contribution

TY - GEN

T1 - Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification

AU - Hong, Qian Bei

AU - Wu, Chung Hsien

AU - Su, Ming Hsiang

AU - Huang, Kun Yi

PY - 2018/9/21

Y1 - 2018/9/21

N2 - In clinical diagnosis of mood disorder, a large portion of bipolar disorder patients (BDs) are misdiagnosed as unipolar depression (UDs). Clinicians have confirmed that BDs generally show ''reduced affect'' during clinical treatment. Thus, it is expected to build an objective and one-time diagnosis system for diagnosis assistance by using machine-learning techniques. In this study, facial expressions of BD, UD and control group (C) elicited by emotional video clips are collected for exploring temporal fluctuation characteristics of intensities of facial muscles expression among the three groups. The differences of facial expressions among mood disorders are investigated by observing macroscopic fluctuations. To deal with these problems, the corresponding methods for feature extraction and modeling are proposed. From the viewpoint of macroscopic facial expression, action unit (AU) is applied for describing the temporal transformation of muscles. Then, modulation spectrum is used for extracting short-term variation of AU. The multilayer perceptron (MLP)-based disorder prediction model is then applied to obtain the prediction results. For evaluation of the proposed method, 12 subjects for three group are included in the K-fold (K=12) cross validation experiments. The experiment results reached 61.1\% classification accuracy, and outperformed the other baseline methods.

AB - In clinical diagnosis of mood disorder, a large portion of bipolar disorder patients (BDs) are misdiagnosed as unipolar depression (UDs). Clinicians have confirmed that BDs generally show ''reduced affect'' during clinical treatment. Thus, it is expected to build an objective and one-time diagnosis system for diagnosis assistance by using machine-learning techniques. In this study, facial expressions of BD, UD and control group (C) elicited by emotional video clips are collected for exploring temporal fluctuation characteristics of intensities of facial muscles expression among the three groups. The differences of facial expressions among mood disorders are investigated by observing macroscopic fluctuations. To deal with these problems, the corresponding methods for feature extraction and modeling are proposed. From the viewpoint of macroscopic facial expression, action unit (AU) is applied for describing the temporal transformation of muscles. Then, modulation spectrum is used for extracting short-term variation of AU. The multilayer perceptron (MLP)-based disorder prediction model is then applied to obtain the prediction results. For evaluation of the proposed method, 12 subjects for three group are included in the K-fold (K=12) cross validation experiments. The experiment results reached 61.1\% classification accuracy, and outperformed the other baseline methods.

UR - http://www.scopus.com/inward/record.url?scp=85055491921&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055491921&partnerID=8YFLogxK

U2 - 10.1109/ACIIAsia.2018.8470337

DO - 10.1109/ACIIAsia.2018.8470337

M3 - Conference contribution

AN - SCOPUS:85055491921

T3 - 2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018

BT - 2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Hong QB, Wu CH, Su MH, Huang KY. Exploring Macroscopic Fluctuation of Facial Expression for Mood Disorder Classification. 於 2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018. Institute of Electrical and Electronics Engineers Inc. 2018. 8470337. (2018 1st Asian Conference on Affective Computing and Intelligent Interaction, ACII Asia 2018). https://doi.org/10.1109/ACIIAsia.2018.8470337