Using facial expression to detect emotion in e-learning system: A deep learning method

Ai Sun, Ying Jian Li, Yueh Min Huang, Qiong Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

E-learning system is becoming more and more popular among students nowadays. However, the emotion of students is usually neglected in e-learning system. This study is mainly concerned about using facial expression to detect emotion in e-learning system. A deep learning method called convolutional neural network (CNN) is used in our research. Firstly, CNN is introduced to detect emotion in e-learning system based on using facial expression in this paper. Secondly, the training process and testing process of CNN are described. To learn about the accuracy of CNN in emotion detection, three databases (CK+, JAFFE and NVIE) are chosen to train and test the model. 10-fold cross validation method is used to calculate the accuracy. Thirdly, we introduce how to apply the trained CNN to e-learning system, and the design of e-learning system with emotion detection module is given. At last, we propose the design of an experiment to evaluate the performance of this method in real e-learning system.

Original languageEnglish
Title of host publicationEmerging Technologies for Education - 2nd International Symposium, SETE 2017, Held in Conjunction with ICWL 2017, Revised Selected Papers
EditorsTien-Chi Huang, Rynson Lau, Yueh-Min Huang, Marc Spaniol, Chun-Hung Yuen
PublisherSpringer Verlag
Pages446-455
Number of pages10
ISBN (Print)9783319710839
DOIs
Publication statusPublished - 2017 Jan 1
Event2nd International Symposium on Emerging Technologies for Education, SETE 2017, held in Conjunction with the 16th International Conference on Web-based learning, ICWL 2017 - Cape Town, South Africa
Duration: 2017 Sep 202017 Sep 22

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10676 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other2nd International Symposium on Emerging Technologies for Education, SETE 2017, held in Conjunction with the 16th International Conference on Web-based learning, ICWL 2017
CountrySouth Africa
CityCape Town
Period17-09-2017-09-22

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Using facial expression to detect emotion in e-learning system: A deep learning method'. Together they form a unique fingerprint.

  • Cite this

    Sun, A., Li, Y. J., Huang, Y. M., & Li, Q. (2017). Using facial expression to detect emotion in e-learning system: A deep learning method. In T-C. Huang, R. Lau, Y-M. Huang, M. Spaniol, & C-H. Yuen (Eds.), Emerging Technologies for Education - 2nd International Symposium, SETE 2017, Held in Conjunction with ICWL 2017, Revised Selected Papers (pp. 446-455). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10676 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-71084-6_52