Dialog State Tracking and action selection using deep learning mechanism for interview coaching

Ming Hsiang Su, Kun Yi Huang, Tsung Hsien Yang, Kuan Jung Lai, Chung Hsien Wu

研究成果: Conference contribution

4 引文 斯高帕斯(Scopus)

摘要

The best way to prepare for an interview is to review the different types of possible interview questions you will be asked during an interview and practice responding to questions. An interview coaching system tries to simulate an interviewer to provide mock interview practice simulation sessions for the users. The traditional interview coaching systems provide some feedbacks, including facial preference, head nodding, response time, speaking rate, and volume, to let users know their own performance in the mock interview. But most of these systems are trained with insufficient dialog data and provide the pre-designed interview questions. In this study, we propose an approach to dialog state tracking and action selection based on deep learning methods. First, the interview corpus in this study is collected from 12 participants, and is annotated with dialog states and actions. Next, a long-short term memory and an artificial neural network are employed to predict dialog states and the Deep RL is adopted to learn the relation between dialog states and actions. Finally, the selected action is used to generate the interview question for interview practice. To evaluate the proposed method in action selection, an interview coaching system is constructed. Experimental results show the effectiveness of the proposed method for dialog state tracking and action selection.

原文English
主出版物標題Proceedings of the 2016 International Conference on Asian Language Processing, IALP 2016
編輯Minghui Dong, Chung-Hsien Wu, Yanfeng Lu, Haizhou Li, Yuen-Hsien Tseng, Liang-Chih Yu, Lung-Hao Lee
發行者Institute of Electrical and Electronics Engineers Inc.
頁面6-9
頁數4
ISBN(電子)9781509009213
DOIs
出版狀態Published - 2017 3月 10
事件20th International Conference on Asian Language Processing, IALP 2016 - Tainan, Taiwan
持續時間: 2016 11月 212016 11月 23

出版系列

名字Proceedings of the 2016 International Conference on Asian Language Processing, IALP 2016

Other

Other20th International Conference on Asian Language Processing, IALP 2016
國家/地區Taiwan
城市Tainan
期間16-11-2116-11-23

All Science Journal Classification (ASJC) codes

  • 訊號處理
  • 電腦視覺和模式識別
  • 語言和語言學
  • 人工智慧

指紋

深入研究「Dialog State Tracking and action selection using deep learning mechanism for interview coaching」主題。共同形成了獨特的指紋。

引用此