Transformer-based Empathetic Response Generation Using Dialogue Situation and Advanced-Level Definition of Empathy

Yi Hsuan Wang, Jia Hao Hsu, Chung Hsien Wu, Tsung Hsien Yang

研究成果: Conference contribution

摘要

This study proposes an approach to transformer-based empathetic response generation using dialogue situation and advanced-level definition of empathy. First, SBERT is adopted to extract the dialog situation vector from the user's historical sentences. A BERT-based emotion detector, a topic detector and an information estimator are constructed for empathy-related feature extraction. The change of the emotional valance and the textual information gain, obtained from the emotion detector and the information estimator, are used for adversarial training of the transformer-based empathetic response generator. The loss function of the transformer is defined to measure how good the expected response in terms of fluency and empathy. The EmpatheticDialogues corpus was adopted for system training and evaluation on empathetic response generation. According to the experimental results, the BLEU score was increased to 7.821 after considering the dialogue situation feature and empathy definition, outperforming the comparison models. In terms of human subjective evaluation, three evaluation results of empathy, relevance and fluency for the proposed system are better than that for the baseline model.

原文English
主出版物標題2021 12th International Symposium on Chinese Spoken Language Processing, ISCSLP 2021
發行者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子)9781728169941
DOIs
出版狀態Published - 2021 一月 24
事件12th International Symposium on Chinese Spoken Language Processing, ISCSLP 2021 - Hong Kong, Hong Kong
持續時間: 2021 一月 242021 一月 27

出版系列

名字2021 12th International Symposium on Chinese Spoken Language Processing, ISCSLP 2021

Conference

Conference12th International Symposium on Chinese Spoken Language Processing, ISCSLP 2021
國家/地區Hong Kong
城市Hong Kong
期間21-01-2421-01-27

All Science Journal Classification (ASJC) codes

  • 人工智慧
  • 電腦科學應用
  • 電腦視覺和模式識別
  • 訊號處理
  • 語言和語言學

指紋

深入研究「Transformer-based Empathetic Response Generation Using Dialogue Situation and Advanced-Level Definition of Empathy」主題。共同形成了獨特的指紋。

引用此