Data mining for automatic communication behaviors identification

Y. J. Chen, Jiunn-Liang Wu, H. M. Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Children's interpersonal communication, personality, social adaptive capability, and learning ability are affected by the interaction with their caregivers. Therefore, it is important to improve the communication ability of caregiver and it can also improve children's language ability and communication behavior. We have to find the communication behavior of child and his/her caregiver from interactive actions and used this information to provide useful information to improve their communication ability. However, the communication behavior should be manually identified and it is a time-consuming process. In this paper, we proposed a data mining algorithm to find the communication behavior. First, child and caregiver have to play three games and the interactive actions are also recorded in video and speech. Those video and speech can help clinical linguists to evaluate the performance of communication behavior. Second, those interactive actions are processed by speech recognition, speech act annotation, and interchange annotation. The speech act and interchange are the most important factors of communication behavior. Third, data mining is proposed to find the most frequent sequences of speech act and interchange. This is the basis information of user's communication behavior. Finally, clinical linguist can easily evaluate the performance of caregiver and provide suggestions to improve their communication ability. Experimental results reveal the usefulness of the proposed method and system.

Original languageEnglish
Title of host publication6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech
Pages91-94
Number of pages4
DOIs
Publication statusPublished - 2010 Oct 22
Event6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech - Singapore, Singapore
Duration: 2010 Aug 12010 Aug 6

Publication series

NameIFMBE Proceedings
Volume31 IFMBE
ISSN (Print)1680-0737

Other

Other6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech
CountrySingapore
CitySingapore
Period10-08-0110-08-06

Fingerprint

Data mining
Communication
Interchanges
Speech recognition

All Science Journal Classification (ASJC) codes

  • Biomedical Engineering
  • Bioengineering

Cite this

Chen, Y. J., Wu, J-L., & Yang, H. M. (2010). Data mining for automatic communication behaviors identification. In 6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech (pp. 91-94). (IFMBE Proceedings; Vol. 31 IFMBE). https://doi.org/10.1007/978-3-642-14515-5_24
Chen, Y. J. ; Wu, Jiunn-Liang ; Yang, H. M. / Data mining for automatic communication behaviors identification. 6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech. 2010. pp. 91-94 (IFMBE Proceedings).
@inproceedings{70b7f89a1c2e4bb495adc5fe0045117b,
title = "Data mining for automatic communication behaviors identification",
abstract = "Children's interpersonal communication, personality, social adaptive capability, and learning ability are affected by the interaction with their caregivers. Therefore, it is important to improve the communication ability of caregiver and it can also improve children's language ability and communication behavior. We have to find the communication behavior of child and his/her caregiver from interactive actions and used this information to provide useful information to improve their communication ability. However, the communication behavior should be manually identified and it is a time-consuming process. In this paper, we proposed a data mining algorithm to find the communication behavior. First, child and caregiver have to play three games and the interactive actions are also recorded in video and speech. Those video and speech can help clinical linguists to evaluate the performance of communication behavior. Second, those interactive actions are processed by speech recognition, speech act annotation, and interchange annotation. The speech act and interchange are the most important factors of communication behavior. Third, data mining is proposed to find the most frequent sequences of speech act and interchange. This is the basis information of user's communication behavior. Finally, clinical linguist can easily evaluate the performance of caregiver and provide suggestions to improve their communication ability. Experimental results reveal the usefulness of the proposed method and system.",
author = "Chen, {Y. J.} and Jiunn-Liang Wu and Yang, {H. M.}",
year = "2010",
month = "10",
day = "22",
doi = "10.1007/978-3-642-14515-5_24",
language = "English",
isbn = "9783540790389",
series = "IFMBE Proceedings",
pages = "91--94",
booktitle = "6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech",

}

Chen, YJ, Wu, J-L & Yang, HM 2010, Data mining for automatic communication behaviors identification. in 6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech. IFMBE Proceedings, vol. 31 IFMBE, pp. 91-94, 6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech, Singapore, Singapore, 10-08-01. https://doi.org/10.1007/978-3-642-14515-5_24

Data mining for automatic communication behaviors identification. / Chen, Y. J.; Wu, Jiunn-Liang; Yang, H. M.

6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech. 2010. p. 91-94 (IFMBE Proceedings; Vol. 31 IFMBE).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Data mining for automatic communication behaviors identification

AU - Chen, Y. J.

AU - Wu, Jiunn-Liang

AU - Yang, H. M.

PY - 2010/10/22

Y1 - 2010/10/22

N2 - Children's interpersonal communication, personality, social adaptive capability, and learning ability are affected by the interaction with their caregivers. Therefore, it is important to improve the communication ability of caregiver and it can also improve children's language ability and communication behavior. We have to find the communication behavior of child and his/her caregiver from interactive actions and used this information to provide useful information to improve their communication ability. However, the communication behavior should be manually identified and it is a time-consuming process. In this paper, we proposed a data mining algorithm to find the communication behavior. First, child and caregiver have to play three games and the interactive actions are also recorded in video and speech. Those video and speech can help clinical linguists to evaluate the performance of communication behavior. Second, those interactive actions are processed by speech recognition, speech act annotation, and interchange annotation. The speech act and interchange are the most important factors of communication behavior. Third, data mining is proposed to find the most frequent sequences of speech act and interchange. This is the basis information of user's communication behavior. Finally, clinical linguist can easily evaluate the performance of caregiver and provide suggestions to improve their communication ability. Experimental results reveal the usefulness of the proposed method and system.

AB - Children's interpersonal communication, personality, social adaptive capability, and learning ability are affected by the interaction with their caregivers. Therefore, it is important to improve the communication ability of caregiver and it can also improve children's language ability and communication behavior. We have to find the communication behavior of child and his/her caregiver from interactive actions and used this information to provide useful information to improve their communication ability. However, the communication behavior should be manually identified and it is a time-consuming process. In this paper, we proposed a data mining algorithm to find the communication behavior. First, child and caregiver have to play three games and the interactive actions are also recorded in video and speech. Those video and speech can help clinical linguists to evaluate the performance of communication behavior. Second, those interactive actions are processed by speech recognition, speech act annotation, and interchange annotation. The speech act and interchange are the most important factors of communication behavior. Third, data mining is proposed to find the most frequent sequences of speech act and interchange. This is the basis information of user's communication behavior. Finally, clinical linguist can easily evaluate the performance of caregiver and provide suggestions to improve their communication ability. Experimental results reveal the usefulness of the proposed method and system.

UR - http://www.scopus.com/inward/record.url?scp=77957983970&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77957983970&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-14515-5_24

DO - 10.1007/978-3-642-14515-5_24

M3 - Conference contribution

SN - 9783540790389

T3 - IFMBE Proceedings

SP - 91

EP - 94

BT - 6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech

ER -

Chen YJ, Wu J-L, Yang HM. Data mining for automatic communication behaviors identification. In 6th World Congress of Biomechanics, WCB 2010 - In Conjunction with 14th International Conference on Biomedical Engineering, ICBME and 5th Asia Pacific Conference on Biomechanics, APBiomech. 2010. p. 91-94. (IFMBE Proceedings). https://doi.org/10.1007/978-3-642-14515-5_24