Natural language processing for Taiwanese sign language to speech conversion

Chung Hsien Wu, Yu Hsien Chiu, Chi Shiang Guo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper addresses some natural language processing technologies in generating sentences from ill-formed Taiwanese Sign Language (TSL) for people with speech or hearing impairments. The design and development of the PC-based TSL Augmentative and Alternative Communication (AAC) system aims to improve the input rate and accuracy of communication aids. We demonstrate 1) developing an effective TSL virtual keyboard to assist users to efficiently input sign sequences, 2) investigating TSL prediction strategies for input rate enhancement, 3) integrating bottom-up parsing with top-down filtering strategy and variable N-gram language model for sentence generation and selection. The proposed system assists people with language defects in sentence formation and grammatical correction. To evaluate the performance of our approach, a pilot study for clinical evaluation and education training was undertaken. Evaluation results show that the generation rate and subjective satisfactory level for sentence construction have been significantly improved.

Original languageEnglish
Title of host publication6th International Conference on Spoken Language Processing, ICSLP 2000
PublisherInternational Speech Communication Association
ISBN (Electronic)7801501144, 9787801501141
Publication statusPublished - 2000
Event6th International Conference on Spoken Language Processing, ICSLP 2000 - Beijing, China
Duration: 2000 Oct 162000 Oct 20

Publication series

Name6th International Conference on Spoken Language Processing, ICSLP 2000

Other

Other6th International Conference on Spoken Language Processing, ICSLP 2000
CountryChina
CityBeijing
Period00-10-1600-10-20

All Science Journal Classification (ASJC) codes

  • Linguistics and Language
  • Language and Linguistics

Fingerprint Dive into the research topics of 'Natural language processing for Taiwanese sign language to speech conversion'. Together they form a unique fingerprint.

Cite this