Eat as much as you can: A Kinect-based facial rehabilitation game based on mouth and tongue movements

Yong Xiang Wang, Li Yun Lo, Min-Chun Hu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

In this demo, we present a Kinect-based interactive game which provides patients of facial palsy with a better and more fun way to perform facial physical therapy. By letting the user get scores when he/she bites or licks the virtual foods falling from the sky, the game goads the user into exercising their facial muscles. A robust bite action detector and an efficient tip-of-tongue locating method are developed to realize this game. Based on the head pose estimated by the depth clue, we classify the face orientation and locate the mouth region in each frame. The movements of lips are measured to detect the bite action, and different strategies are designed to more accurately detect the tip-of-tongue for various face orientations. The experimental results show that our method can be successfully applied to different users.

Original languageEnglish
Title of host publicationMM 2014 - Proceedings of the 2014 ACM Conference on Multimedia
PublisherAssociation for Computing Machinery, Inc
Pages743-744
Number of pages2
ISBN (Electronic)9781450330633
DOIs
Publication statusPublished - 2014 Nov 3
Event2014 ACM Conference on Multimedia, MM 2014 - Orlando, United States
Duration: 2014 Nov 32014 Nov 7

Publication series

NameMM 2014 - Proceedings of the 2014 ACM Conference on Multimedia

Other

Other2014 ACM Conference on Multimedia, MM 2014
CountryUnited States
CityOrlando
Period14-11-0314-11-07

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Media Technology
  • Software

Fingerprint Dive into the research topics of 'Eat as much as you can: A Kinect-based facial rehabilitation game based on mouth and tongue movements'. Together they form a unique fingerprint.

  • Cite this

    Wang, Y. X., Lo, L. Y., & Hu, M-C. (2014). Eat as much as you can: A Kinect-based facial rehabilitation game based on mouth and tongue movements. In MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia (pp. 743-744). (MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia). Association for Computing Machinery, Inc. https://doi.org/10.1145/2647868.2654887