Real-time sign language recognition in complex background scene based on a hierarchical clustering classification method

Tse Yu Pan, Li Yun Lo, Chung Wei Yeh, Jhe Wei Li, Hou Tim Liu, Min Chun Hu

研究成果: Conference contribution

47 引文 斯高帕斯(Scopus)

摘要

Cameras are embedded in many mobile/wearable devices and can be used for gesture recognition or even sign language recognition to help the deaf people communicate with others. In this paper, we proposed a vision-based gesture recognition system which can be used in environments with complex background. We design a method to adaptively update the skin color model for different users and various lighting conditions. Three kinds of features are combined to describe the contours and the salient points of hand gestures. Principle Component Analysis (PCA), Linear Discriminant Analysis (LDA), and Support Vector Machine (SVM) are integrated to construct a novel hierarchical classification scheme. We evaluated the proposed recognition method on two datasets: (1) the CSL dataset collected by ourselves, in which images were captured in complex background. (2) The public ASL dataset, in which images of the same gesture were captured in different lighting conditions. Our method achieves the accuracies of 99.8% and 94%, respectively, which outperforms the existing works.

原文English
主出版物標題Proceedings - 2016 IEEE 2nd International Conference on Multimedia Big Data, BigMM 2016
發行者Institute of Electrical and Electronics Engineers Inc.
頁面64-67
頁數4
ISBN(電子)9781509021789
DOIs
出版狀態Published - 2016 8月 16
事件2nd IEEE International Conference on Multimedia Big Data, BigMM 2016 - Taipei, Taiwan
持續時間: 2016 4月 202016 4月 22

出版系列

名字Proceedings - 2016 IEEE 2nd International Conference on Multimedia Big Data, BigMM 2016

Other

Other2nd IEEE International Conference on Multimedia Big Data, BigMM 2016
國家/地區Taiwan
城市Taipei
期間16-04-2016-04-22

All Science Journal Classification (ASJC) codes

  • 訊號處理
  • 資訊系統
  • 媒體技術

指紋

深入研究「Real-time sign language recognition in complex background scene based on a hierarchical clustering classification method」主題。共同形成了獨特的指紋。

引用此