Real-time sign language recognition in complex background scene based on a hierarchical clustering classification method

Tse Yu Pan, Li Yun Lo, Chung Wei Yeh, Jhe Wei Li, Hou Tim Liu, Min Chun Hu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)

Abstract

Cameras are embedded in many mobile/wearable devices and can be used for gesture recognition or even sign language recognition to help the deaf people communicate with others. In this paper, we proposed a vision-based gesture recognition system which can be used in environments with complex background. We design a method to adaptively update the skin color model for different users and various lighting conditions. Three kinds of features are combined to describe the contours and the salient points of hand gestures. Principle Component Analysis (PCA), Linear Discriminant Analysis (LDA), and Support Vector Machine (SVM) are integrated to construct a novel hierarchical classification scheme. We evaluated the proposed recognition method on two datasets: (1) the CSL dataset collected by ourselves, in which images were captured in complex background. (2) The public ASL dataset, in which images of the same gesture were captured in different lighting conditions. Our method achieves the accuracies of 99.8% and 94%, respectively, which outperforms the existing works.

Original languageEnglish
Title of host publicationProceedings - 2016 IEEE 2nd International Conference on Multimedia Big Data, BigMM 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages64-67
Number of pages4
ISBN (Electronic)9781509021789
DOIs
Publication statusPublished - 2016 Aug 16
Event2nd IEEE International Conference on Multimedia Big Data, BigMM 2016 - Taipei, Taiwan
Duration: 2016 Apr 202016 Apr 22

Publication series

NameProceedings - 2016 IEEE 2nd International Conference on Multimedia Big Data, BigMM 2016

Other

Other2nd IEEE International Conference on Multimedia Big Data, BigMM 2016
CountryTaiwan
CityTaipei
Period16-04-2016-04-22

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Information Systems
  • Media Technology

Fingerprint Dive into the research topics of 'Real-time sign language recognition in complex background scene based on a hierarchical clustering classification method'. Together they form a unique fingerprint.

Cite this