A friendly and intelligent human-robot interface system based on human face and hand gesture

Ming Shaung Chang; Jung-Hua Chou

doi:10.1109/AIM.2009.5229793

A friendly and intelligent human-robot interface system based on human face and hand gesture

Ming Shaung Chang, Jung-Hua Chou

Department of Engineering Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

5 Citations (Scopus)

Abstract

A friendly and intelligent human-robot interface (HRI) system based on machine vision is established in this paper. A user uses his/her face and hand gestures to communicate with the robot. Three kinds of face detection, including shape, similarity and lip detections, are adopted to improve the recognition accuracy. The recognition of hand gestures is implemented through PCA, BPANN and their combined classifier. Successive dynamic commands are processed by dynamic programming. Experimental results show that the devised natural HRI works well and the system can process 8 image frames per second for practical real time applications.

Original language	English
Title of host publication	2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009
Pages	1856-1861
Number of pages	6
DOIs	https://doi.org/10.1109/AIM.2009.5229793
Publication status	Published - 2009 Nov 4
Event	2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009 - Singapore, Singapore Duration: 2009 Jul 14 → 2009 Jul 17

Publication series

Name	IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM

Other

Other	2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009
Country/Territory	Singapore
City	Singapore
Period	09-07-14 → 09-07-17

All Science Journal Classification (ASJC) codes

Electrical and Electronic Engineering
Control and Systems Engineering
Computer Science Applications
Software

Access to Document

10.1109/AIM.2009.5229793

Cite this

@inproceedings{af659061f44040edb3663d261a08004d,

title = "A friendly and intelligent human-robot interface system based on human face and hand gesture",

abstract = "A friendly and intelligent human-robot interface (HRI) system based on machine vision is established in this paper. A user uses his/her face and hand gestures to communicate with the robot. Three kinds of face detection, including shape, similarity and lip detections, are adopted to improve the recognition accuracy. The recognition of hand gestures is implemented through PCA, BPANN and their combined classifier. Successive dynamic commands are processed by dynamic programming. Experimental results show that the devised natural HRI works well and the system can process 8 image frames per second for practical real time applications.",

author = "Chang, {Ming Shaung} and Jung-Hua Chou",

year = "2009",

month = nov,

day = "4",

doi = "10.1109/AIM.2009.5229793",

language = "English",

isbn = "9781424428533",

series = "IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM",

pages = "1856--1861",

booktitle = "2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009",

note = "2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009 ; Conference date: 14-07-2009 Through 17-07-2009",

}

Chang, MS & Chou, J-H 2009, A friendly and intelligent human-robot interface system based on human face and hand gesture. in 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009., 5229793, IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM, pp. 1856-1861, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009, Singapore, Singapore, 09-07-14. https://doi.org/10.1109/AIM.2009.5229793

A friendly and intelligent human-robot interface system based on human face and hand gesture. / Chang, Ming Shaung; Chou, Jung-Hua.
2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009. 2009. p. 1856-1861 5229793 (IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - A friendly and intelligent human-robot interface system based on human face and hand gesture

AU - Chang, Ming Shaung

AU - Chou, Jung-Hua

PY - 2009/11/4

Y1 - 2009/11/4

N2 - A friendly and intelligent human-robot interface (HRI) system based on machine vision is established in this paper. A user uses his/her face and hand gestures to communicate with the robot. Three kinds of face detection, including shape, similarity and lip detections, are adopted to improve the recognition accuracy. The recognition of hand gestures is implemented through PCA, BPANN and their combined classifier. Successive dynamic commands are processed by dynamic programming. Experimental results show that the devised natural HRI works well and the system can process 8 image frames per second for practical real time applications.

AB - A friendly and intelligent human-robot interface (HRI) system based on machine vision is established in this paper. A user uses his/her face and hand gestures to communicate with the robot. Three kinds of face detection, including shape, similarity and lip detections, are adopted to improve the recognition accuracy. The recognition of hand gestures is implemented through PCA, BPANN and their combined classifier. Successive dynamic commands are processed by dynamic programming. Experimental results show that the devised natural HRI works well and the system can process 8 image frames per second for practical real time applications.

UR - http://www.scopus.com/inward/record.url?scp=70350447824&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350447824&partnerID=8YFLogxK

U2 - 10.1109/AIM.2009.5229793

DO - 10.1109/AIM.2009.5229793

M3 - Conference contribution

AN - SCOPUS:70350447824

SN - 9781424428533

T3 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM

SP - 1856

EP - 1861

BT - 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009

T2 - 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2009

Y2 - 14 July 2009 through 17 July 2009

ER -

A friendly and intelligent human-robot interface system based on human face and hand gesture

Abstract

Publication series

Other

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this