Action tutor

Real-time exemplar-based sequential movement assessment with kinect sensor

Chi Wen Chen, Min-Chun Hu, Wen Huang Cheng, Che Han Chang, Jui Hsin Lai, Ja Ling Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

With the aid of depth camera, such as Microsoft Kinect, the difficulty of vision-based posture estimation is greatly decreased, and human action analysis has achieved a wide range of applications. However, there is still much to do to develop effective movement assessment technique, which bridges the results of human posture estimation and the understanding of human action performance. In this work, we propose an action tutor system which enables the user to interactively retrieve the learning exemplar of the target action movement and to immediately acquire motion instructions while learning it in front of the Kinect. In the retrieval stage, non-linear time warping algorithms are designed to retrieve video segments similar to the query movement roughly performed by the user. In the learning stage, the user learns according to the selected video exemplar, and the motion assessment including both static and dynamic differences is presented to the user in a more effective and organized way, helping him/her to perform the action movement correctly.

Original languageEnglish
Title of host publicationMM 2012 - Proceedings of the 20th ACM International Conference on Multimedia
Pages1263-1264
Number of pages2
DOIs
Publication statusPublished - 2012 Dec 26
Event20th ACM International Conference on Multimedia, MM 2012 - Nara, Japan
Duration: 2012 Oct 292012 Nov 2

Publication series

NameMM 2012 - Proceedings of the 20th ACM International Conference on Multimedia

Other

Other20th ACM International Conference on Multimedia, MM 2012
CountryJapan
CityNara
Period12-10-2912-11-02

Fingerprint

Sensors
Cameras

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Cite this

Chen, C. W., Hu, M-C., Cheng, W. H., Chang, C. H., Lai, J. H., & Wu, J. L. (2012). Action tutor: Real-time exemplar-based sequential movement assessment with kinect sensor. In MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia (pp. 1263-1264). (MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia). https://doi.org/10.1145/2393347.2396433
Chen, Chi Wen ; Hu, Min-Chun ; Cheng, Wen Huang ; Chang, Che Han ; Lai, Jui Hsin ; Wu, Ja Ling. / Action tutor : Real-time exemplar-based sequential movement assessment with kinect sensor. MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia. 2012. pp. 1263-1264 (MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia).
@inproceedings{6b4d98b520524d06a089c654ddcc0fed,
title = "Action tutor: Real-time exemplar-based sequential movement assessment with kinect sensor",
abstract = "With the aid of depth camera, such as Microsoft Kinect, the difficulty of vision-based posture estimation is greatly decreased, and human action analysis has achieved a wide range of applications. However, there is still much to do to develop effective movement assessment technique, which bridges the results of human posture estimation and the understanding of human action performance. In this work, we propose an action tutor system which enables the user to interactively retrieve the learning exemplar of the target action movement and to immediately acquire motion instructions while learning it in front of the Kinect. In the retrieval stage, non-linear time warping algorithms are designed to retrieve video segments similar to the query movement roughly performed by the user. In the learning stage, the user learns according to the selected video exemplar, and the motion assessment including both static and dynamic differences is presented to the user in a more effective and organized way, helping him/her to perform the action movement correctly.",
author = "Chen, {Chi Wen} and Min-Chun Hu and Cheng, {Wen Huang} and Chang, {Che Han} and Lai, {Jui Hsin} and Wu, {Ja Ling}",
year = "2012",
month = "12",
day = "26",
doi = "10.1145/2393347.2396433",
language = "English",
isbn = "9781450310895",
series = "MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia",
pages = "1263--1264",
booktitle = "MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia",

}

Chen, CW, Hu, M-C, Cheng, WH, Chang, CH, Lai, JH & Wu, JL 2012, Action tutor: Real-time exemplar-based sequential movement assessment with kinect sensor. in MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia. MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia, pp. 1263-1264, 20th ACM International Conference on Multimedia, MM 2012, Nara, Japan, 12-10-29. https://doi.org/10.1145/2393347.2396433

Action tutor : Real-time exemplar-based sequential movement assessment with kinect sensor. / Chen, Chi Wen; Hu, Min-Chun; Cheng, Wen Huang; Chang, Che Han; Lai, Jui Hsin; Wu, Ja Ling.

MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia. 2012. p. 1263-1264 (MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Action tutor

T2 - Real-time exemplar-based sequential movement assessment with kinect sensor

AU - Chen, Chi Wen

AU - Hu, Min-Chun

AU - Cheng, Wen Huang

AU - Chang, Che Han

AU - Lai, Jui Hsin

AU - Wu, Ja Ling

PY - 2012/12/26

Y1 - 2012/12/26

N2 - With the aid of depth camera, such as Microsoft Kinect, the difficulty of vision-based posture estimation is greatly decreased, and human action analysis has achieved a wide range of applications. However, there is still much to do to develop effective movement assessment technique, which bridges the results of human posture estimation and the understanding of human action performance. In this work, we propose an action tutor system which enables the user to interactively retrieve the learning exemplar of the target action movement and to immediately acquire motion instructions while learning it in front of the Kinect. In the retrieval stage, non-linear time warping algorithms are designed to retrieve video segments similar to the query movement roughly performed by the user. In the learning stage, the user learns according to the selected video exemplar, and the motion assessment including both static and dynamic differences is presented to the user in a more effective and organized way, helping him/her to perform the action movement correctly.

AB - With the aid of depth camera, such as Microsoft Kinect, the difficulty of vision-based posture estimation is greatly decreased, and human action analysis has achieved a wide range of applications. However, there is still much to do to develop effective movement assessment technique, which bridges the results of human posture estimation and the understanding of human action performance. In this work, we propose an action tutor system which enables the user to interactively retrieve the learning exemplar of the target action movement and to immediately acquire motion instructions while learning it in front of the Kinect. In the retrieval stage, non-linear time warping algorithms are designed to retrieve video segments similar to the query movement roughly performed by the user. In the learning stage, the user learns according to the selected video exemplar, and the motion assessment including both static and dynamic differences is presented to the user in a more effective and organized way, helping him/her to perform the action movement correctly.

UR - http://www.scopus.com/inward/record.url?scp=84871371385&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871371385&partnerID=8YFLogxK

U2 - 10.1145/2393347.2396433

DO - 10.1145/2393347.2396433

M3 - Conference contribution

SN - 9781450310895

T3 - MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia

SP - 1263

EP - 1264

BT - MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia

ER -

Chen CW, Hu M-C, Cheng WH, Chang CH, Lai JH, Wu JL. Action tutor: Real-time exemplar-based sequential movement assessment with kinect sensor. In MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia. 2012. p. 1263-1264. (MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia). https://doi.org/10.1145/2393347.2396433