Human motion retrieval from hand-drawn sketch

Min Wen Chao, Chao-Hung Lin, Jackie Assa, Tong-Yee Lee

Research output: Contribution to journalArticle

41 Citations (Scopus)

Abstract

The rapid growth of motion capture data increases the importance of motion retrieval. The majority of the existing motion retrieval approaches are based on a labor-intensive step in which the user browses and selects a desired query motion clip from the large motion clip database. In this work, a novel sketching interface for defining the query is presented. This simple approach allows users to define the required motion by sketching several motion strokes over a drawn character, which requires less effort and extends the users' expressiveness. To support the real-time interface, a specialized encoding of the motions and the hand-drawn query is required. Here, we introduce a novel hierarchical encoding scheme based on a set of orthonormal spherical harmonic (SH) basis functions, which provides a compact representation, and avoids the CPU/processing intensive stage of temporal alignment used by previous solutions. Experimental results show that the proposed approach can well retrieve the motions, and is capable of retrieve logically and numerically similar motions, which is superior to previous approaches. The user study shows that the proposed system can be a useful tool to input motion query if the users are familiar with it. Finally, an application of generating a 3D animation from a hand-drawn comics strip is demonstrated.

Original languageEnglish
Article number5728806
Pages (from-to)729-740
Number of pages12
JournalIEEE Transactions on Visualization and Computer Graphics
Volume18
Issue number5
DOIs
Publication statusPublished - 2012 Jan 1

Fingerprint

Animation
Program processors
Data acquisition
Personnel
Processing

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Cite this

@article{9a330412b27143828c985de9b531b736,
title = "Human motion retrieval from hand-drawn sketch",
abstract = "The rapid growth of motion capture data increases the importance of motion retrieval. The majority of the existing motion retrieval approaches are based on a labor-intensive step in which the user browses and selects a desired query motion clip from the large motion clip database. In this work, a novel sketching interface for defining the query is presented. This simple approach allows users to define the required motion by sketching several motion strokes over a drawn character, which requires less effort and extends the users' expressiveness. To support the real-time interface, a specialized encoding of the motions and the hand-drawn query is required. Here, we introduce a novel hierarchical encoding scheme based on a set of orthonormal spherical harmonic (SH) basis functions, which provides a compact representation, and avoids the CPU/processing intensive stage of temporal alignment used by previous solutions. Experimental results show that the proposed approach can well retrieve the motions, and is capable of retrieve logically and numerically similar motions, which is superior to previous approaches. The user study shows that the proposed system can be a useful tool to input motion query if the users are familiar with it. Finally, an application of generating a 3D animation from a hand-drawn comics strip is demonstrated.",
author = "Chao, {Min Wen} and Chao-Hung Lin and Jackie Assa and Tong-Yee Lee",
year = "2012",
month = "1",
day = "1",
doi = "10.1109/TVCG.2011.53",
language = "English",
volume = "18",
pages = "729--740",
journal = "IEEE Transactions on Visualization and Computer Graphics",
issn = "1077-2626",
publisher = "IEEE Computer Society",
number = "5",

}

Human motion retrieval from hand-drawn sketch. / Chao, Min Wen; Lin, Chao-Hung; Assa, Jackie; Lee, Tong-Yee.

In: IEEE Transactions on Visualization and Computer Graphics, Vol. 18, No. 5, 5728806, 01.01.2012, p. 729-740.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Human motion retrieval from hand-drawn sketch

AU - Chao, Min Wen

AU - Lin, Chao-Hung

AU - Assa, Jackie

AU - Lee, Tong-Yee

PY - 2012/1/1

Y1 - 2012/1/1

N2 - The rapid growth of motion capture data increases the importance of motion retrieval. The majority of the existing motion retrieval approaches are based on a labor-intensive step in which the user browses and selects a desired query motion clip from the large motion clip database. In this work, a novel sketching interface for defining the query is presented. This simple approach allows users to define the required motion by sketching several motion strokes over a drawn character, which requires less effort and extends the users' expressiveness. To support the real-time interface, a specialized encoding of the motions and the hand-drawn query is required. Here, we introduce a novel hierarchical encoding scheme based on a set of orthonormal spherical harmonic (SH) basis functions, which provides a compact representation, and avoids the CPU/processing intensive stage of temporal alignment used by previous solutions. Experimental results show that the proposed approach can well retrieve the motions, and is capable of retrieve logically and numerically similar motions, which is superior to previous approaches. The user study shows that the proposed system can be a useful tool to input motion query if the users are familiar with it. Finally, an application of generating a 3D animation from a hand-drawn comics strip is demonstrated.

AB - The rapid growth of motion capture data increases the importance of motion retrieval. The majority of the existing motion retrieval approaches are based on a labor-intensive step in which the user browses and selects a desired query motion clip from the large motion clip database. In this work, a novel sketching interface for defining the query is presented. This simple approach allows users to define the required motion by sketching several motion strokes over a drawn character, which requires less effort and extends the users' expressiveness. To support the real-time interface, a specialized encoding of the motions and the hand-drawn query is required. Here, we introduce a novel hierarchical encoding scheme based on a set of orthonormal spherical harmonic (SH) basis functions, which provides a compact representation, and avoids the CPU/processing intensive stage of temporal alignment used by previous solutions. Experimental results show that the proposed approach can well retrieve the motions, and is capable of retrieve logically and numerically similar motions, which is superior to previous approaches. The user study shows that the proposed system can be a useful tool to input motion query if the users are familiar with it. Finally, an application of generating a 3D animation from a hand-drawn comics strip is demonstrated.

UR - http://www.scopus.com/inward/record.url?scp=84858996825&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84858996825&partnerID=8YFLogxK

U2 - 10.1109/TVCG.2011.53

DO - 10.1109/TVCG.2011.53

M3 - Article

C2 - 21383410

AN - SCOPUS:84858996825

VL - 18

SP - 729

EP - 740

JO - IEEE Transactions on Visualization and Computer Graphics

JF - IEEE Transactions on Visualization and Computer Graphics

SN - 1077-2626

IS - 5

M1 - 5728806

ER -