A lightweight and efficient system for tracking handheld objects in virtual reality

Ya Kuei Chang, Jui Wei Huang, Chien Hua Chen, Chien Wen Chen, Jian Wei Peng, Min-Chun Hu, Chih Yuan Yao, Hung Kuo Chu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

While the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and weight, and thus can not provide realistic haptic feedback when interacting with virtual objects in VR. In this work, we present a novel and lightweight tracking system in the context of manipulating handheld objects in VR. Specifically, our system can effortlessly synchronize the 3D pose of arbitrary handheld objects between the real world and VR in realtime performance. The tracking algorithm is simple, which delicately leverages the power of Leap Motion and IMU sensor to respectively track object’s location and orientation. We demonstrate the effectiveness of our system with three VR applications use pencil, ping-pong paddle, and smartphone as control interfaces to provide users more immersive VR experience.

Original languageEnglish
Title of host publicationProceedings - VRST 2018
Subtitle of host publication24th ACM Symposium on Virtual Reality Software and Technology
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450360869
DOIs
Publication statusPublished - 2018 Nov 28
Event24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018 - Tokyo, Japan
Duration: 2018 Nov 282018 Dec 1

Publication series

NameProceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

Other

Other24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018
CountryJapan
CityTokyo
Period18-11-2818-12-01

Fingerprint

Virtual reality
Smartphones
Feedback
Controllers
Sensors

All Science Journal Classification (ASJC) codes

  • Software

Cite this

Chang, Y. K., Huang, J. W., Chen, C. H., Chen, C. W., Peng, J. W., Hu, M-C., ... Chu, H. K. (2018). A lightweight and efficient system for tracking handheld objects in virtual reality. In S. N. Spencer (Ed.), Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology [3281567] (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST). Association for Computing Machinery. https://doi.org/10.1145/3281505.3281567
Chang, Ya Kuei ; Huang, Jui Wei ; Chen, Chien Hua ; Chen, Chien Wen ; Peng, Jian Wei ; Hu, Min-Chun ; Yao, Chih Yuan ; Chu, Hung Kuo. / A lightweight and efficient system for tracking handheld objects in virtual reality. Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology. editor / Stephen N. Spencer. Association for Computing Machinery, 2018. (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST).
@inproceedings{474396bd1f0448ee94a88ab334023915,
title = "A lightweight and efficient system for tracking handheld objects in virtual reality",
abstract = "While the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and weight, and thus can not provide realistic haptic feedback when interacting with virtual objects in VR. In this work, we present a novel and lightweight tracking system in the context of manipulating handheld objects in VR. Specifically, our system can effortlessly synchronize the 3D pose of arbitrary handheld objects between the real world and VR in realtime performance. The tracking algorithm is simple, which delicately leverages the power of Leap Motion and IMU sensor to respectively track object’s location and orientation. We demonstrate the effectiveness of our system with three VR applications use pencil, ping-pong paddle, and smartphone as control interfaces to provide users more immersive VR experience.",
author = "Chang, {Ya Kuei} and Huang, {Jui Wei} and Chen, {Chien Hua} and Chen, {Chien Wen} and Peng, {Jian Wei} and Min-Chun Hu and Yao, {Chih Yuan} and Chu, {Hung Kuo}",
year = "2018",
month = "11",
day = "28",
doi = "10.1145/3281505.3281567",
language = "English",
series = "Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST",
publisher = "Association for Computing Machinery",
editor = "Spencer, {Stephen N.}",
booktitle = "Proceedings - VRST 2018",

}

Chang, YK, Huang, JW, Chen, CH, Chen, CW, Peng, JW, Hu, M-C, Yao, CY & Chu, HK 2018, A lightweight and efficient system for tracking handheld objects in virtual reality. in SN Spencer (ed.), Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology., 3281567, Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST, Association for Computing Machinery, 24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018, Tokyo, Japan, 18-11-28. https://doi.org/10.1145/3281505.3281567

A lightweight and efficient system for tracking handheld objects in virtual reality. / Chang, Ya Kuei; Huang, Jui Wei; Chen, Chien Hua; Chen, Chien Wen; Peng, Jian Wei; Hu, Min-Chun; Yao, Chih Yuan; Chu, Hung Kuo.

Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology. ed. / Stephen N. Spencer. Association for Computing Machinery, 2018. 3281567 (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A lightweight and efficient system for tracking handheld objects in virtual reality

AU - Chang, Ya Kuei

AU - Huang, Jui Wei

AU - Chen, Chien Hua

AU - Chen, Chien Wen

AU - Peng, Jian Wei

AU - Hu, Min-Chun

AU - Yao, Chih Yuan

AU - Chu, Hung Kuo

PY - 2018/11/28

Y1 - 2018/11/28

N2 - While the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and weight, and thus can not provide realistic haptic feedback when interacting with virtual objects in VR. In this work, we present a novel and lightweight tracking system in the context of manipulating handheld objects in VR. Specifically, our system can effortlessly synchronize the 3D pose of arbitrary handheld objects between the real world and VR in realtime performance. The tracking algorithm is simple, which delicately leverages the power of Leap Motion and IMU sensor to respectively track object’s location and orientation. We demonstrate the effectiveness of our system with three VR applications use pencil, ping-pong paddle, and smartphone as control interfaces to provide users more immersive VR experience.

AB - While the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and weight, and thus can not provide realistic haptic feedback when interacting with virtual objects in VR. In this work, we present a novel and lightweight tracking system in the context of manipulating handheld objects in VR. Specifically, our system can effortlessly synchronize the 3D pose of arbitrary handheld objects between the real world and VR in realtime performance. The tracking algorithm is simple, which delicately leverages the power of Leap Motion and IMU sensor to respectively track object’s location and orientation. We demonstrate the effectiveness of our system with three VR applications use pencil, ping-pong paddle, and smartphone as control interfaces to provide users more immersive VR experience.

UR - http://www.scopus.com/inward/record.url?scp=85060917502&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060917502&partnerID=8YFLogxK

U2 - 10.1145/3281505.3281567

DO - 10.1145/3281505.3281567

M3 - Conference contribution

AN - SCOPUS:85060917502

T3 - Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

BT - Proceedings - VRST 2018

A2 - Spencer, Stephen N.

PB - Association for Computing Machinery

ER -

Chang YK, Huang JW, Chen CH, Chen CW, Peng JW, Hu M-C et al. A lightweight and efficient system for tracking handheld objects in virtual reality. In Spencer SN, editor, Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology. Association for Computing Machinery. 2018. 3281567. (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST). https://doi.org/10.1145/3281505.3281567