A lightweight and efficient system for tracking handheld objects in virtual reality

Ya Kuei Chang, Jui Wei Huang, Chien Hua Chen, Chien Wen Chen, Jian Wei Peng, Min-Chun Hu, Chih Yuan Yao, Hung Kuo Chu

研究成果: Conference contribution

摘要

While the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and weight, and thus can not provide realistic haptic feedback when interacting with virtual objects in VR. In this work, we present a novel and lightweight tracking system in the context of manipulating handheld objects in VR. Specifically, our system can effortlessly synchronize the 3D pose of arbitrary handheld objects between the real world and VR in realtime performance. The tracking algorithm is simple, which delicately leverages the power of Leap Motion and IMU sensor to respectively track object’s location and orientation. We demonstrate the effectiveness of our system with three VR applications use pencil, ping-pong paddle, and smartphone as control interfaces to provide users more immersive VR experience.

原文English
主出版物標題Proceedings - VRST 2018
主出版物子標題24th ACM Symposium on Virtual Reality Software and Technology
編輯Stephen N. Spencer
發行者Association for Computing Machinery
ISBN(電子)9781450360869
DOIs
出版狀態Published - 2018 十一月 28
事件24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018 - Tokyo, Japan
持續時間: 2018 十一月 282018 十二月 1

出版系列

名字Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

Other

Other24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018
國家Japan
城市Tokyo
期間18-11-2818-12-01

指紋

Virtual reality
Smartphones
Feedback
Controllers
Sensors

All Science Journal Classification (ASJC) codes

  • Software

引用此文

Chang, Y. K., Huang, J. W., Chen, C. H., Chen, C. W., Peng, J. W., Hu, M-C., ... Chu, H. K. (2018). A lightweight and efficient system for tracking handheld objects in virtual reality. 於 S. N. Spencer (編輯), Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology [3281567] (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST). Association for Computing Machinery. https://doi.org/10.1145/3281505.3281567
Chang, Ya Kuei ; Huang, Jui Wei ; Chen, Chien Hua ; Chen, Chien Wen ; Peng, Jian Wei ; Hu, Min-Chun ; Yao, Chih Yuan ; Chu, Hung Kuo. / A lightweight and efficient system for tracking handheld objects in virtual reality. Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology. 編輯 / Stephen N. Spencer. Association for Computing Machinery, 2018. (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST).
@inproceedings{474396bd1f0448ee94a88ab334023915,
title = "A lightweight and efficient system for tracking handheld objects in virtual reality",
abstract = "While the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and weight, and thus can not provide realistic haptic feedback when interacting with virtual objects in VR. In this work, we present a novel and lightweight tracking system in the context of manipulating handheld objects in VR. Specifically, our system can effortlessly synchronize the 3D pose of arbitrary handheld objects between the real world and VR in realtime performance. The tracking algorithm is simple, which delicately leverages the power of Leap Motion and IMU sensor to respectively track object’s location and orientation. We demonstrate the effectiveness of our system with three VR applications use pencil, ping-pong paddle, and smartphone as control interfaces to provide users more immersive VR experience.",
author = "Chang, {Ya Kuei} and Huang, {Jui Wei} and Chen, {Chien Hua} and Chen, {Chien Wen} and Peng, {Jian Wei} and Min-Chun Hu and Yao, {Chih Yuan} and Chu, {Hung Kuo}",
year = "2018",
month = "11",
day = "28",
doi = "10.1145/3281505.3281567",
language = "English",
series = "Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST",
publisher = "Association for Computing Machinery",
editor = "Spencer, {Stephen N.}",
booktitle = "Proceedings - VRST 2018",

}

Chang, YK, Huang, JW, Chen, CH, Chen, CW, Peng, JW, Hu, M-C, Yao, CY & Chu, HK 2018, A lightweight and efficient system for tracking handheld objects in virtual reality. 於 SN Spencer (編輯), Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology., 3281567, Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST, Association for Computing Machinery, 24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018, Tokyo, Japan, 18-11-28. https://doi.org/10.1145/3281505.3281567

A lightweight and efficient system for tracking handheld objects in virtual reality. / Chang, Ya Kuei; Huang, Jui Wei; Chen, Chien Hua; Chen, Chien Wen; Peng, Jian Wei; Hu, Min-Chun; Yao, Chih Yuan; Chu, Hung Kuo.

Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology. 編輯 / Stephen N. Spencer. Association for Computing Machinery, 2018. 3281567 (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST).

研究成果: Conference contribution

TY - GEN

T1 - A lightweight and efficient system for tracking handheld objects in virtual reality

AU - Chang, Ya Kuei

AU - Huang, Jui Wei

AU - Chen, Chien Hua

AU - Chen, Chien Wen

AU - Peng, Jian Wei

AU - Hu, Min-Chun

AU - Yao, Chih Yuan

AU - Chu, Hung Kuo

PY - 2018/11/28

Y1 - 2018/11/28

N2 - While the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and weight, and thus can not provide realistic haptic feedback when interacting with virtual objects in VR. In this work, we present a novel and lightweight tracking system in the context of manipulating handheld objects in VR. Specifically, our system can effortlessly synchronize the 3D pose of arbitrary handheld objects between the real world and VR in realtime performance. The tracking algorithm is simple, which delicately leverages the power of Leap Motion and IMU sensor to respectively track object’s location and orientation. We demonstrate the effectiveness of our system with three VR applications use pencil, ping-pong paddle, and smartphone as control interfaces to provide users more immersive VR experience.

AB - While the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and weight, and thus can not provide realistic haptic feedback when interacting with virtual objects in VR. In this work, we present a novel and lightweight tracking system in the context of manipulating handheld objects in VR. Specifically, our system can effortlessly synchronize the 3D pose of arbitrary handheld objects between the real world and VR in realtime performance. The tracking algorithm is simple, which delicately leverages the power of Leap Motion and IMU sensor to respectively track object’s location and orientation. We demonstrate the effectiveness of our system with three VR applications use pencil, ping-pong paddle, and smartphone as control interfaces to provide users more immersive VR experience.

UR - http://www.scopus.com/inward/record.url?scp=85060917502&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060917502&partnerID=8YFLogxK

U2 - 10.1145/3281505.3281567

DO - 10.1145/3281505.3281567

M3 - Conference contribution

AN - SCOPUS:85060917502

T3 - Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

BT - Proceedings - VRST 2018

A2 - Spencer, Stephen N.

PB - Association for Computing Machinery

ER -

Chang YK, Huang JW, Chen CH, Chen CW, Peng JW, Hu M-C 等. A lightweight and efficient system for tracking handheld objects in virtual reality. 於 Spencer SN, 編輯, Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology. Association for Computing Machinery. 2018. 3281567. (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST). https://doi.org/10.1145/3281505.3281567