A real-Time markerless augmented reality framework based on slam technique

Chien Wen Chen, Wen Zheng Chen, Jain Wei Peng, Bo Xun Cheng, Tse Yu Pan, Hsu-Chan Kuo, Min-Chun Hu

研究成果: Conference contribution

3 引文 (Scopus)

摘要

The most common way to perform Augmented Reality (AR) is to use markers to calibrate the camera pose, which enables later placement/projection of virtual content into the captured real scene accordingly. However, marker-based AR has an inherent drawback, i.e.The requirement of specific marker(s), which may limit the development of its applications. In contrast, markerless AR uses visual or depth information of the captured scene to estimate the camera pose, thus no special marker is needed for calibaration, nonetheless, requires higher computation complexity. In this work, we design a markerless AR framework that simultanesously considers mobility, accuracy, and computation complexity. The proposed AR framework can achieve real-Time 3D environment reconstruction by using a mobile device equipped with a depth camera and Inertial Measurement Units (IMUs). We further design an AR game based on the Unity3D engine to validate the feasibility and accuracy of the proposed markerless AR framework, which successfully improves the game experience.

原文English
主出版物標題Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017
發行者Institute of Electrical and Electronics Engineers Inc.
頁面127-132
頁數6
ISBN(電子)9781538608401
DOIs
出版狀態Published - 2017 十一月 27
事件14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017 - Exeter, Devon, United Kingdom
持續時間: 2017 六月 212017 六月 23

出版系列

名字Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017
2017-November

Other

Other14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017
國家United Kingdom
城市Exeter, Devon
期間17-06-2117-06-23

指紋

Augmented reality
Cameras
Units of measurement
Mobile devices
Engines

All Science Journal Classification (ASJC) codes

  • Industrial and Manufacturing Engineering
  • Control and Systems Engineering
  • Computer Science(all)
  • Electrical and Electronic Engineering

引用此文

Chen, C. W., Chen, W. Z., Peng, J. W., Cheng, B. X., Pan, T. Y., Kuo, H-C., & Hu, M-C. (2017). A real-Time markerless augmented reality framework based on slam technique. 於 Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017 (頁 127-132). (Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017; 卷 2017-November). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISPAN-FCST-ISCC.2017.87
Chen, Chien Wen ; Chen, Wen Zheng ; Peng, Jain Wei ; Cheng, Bo Xun ; Pan, Tse Yu ; Kuo, Hsu-Chan ; Hu, Min-Chun. / A real-Time markerless augmented reality framework based on slam technique. Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017. Institute of Electrical and Electronics Engineers Inc., 2017. 頁 127-132 (Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017).
@inproceedings{66711468fedd4423b4ba6c6b8447d1e8,
title = "A real-Time markerless augmented reality framework based on slam technique",
abstract = "The most common way to perform Augmented Reality (AR) is to use markers to calibrate the camera pose, which enables later placement/projection of virtual content into the captured real scene accordingly. However, marker-based AR has an inherent drawback, i.e.The requirement of specific marker(s), which may limit the development of its applications. In contrast, markerless AR uses visual or depth information of the captured scene to estimate the camera pose, thus no special marker is needed for calibaration, nonetheless, requires higher computation complexity. In this work, we design a markerless AR framework that simultanesously considers mobility, accuracy, and computation complexity. The proposed AR framework can achieve real-Time 3D environment reconstruction by using a mobile device equipped with a depth camera and Inertial Measurement Units (IMUs). We further design an AR game based on the Unity3D engine to validate the feasibility and accuracy of the proposed markerless AR framework, which successfully improves the game experience.",
author = "Chen, {Chien Wen} and Chen, {Wen Zheng} and Peng, {Jain Wei} and Cheng, {Bo Xun} and Pan, {Tse Yu} and Hsu-Chan Kuo and Min-Chun Hu",
year = "2017",
month = "11",
day = "27",
doi = "10.1109/ISPAN-FCST-ISCC.2017.87",
language = "English",
series = "Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "127--132",
booktitle = "Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017",
address = "United States",

}

Chen, CW, Chen, WZ, Peng, JW, Cheng, BX, Pan, TY, Kuo, H-C & Hu, M-C 2017, A real-Time markerless augmented reality framework based on slam technique. 於 Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017. Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017, 卷 2017-November, Institute of Electrical and Electronics Engineers Inc., 頁 127-132, 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017, Exeter, Devon, United Kingdom, 17-06-21. https://doi.org/10.1109/ISPAN-FCST-ISCC.2017.87

A real-Time markerless augmented reality framework based on slam technique. / Chen, Chien Wen; Chen, Wen Zheng; Peng, Jain Wei; Cheng, Bo Xun; Pan, Tse Yu; Kuo, Hsu-Chan; Hu, Min-Chun.

Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 127-132 (Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017; 卷 2017-November).

研究成果: Conference contribution

TY - GEN

T1 - A real-Time markerless augmented reality framework based on slam technique

AU - Chen, Chien Wen

AU - Chen, Wen Zheng

AU - Peng, Jain Wei

AU - Cheng, Bo Xun

AU - Pan, Tse Yu

AU - Kuo, Hsu-Chan

AU - Hu, Min-Chun

PY - 2017/11/27

Y1 - 2017/11/27

N2 - The most common way to perform Augmented Reality (AR) is to use markers to calibrate the camera pose, which enables later placement/projection of virtual content into the captured real scene accordingly. However, marker-based AR has an inherent drawback, i.e.The requirement of specific marker(s), which may limit the development of its applications. In contrast, markerless AR uses visual or depth information of the captured scene to estimate the camera pose, thus no special marker is needed for calibaration, nonetheless, requires higher computation complexity. In this work, we design a markerless AR framework that simultanesously considers mobility, accuracy, and computation complexity. The proposed AR framework can achieve real-Time 3D environment reconstruction by using a mobile device equipped with a depth camera and Inertial Measurement Units (IMUs). We further design an AR game based on the Unity3D engine to validate the feasibility and accuracy of the proposed markerless AR framework, which successfully improves the game experience.

AB - The most common way to perform Augmented Reality (AR) is to use markers to calibrate the camera pose, which enables later placement/projection of virtual content into the captured real scene accordingly. However, marker-based AR has an inherent drawback, i.e.The requirement of specific marker(s), which may limit the development of its applications. In contrast, markerless AR uses visual or depth information of the captured scene to estimate the camera pose, thus no special marker is needed for calibaration, nonetheless, requires higher computation complexity. In this work, we design a markerless AR framework that simultanesously considers mobility, accuracy, and computation complexity. The proposed AR framework can achieve real-Time 3D environment reconstruction by using a mobile device equipped with a depth camera and Inertial Measurement Units (IMUs). We further design an AR game based on the Unity3D engine to validate the feasibility and accuracy of the proposed markerless AR framework, which successfully improves the game experience.

UR - http://www.scopus.com/inward/record.url?scp=85048450164&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85048450164&partnerID=8YFLogxK

U2 - 10.1109/ISPAN-FCST-ISCC.2017.87

DO - 10.1109/ISPAN-FCST-ISCC.2017.87

M3 - Conference contribution

AN - SCOPUS:85048450164

T3 - Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017

SP - 127

EP - 132

BT - Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Chen CW, Chen WZ, Peng JW, Cheng BX, Pan TY, Kuo H-C 等. A real-Time markerless augmented reality framework based on slam technique. 於 Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 127-132. (Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017). https://doi.org/10.1109/ISPAN-FCST-ISCC.2017.87