A real-Time markerless augmented reality framework based on slam technique

Chien Wen Chen, Wen Zheng Chen, Jain Wei Peng, Bo Xun Cheng, Tse Yu Pan, Hsu-Chan Kuo, Min-Chun Hu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

The most common way to perform Augmented Reality (AR) is to use markers to calibrate the camera pose, which enables later placement/projection of virtual content into the captured real scene accordingly. However, marker-based AR has an inherent drawback, i.e.The requirement of specific marker(s), which may limit the development of its applications. In contrast, markerless AR uses visual or depth information of the captured scene to estimate the camera pose, thus no special marker is needed for calibaration, nonetheless, requires higher computation complexity. In this work, we design a markerless AR framework that simultanesously considers mobility, accuracy, and computation complexity. The proposed AR framework can achieve real-Time 3D environment reconstruction by using a mobile device equipped with a depth camera and Inertial Measurement Units (IMUs). We further design an AR game based on the Unity3D engine to validate the feasibility and accuracy of the proposed markerless AR framework, which successfully improves the game experience.

Original languageEnglish
Title of host publicationProceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages127-132
Number of pages6
ISBN (Electronic)9781538608401
DOIs
Publication statusPublished - 2017 Nov 27
Event14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017 - Exeter, Devon, United Kingdom
Duration: 2017 Jun 212017 Jun 23

Publication series

NameProceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017
Volume2017-November

Other

Other14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017
CountryUnited Kingdom
CityExeter, Devon
Period17-06-2117-06-23

Fingerprint

Augmented reality
Cameras
Units of measurement
Mobile devices
Engines

All Science Journal Classification (ASJC) codes

  • Industrial and Manufacturing Engineering
  • Control and Systems Engineering
  • Computer Science(all)
  • Electrical and Electronic Engineering

Cite this

Chen, C. W., Chen, W. Z., Peng, J. W., Cheng, B. X., Pan, T. Y., Kuo, H-C., & Hu, M-C. (2017). A real-Time markerless augmented reality framework based on slam technique. In Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017 (pp. 127-132). (Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017; Vol. 2017-November). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISPAN-FCST-ISCC.2017.87
Chen, Chien Wen ; Chen, Wen Zheng ; Peng, Jain Wei ; Cheng, Bo Xun ; Pan, Tse Yu ; Kuo, Hsu-Chan ; Hu, Min-Chun. / A real-Time markerless augmented reality framework based on slam technique. Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 127-132 (Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017).
@inproceedings{66711468fedd4423b4ba6c6b8447d1e8,
title = "A real-Time markerless augmented reality framework based on slam technique",
abstract = "The most common way to perform Augmented Reality (AR) is to use markers to calibrate the camera pose, which enables later placement/projection of virtual content into the captured real scene accordingly. However, marker-based AR has an inherent drawback, i.e.The requirement of specific marker(s), which may limit the development of its applications. In contrast, markerless AR uses visual or depth information of the captured scene to estimate the camera pose, thus no special marker is needed for calibaration, nonetheless, requires higher computation complexity. In this work, we design a markerless AR framework that simultanesously considers mobility, accuracy, and computation complexity. The proposed AR framework can achieve real-Time 3D environment reconstruction by using a mobile device equipped with a depth camera and Inertial Measurement Units (IMUs). We further design an AR game based on the Unity3D engine to validate the feasibility and accuracy of the proposed markerless AR framework, which successfully improves the game experience.",
author = "Chen, {Chien Wen} and Chen, {Wen Zheng} and Peng, {Jain Wei} and Cheng, {Bo Xun} and Pan, {Tse Yu} and Hsu-Chan Kuo and Min-Chun Hu",
year = "2017",
month = "11",
day = "27",
doi = "10.1109/ISPAN-FCST-ISCC.2017.87",
language = "English",
series = "Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "127--132",
booktitle = "Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017",
address = "United States",

}

Chen, CW, Chen, WZ, Peng, JW, Cheng, BX, Pan, TY, Kuo, H-C & Hu, M-C 2017, A real-Time markerless augmented reality framework based on slam technique. in Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017. Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017, vol. 2017-November, Institute of Electrical and Electronics Engineers Inc., pp. 127-132, 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017, Exeter, Devon, United Kingdom, 17-06-21. https://doi.org/10.1109/ISPAN-FCST-ISCC.2017.87

A real-Time markerless augmented reality framework based on slam technique. / Chen, Chien Wen; Chen, Wen Zheng; Peng, Jain Wei; Cheng, Bo Xun; Pan, Tse Yu; Kuo, Hsu-Chan; Hu, Min-Chun.

Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 127-132 (Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017; Vol. 2017-November).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A real-Time markerless augmented reality framework based on slam technique

AU - Chen, Chien Wen

AU - Chen, Wen Zheng

AU - Peng, Jain Wei

AU - Cheng, Bo Xun

AU - Pan, Tse Yu

AU - Kuo, Hsu-Chan

AU - Hu, Min-Chun

PY - 2017/11/27

Y1 - 2017/11/27

N2 - The most common way to perform Augmented Reality (AR) is to use markers to calibrate the camera pose, which enables later placement/projection of virtual content into the captured real scene accordingly. However, marker-based AR has an inherent drawback, i.e.The requirement of specific marker(s), which may limit the development of its applications. In contrast, markerless AR uses visual or depth information of the captured scene to estimate the camera pose, thus no special marker is needed for calibaration, nonetheless, requires higher computation complexity. In this work, we design a markerless AR framework that simultanesously considers mobility, accuracy, and computation complexity. The proposed AR framework can achieve real-Time 3D environment reconstruction by using a mobile device equipped with a depth camera and Inertial Measurement Units (IMUs). We further design an AR game based on the Unity3D engine to validate the feasibility and accuracy of the proposed markerless AR framework, which successfully improves the game experience.

AB - The most common way to perform Augmented Reality (AR) is to use markers to calibrate the camera pose, which enables later placement/projection of virtual content into the captured real scene accordingly. However, marker-based AR has an inherent drawback, i.e.The requirement of specific marker(s), which may limit the development of its applications. In contrast, markerless AR uses visual or depth information of the captured scene to estimate the camera pose, thus no special marker is needed for calibaration, nonetheless, requires higher computation complexity. In this work, we design a markerless AR framework that simultanesously considers mobility, accuracy, and computation complexity. The proposed AR framework can achieve real-Time 3D environment reconstruction by using a mobile device equipped with a depth camera and Inertial Measurement Units (IMUs). We further design an AR game based on the Unity3D engine to validate the feasibility and accuracy of the proposed markerless AR framework, which successfully improves the game experience.

UR - http://www.scopus.com/inward/record.url?scp=85048450164&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85048450164&partnerID=8YFLogxK

U2 - 10.1109/ISPAN-FCST-ISCC.2017.87

DO - 10.1109/ISPAN-FCST-ISCC.2017.87

M3 - Conference contribution

AN - SCOPUS:85048450164

T3 - Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017

SP - 127

EP - 132

BT - Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Chen CW, Chen WZ, Peng JW, Cheng BX, Pan TY, Kuo H-C et al. A real-Time markerless augmented reality framework based on slam technique. In Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 127-132. (Proceedings - 14th International Symposium on Pervasive Systems, Algorithms and Networks, I-SPAN 2017, 11th International Conference on Frontier of Computer Science and Technology, FCST 2017 and 3rd International Symposium of Creative Computing, ISCC 2017). https://doi.org/10.1109/ISPAN-FCST-ISCC.2017.87