Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience

Hao Lun Fu; Po Hsiang Fang; Chan Yu Chi; Chung Ting Kuo; Meng Hsuan Liu; Howard Muchen Hsu; Cheng Hsun Hsieh; Sheng Fu Liang; Shulan Hsieh; Cheng Ta Yang

doi:10.1109/VCIP49819.2020.9301801

Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience

Hao Lun Fu, Po Hsiang Fang, Chan Yu Chi, Chung Ting Kuo, Meng Hsuan Liu, Howard Muchen Hsu, Cheng Hsun Hsieh, Sheng Fu Liang, Shulan Hsieh, Cheng Ta Yang

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

5 Citations (Scopus)

Abstract

Virtual reality (VR), a computer-generated interactive environment, is provided to a user by projecting a peripheral image onto environmental surfaces. VR has an advantage of enhancing the immersive experience. Nowadays, VR has been widely applied in tourism and cultural experience. On the other hand, a recent integration of electroencephalography-based (EEG-based) brain-computer interface (BCI) and VR is capable of promoting the immersive virtual experience. Therefore, our study aims to propose an integrative framework to implement EEG-based BCI in a VR game to advance the cultural experience. A room escape game in a Tainan temple is created. EEG signals arc recorded while users arc playing the game. The online analyses of EEG signals arc used to interact with the VR display. This integrative framework can result in a better experience than the conventional setup.

Original language	English
Title of host publication	2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	351-354
Number of pages	4
ISBN (Electronic)	9781728180670
DOIs	https://doi.org/10.1109/VCIP49819.2020.9301801
Publication status	Published - 2020 Dec 1
Event	2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020 - Virtual, Macau, China Duration: 2020 Dec 1 → 2020 Dec 4

Publication series

Name	2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020

Conference

Conference	2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020
Country/Territory	China
City	Virtual, Macau
Period	20-12-01 → 20-12-04

All Science Journal Classification (ASJC) codes

Computer Networks and Communications
Signal Processing
Media Technology

Access to Document

10.1109/VCIP49819.2020.9301801

Cite this

Fu, H. L., Fang, P. H., Chi, C. Y., Kuo, C. T., Liu, M. H., Hsu, H. M., Hsieh, C. H., Liang, S. F., Hsieh, S., & Yang, C. T. (2020). Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience. In 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020 (pp. 351-354). Article 9301801 (2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VCIP49819.2020.9301801

Fu, Hao Lun ; Fang, Po Hsiang ; Chi, Chan Yu et al. / Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience. 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020. Institute of Electrical and Electronics Engineers Inc., 2020. pp. 351-354 (2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020).

@inproceedings{07f1454958b34d43b3d9a623c19f3ccb,

title = "Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience",

abstract = "Virtual reality (VR), a computer-generated interactive environment, is provided to a user by projecting a peripheral image onto environmental surfaces. VR has an advantage of enhancing the immersive experience. Nowadays, VR has been widely applied in tourism and cultural experience. On the other hand, a recent integration of electroencephalography-based (EEG-based) brain-computer interface (BCI) and VR is capable of promoting the immersive virtual experience. Therefore, our study aims to propose an integrative framework to implement EEG-based BCI in a VR game to advance the cultural experience. A room escape game in a Tainan temple is created. EEG signals arc recorded while users arc playing the game. The online analyses of EEG signals arc used to interact with the VR display. This integrative framework can result in a better experience than the conventional setup.",

author = "Fu, {Hao Lun} and Fang, {Po Hsiang} and Chi, {Chan Yu} and Kuo, {Chung Ting} and Liu, {Meng Hsuan} and Hsu, {Howard Muchen} and Hsieh, {Cheng Hsun} and Liang, {Sheng Fu} and Shulan Hsieh and Yang, {Cheng Ta}",

note = "Funding Information: This work was supported by grants from the Ministry of Education, Taiwan (MOE 1090010611V) and the Ministry of Science and Technology, Taiwan (MOST 109-251 l-H-006-002-MY2 and MOST 109-2410-H-006-049-MY3). Publisher Copyright: {\textcopyright} 2020 IEEE.; 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020 ; Conference date: 01-12-2020 Through 04-12-2020",

year = "2020",

month = dec,

day = "1",

doi = "10.1109/VCIP49819.2020.9301801",

language = "English",

series = "2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "351--354",

booktitle = "2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020",

address = "United States",

}

Fu, HL, Fang, PH, Chi, CY, Kuo, CT, Liu, MH, Hsu, HM, Hsieh, CH, Liang, SF , Hsieh, S & Yang, CT 2020, Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience. in 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020., 9301801, 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020, Institute of Electrical and Electronics Engineers Inc., pp. 351-354, 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020, Virtual, Macau, China, 20-12-01. https://doi.org/10.1109/VCIP49819.2020.9301801

Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience. / Fu, Hao Lun; Fang, Po Hsiang; Chi, Chan Yu et al.
2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020. Institute of Electrical and Electronics Engineers Inc., 2020. p. 351-354 9301801 (2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience

AU - Fu, Hao Lun

AU - Fang, Po Hsiang

AU - Chi, Chan Yu

AU - Kuo, Chung Ting

AU - Liu, Meng Hsuan

AU - Hsu, Howard Muchen

AU - Hsieh, Cheng Hsun

AU - Liang, Sheng Fu

AU - Hsieh, Shulan

AU - Yang, Cheng Ta

N1 - Funding Information: This work was supported by grants from the Ministry of Education, Taiwan (MOE 1090010611V) and the Ministry of Science and Technology, Taiwan (MOST 109-251 l-H-006-002-MY2 and MOST 109-2410-H-006-049-MY3). Publisher Copyright: © 2020 IEEE.

PY - 2020/12/1

Y1 - 2020/12/1

N2 - Virtual reality (VR), a computer-generated interactive environment, is provided to a user by projecting a peripheral image onto environmental surfaces. VR has an advantage of enhancing the immersive experience. Nowadays, VR has been widely applied in tourism and cultural experience. On the other hand, a recent integration of electroencephalography-based (EEG-based) brain-computer interface (BCI) and VR is capable of promoting the immersive virtual experience. Therefore, our study aims to propose an integrative framework to implement EEG-based BCI in a VR game to advance the cultural experience. A room escape game in a Tainan temple is created. EEG signals arc recorded while users arc playing the game. The online analyses of EEG signals arc used to interact with the VR display. This integrative framework can result in a better experience than the conventional setup.

AB - Virtual reality (VR), a computer-generated interactive environment, is provided to a user by projecting a peripheral image onto environmental surfaces. VR has an advantage of enhancing the immersive experience. Nowadays, VR has been widely applied in tourism and cultural experience. On the other hand, a recent integration of electroencephalography-based (EEG-based) brain-computer interface (BCI) and VR is capable of promoting the immersive virtual experience. Therefore, our study aims to propose an integrative framework to implement EEG-based BCI in a VR game to advance the cultural experience. A room escape game in a Tainan temple is created. EEG signals arc recorded while users arc playing the game. The online analyses of EEG signals arc used to interact with the VR display. This integrative framework can result in a better experience than the conventional setup.

UR - http://www.scopus.com/inward/record.url?scp=85099438210&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85099438210&partnerID=8YFLogxK

U2 - 10.1109/VCIP49819.2020.9301801

DO - 10.1109/VCIP49819.2020.9301801

M3 - Conference contribution

AN - SCOPUS:85099438210

T3 - 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020

SP - 351

EP - 354

BT - 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020

Y2 - 1 December 2020 through 4 December 2020

ER -

Fu HL, Fang PH, Chi CY, Kuo CT, Liu MH, Hsu HM et al. Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience. In 2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020. Institute of Electrical and Electronics Engineers Inc. 2020. p. 351-354. 9301801. (2020 IEEE International Conference on Visual Communications and Image Processing, VCIP 2020). doi: 10.1109/VCIP49819.2020.9301801

Application of Brain-Computer Interface and Virtual Reality in Advancing Cultural Experience

Abstract

Publication series

Conference

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this