Applying Holo360 Video and Image Super-Resolution Generative Adversarial Networks to Virtual Reality Immersion

Chia Hui Feng, Yu Hsiu Hung, Chao Kuang Yang, Liang Chi Chen, Wen Cheng Hsu, Shih Hao Lin

研究成果: Conference contribution

摘要

Super-resolution deep learning methods focus on image processing solutions and discussions in two-dimensional super-resolution image processing NOT for 360 equirectangular images. Therefore, the motivation of this research is to establish the deep learning network model Holo360 SRGAN and data set of 360 equirectangular images, and observe whether the sharpness and noise of Holo360 SRGAN compared with the original image reach the optical verification standard. The results of this study point out two significant points: 1) For a convolution training core neuron with the best model architecture of Holo360 SRGAN with 360 images 8 K (8192 × 4096 px), FOV: 360°, the expanded the convolution core neuron size as 5 × 5 to contains more learning features. And 2) Holo360 SRGAN image experiment results, 6 ROI optical analysis clarity increased by 27%, and sharpness increased by 42%. The experimental original image noise SNR is 28.2 dB, and the Holo360 SRGAN (×2) noise SNR is 36.8 dB, so it is increased by +8.6 dB, and the amount of image detail is also increased. Contributions enhance the super-resolution visual experience of equirectangular video or image.

原文English
主出版物標題Human-Computer Interaction. Design and User Experience - Thematic Area, HCI 2020, Held as Part of the 22nd International Conference, HCII 2020, Proceedings
編輯Masaaki Kurosu
發行者Springer
頁面569-584
頁數16
ISBN(列印)9783030490584
DOIs
出版狀態Published - 2020
事件Thematic Area on Human Computer Interaction, HCI 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020 - Copenhagen, Denmark
持續時間: 2020 七月 192020 七月 24

出版系列

名字Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
12181 LNCS
ISSN(列印)0302-9743
ISSN(電子)1611-3349

Conference

ConferenceThematic Area on Human Computer Interaction, HCI 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020
國家Denmark
城市Copenhagen
期間20-07-1920-07-24

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

指紋 深入研究「Applying Holo360 Video and Image Super-Resolution Generative Adversarial Networks to Virtual Reality Immersion」主題。共同形成了獨特的指紋。

引用此