Applying Holo360 Video and Image Super-Resolution Generative Adversarial Networks to Virtual Reality Immersion

Chia Hui Feng, Yu Hsiu Hung, Chao Kuang Yang, Liang Chi Chen, Wen Cheng Hsu, Shih Hao Lin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Super-resolution deep learning methods focus on image processing solutions and discussions in two-dimensional super-resolution image processing NOT for 360 equirectangular images. Therefore, the motivation of this research is to establish the deep learning network model Holo360 SRGAN and data set of 360 equirectangular images, and observe whether the sharpness and noise of Holo360 SRGAN compared with the original image reach the optical verification standard. The results of this study point out two significant points: 1) For a convolution training core neuron with the best model architecture of Holo360 SRGAN with 360 images 8 K (8192 × 4096 px), FOV: 360°, the expanded the convolution core neuron size as 5 × 5 to contains more learning features. And 2) Holo360 SRGAN image experiment results, 6 ROI optical analysis clarity increased by 27%, and sharpness increased by 42%. The experimental original image noise SNR is 28.2 dB, and the Holo360 SRGAN (×2) noise SNR is 36.8 dB, so it is increased by +8.6 dB, and the amount of image detail is also increased. Contributions enhance the super-resolution visual experience of equirectangular video or image.

Original languageEnglish
Title of host publicationHuman-Computer Interaction. Design and User Experience - Thematic Area, HCI 2020, Held as Part of the 22nd International Conference, HCII 2020, Proceedings
EditorsMasaaki Kurosu
PublisherSpringer
Pages569-584
Number of pages16
ISBN (Print)9783030490584
DOIs
Publication statusPublished - 2020
EventThematic Area on Human Computer Interaction, HCI 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020 - Copenhagen, Denmark
Duration: 2020 Jul 192020 Jul 24

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12181 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceThematic Area on Human Computer Interaction, HCI 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020
CountryDenmark
CityCopenhagen
Period20-07-1920-07-24

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Applying Holo360 Video and Image Super-Resolution Generative Adversarial Networks to Virtual Reality Immersion'. Together they form a unique fingerprint.

Cite this