CTDP Depacking with Guided Depth Upsampling Networks for Realization of Multiview 3D Video

Wei Jong Yang, Bo Xun Chen, Jar Ferr Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

With the advancement of 3D display technology, the original 3D stereo-view systems requiring 3D glasses have evolved to multiple-view naked-eyes 3D displays. For 2D broadcasting systems, we can pack one view and its corresponding depth map into a frame in the transmission side and generate multiple views by the depth image-based rendering (DIBR) engine at the receivers. Up to now, the centralized texture depth packing (CTDP) frame-compatible format is the best solution for view and depth packing. In this paper, we propose an improved CTDP depacking method and realize it with DIBR process to achieve real-time 3D multiview exhibition. To maintain the quality of the depacked depth map, in the CTDP depacking process, we suggest a deep learning-based guided depth upsampling network. The experimental results demonstrate that the proposed 3D multiview system can successfully depack CTDP video and generate 9-view 3D movies in real-time. The proposed guided depth upsampling network achieves a better quality of the generated views than the traditional algorithms.

Original languageEnglish
Title of host publicationAdvances in Information and Communication - Proceedings of the 2023 Future of Information and Communication Conference, FICC 2023
EditorsKohei Arai
PublisherSpringer Science and Business Media Deutschland GmbH
Pages136-152
Number of pages17
ISBN (Print)9783031280757
DOIs
Publication statusPublished - 2023
Event8th Future of Information and Computing Conference, FICC 2023 - Virtual, Online
Duration: 2023 Mar 22023 Mar 3

Publication series

NameLecture Notes in Networks and Systems
Volume651 LNNS
ISSN (Print)2367-3370
ISSN (Electronic)2367-3389

Conference

Conference8th Future of Information and Computing Conference, FICC 2023
CityVirtual, Online
Period23-03-0223-03-03

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Signal Processing
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'CTDP Depacking with Guided Depth Upsampling Networks for Realization of Multiview 3D Video'. Together they form a unique fingerprint.

Cite this