Stereoview to Multiview Conversion Architecture for Auto-Stereoscopic 3D Displays

Pin Chen Kuo, Kuan Lun Lo, Huan Kai Tseng, Kuan Ting Lee, Bin-Da Liu, Jar-Ferr Yang

Research output: Contribution to journalArticle

Abstract

In this paper, a stereoview to multiview conversion system, which includes stereo matching and depth image-based rendering (DIBR) hardware designs, is proposed. To achieve an efficient architecture, the proposed stereo matching algorithm simply generates the raw matching costs and aggregates cost based on 1D iterative aggregation schemes. For the DIBR architecture, an inpainting-based method is used to find the most similar patch from the background, according to depth information. The simulation results show that the designed architecture achieves an averaged peak signal-to-noise ratio of 30.2 dB and structure similarity of 0.94 for the tested images. The hardware design for the proposed 2D to 3D conversion system operates at a maximum clock frequency of 160.2 MHz for outputting 1080p (1920 × 1080) video at 60 frames per second.

Original languageEnglish
Article number7993031
Pages (from-to)3274-3287
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume28
Issue number11
DOIs
Publication statusPublished - 2018 Nov 1

Fingerprint

Display devices
Hardware
Costs
Clocks
Signal to noise ratio
Agglomeration

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Electrical and Electronic Engineering

Cite this

Kuo, Pin Chen ; Lo, Kuan Lun ; Tseng, Huan Kai ; Lee, Kuan Ting ; Liu, Bin-Da ; Yang, Jar-Ferr. / Stereoview to Multiview Conversion Architecture for Auto-Stereoscopic 3D Displays. In: IEEE Transactions on Circuits and Systems for Video Technology. 2018 ; Vol. 28, No. 11. pp. 3274-3287.
@article{25fcafec799b48ed98489e9617694dcf,
title = "Stereoview to Multiview Conversion Architecture for Auto-Stereoscopic 3D Displays",
abstract = "In this paper, a stereoview to multiview conversion system, which includes stereo matching and depth image-based rendering (DIBR) hardware designs, is proposed. To achieve an efficient architecture, the proposed stereo matching algorithm simply generates the raw matching costs and aggregates cost based on 1D iterative aggregation schemes. For the DIBR architecture, an inpainting-based method is used to find the most similar patch from the background, according to depth information. The simulation results show that the designed architecture achieves an averaged peak signal-to-noise ratio of 30.2 dB and structure similarity of 0.94 for the tested images. The hardware design for the proposed 2D to 3D conversion system operates at a maximum clock frequency of 160.2 MHz for outputting 1080p (1920 × 1080) video at 60 frames per second.",
author = "Kuo, {Pin Chen} and Lo, {Kuan Lun} and Tseng, {Huan Kai} and Lee, {Kuan Ting} and Bin-Da Liu and Jar-Ferr Yang",
year = "2018",
month = "11",
day = "1",
doi = "10.1109/TCSVT.2017.2732061",
language = "English",
volume = "28",
pages = "3274--3287",
journal = "IEEE Transactions on Circuits and Systems for Video Technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "11",

}

Stereoview to Multiview Conversion Architecture for Auto-Stereoscopic 3D Displays. / Kuo, Pin Chen; Lo, Kuan Lun; Tseng, Huan Kai; Lee, Kuan Ting; Liu, Bin-Da; Yang, Jar-Ferr.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 28, No. 11, 7993031, 01.11.2018, p. 3274-3287.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Stereoview to Multiview Conversion Architecture for Auto-Stereoscopic 3D Displays

AU - Kuo, Pin Chen

AU - Lo, Kuan Lun

AU - Tseng, Huan Kai

AU - Lee, Kuan Ting

AU - Liu, Bin-Da

AU - Yang, Jar-Ferr

PY - 2018/11/1

Y1 - 2018/11/1

N2 - In this paper, a stereoview to multiview conversion system, which includes stereo matching and depth image-based rendering (DIBR) hardware designs, is proposed. To achieve an efficient architecture, the proposed stereo matching algorithm simply generates the raw matching costs and aggregates cost based on 1D iterative aggregation schemes. For the DIBR architecture, an inpainting-based method is used to find the most similar patch from the background, according to depth information. The simulation results show that the designed architecture achieves an averaged peak signal-to-noise ratio of 30.2 dB and structure similarity of 0.94 for the tested images. The hardware design for the proposed 2D to 3D conversion system operates at a maximum clock frequency of 160.2 MHz for outputting 1080p (1920 × 1080) video at 60 frames per second.

AB - In this paper, a stereoview to multiview conversion system, which includes stereo matching and depth image-based rendering (DIBR) hardware designs, is proposed. To achieve an efficient architecture, the proposed stereo matching algorithm simply generates the raw matching costs and aggregates cost based on 1D iterative aggregation schemes. For the DIBR architecture, an inpainting-based method is used to find the most similar patch from the background, according to depth information. The simulation results show that the designed architecture achieves an averaged peak signal-to-noise ratio of 30.2 dB and structure similarity of 0.94 for the tested images. The hardware design for the proposed 2D to 3D conversion system operates at a maximum clock frequency of 160.2 MHz for outputting 1080p (1920 × 1080) video at 60 frames per second.

UR - http://www.scopus.com/inward/record.url?scp=85028963746&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85028963746&partnerID=8YFLogxK

U2 - 10.1109/TCSVT.2017.2732061

DO - 10.1109/TCSVT.2017.2732061

M3 - Article

AN - SCOPUS:85028963746

VL - 28

SP - 3274

EP - 3287

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

SN - 1051-8215

IS - 11

M1 - 7993031

ER -