High efficiency depth image-based rendering with simplified inpainting-based hole filling

Pin Chen Kuo; Jhih Ming Lin; Bin Da Liu; Jar Ferr Yang

doi:10.1007/s11045-015-0378-8

High efficiency depth image-based rendering with simplified inpainting-based hole filling

Pin Chen Kuo, Jhih Ming Lin, Bin Da Liu, Jar Ferr Yang

Research output: Contribution to journal › Article › peer-review

7 Citations (Scopus)

Abstract

Hole and crack filling is the most important issue in depth-image-based rendering (DIBR) algorithms for generating virtual view images when only one view image and one depth map are available. This paper proposes a priority patch inpainting algorithm for hole filling inDIBR algorithms by generatingmultiple virtual views.Atexture-based interpolation method is applied for crack filling. Then, an inpainting-based algorithm is applied patch by patch for hole filling. A prioritized method for selecting the critical patch is also proposed to reduce computation time. Finally, the proposed method is realized on the compute unified device architecture parallel computing platform which runs on a graphics processing unit. Simulation results showthat the proposed algorithm is 51-fold faster for virtual viewsynthesis and achieves better virtual view quality compared to the traditional DIBR algorithm which contains depth preprocessing, warping, and hole filling.

Original language	English
Pages (from-to)	623-645
Number of pages	23
Journal	Multidimensional Systems and Signal Processing
Volume	27
Issue number	3
DOIs	https://doi.org/10.1007/s11045-015-0378-8
Publication status	Published - 2016 Dec 30

All Science Journal Classification (ASJC) codes

Software
Signal Processing
Information Systems
Hardware and Architecture
Computer Science Applications
Artificial Intelligence
Applied Mathematics

Access to Document

10.1007/s11045-015-0378-8

Fingerprint Dive into the research topics of 'High efficiency depth image-based rendering with simplified inpainting-based hole filling'. Together they form a unique fingerprint.

Cite this

@article{31a4d33b89ee45aba4e6d7472879ed75,

title = "High efficiency depth image-based rendering with simplified inpainting-based hole filling",

abstract = "Hole and crack filling is the most important issue in depth-image-based rendering (DIBR) algorithms for generating virtual view images when only one view image and one depth map are available. This paper proposes a priority patch inpainting algorithm for hole filling inDIBR algorithms by generatingmultiple virtual views.Atexture-based interpolation method is applied for crack filling. Then, an inpainting-based algorithm is applied patch by patch for hole filling. A prioritized method for selecting the critical patch is also proposed to reduce computation time. Finally, the proposed method is realized on the compute unified device architecture parallel computing platform which runs on a graphics processing unit. Simulation results showthat the proposed algorithm is 51-fold faster for virtual viewsynthesis and achieves better virtual view quality compared to the traditional DIBR algorithm which contains depth preprocessing, warping, and hole filling.",

author = "Kuo, {Pin Chen} and Lin, {Jhih Ming} and Liu, {Bin Da} and Yang, {Jar Ferr}",

note = "Funding Information: This work was in part supported by the Ministry of Science and Technology under grant NSC 102-2219-E-006-005, the Ministry of Education, and the Ministry of Economic Affairs of Taiwan, under grant 103-EC-17-A-02-S1-201.",

year = "2016",

month = dec,

day = "30",

doi = "10.1007/s11045-015-0378-8",

language = "English",

volume = "27",

pages = "623--645",

journal = "Multidimensional Systems and Signal Processing",

issn = "0923-6082",

publisher = "Springer Netherlands",

number = "3",

}

TY - JOUR

T1 - High efficiency depth image-based rendering with simplified inpainting-based hole filling

AU - Kuo, Pin Chen

AU - Lin, Jhih Ming

AU - Liu, Bin Da

AU - Yang, Jar Ferr

N1 - Funding Information: This work was in part supported by the Ministry of Science and Technology under grant NSC 102-2219-E-006-005, the Ministry of Education, and the Ministry of Economic Affairs of Taiwan, under grant 103-EC-17-A-02-S1-201.

PY - 2016/12/30

Y1 - 2016/12/30

N2 - Hole and crack filling is the most important issue in depth-image-based rendering (DIBR) algorithms for generating virtual view images when only one view image and one depth map are available. This paper proposes a priority patch inpainting algorithm for hole filling inDIBR algorithms by generatingmultiple virtual views.Atexture-based interpolation method is applied for crack filling. Then, an inpainting-based algorithm is applied patch by patch for hole filling. A prioritized method for selecting the critical patch is also proposed to reduce computation time. Finally, the proposed method is realized on the compute unified device architecture parallel computing platform which runs on a graphics processing unit. Simulation results showthat the proposed algorithm is 51-fold faster for virtual viewsynthesis and achieves better virtual view quality compared to the traditional DIBR algorithm which contains depth preprocessing, warping, and hole filling.

AB - Hole and crack filling is the most important issue in depth-image-based rendering (DIBR) algorithms for generating virtual view images when only one view image and one depth map are available. This paper proposes a priority patch inpainting algorithm for hole filling inDIBR algorithms by generatingmultiple virtual views.Atexture-based interpolation method is applied for crack filling. Then, an inpainting-based algorithm is applied patch by patch for hole filling. A prioritized method for selecting the critical patch is also proposed to reduce computation time. Finally, the proposed method is realized on the compute unified device architecture parallel computing platform which runs on a graphics processing unit. Simulation results showthat the proposed algorithm is 51-fold faster for virtual viewsynthesis and achieves better virtual view quality compared to the traditional DIBR algorithm which contains depth preprocessing, warping, and hole filling.

UR - http://www.scopus.com/inward/record.url?scp=84952664020&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84952664020&partnerID=8YFLogxK

U2 - 10.1007/s11045-015-0378-8

DO - 10.1007/s11045-015-0378-8

M3 - Article

AN - SCOPUS:84952664020

VL - 27

SP - 623

EP - 645

JO - Multidimensional Systems and Signal Processing

JF - Multidimensional Systems and Signal Processing

SN - 0923-6082

IS - 3

ER -

High efficiency depth image-based rendering with simplified inpainting-based hole filling

Abstract

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Cite this