TY - JOUR
T1 - Depth of Field Rendering Using Multilayer-Neighborhood Optimization
AU - Zhang, Benxuan
AU - Sheng, Bin
AU - Li, Ping
AU - Lee, Tong Yee
N1 - Funding Information:
We thank the reviewers for their insightful comments and suggestions. This work was supported in part by the National Natural Science Foundation of China (61872241, 61572316), the National Key Research and Development Program of China (2017YFE0104000, 2016YFC1300302), the Macau Science and Technology Development Fund (0027/2018/A1), the Science and Technology Commission of Shanghai Municipality (18410750700, 17411952600, 16DZ0501100), and the Ministry of Science and Technology (107-2221-E-006-196-MY3), Taiwan.
Publisher Copyright:
© 1995-2012 IEEE.
PY - 2020/8/1
Y1 - 2020/8/1
N2 - Depth of field (DOF) is utilized widely to deliver artistic effects in photography. However, existing post-processing techniques for rendering DOF effects introduce visual artifacts such as color leakage, blurring discontinuity, and the partial occlusion problems which limit the application of DOF. Traditionally, occluded pixels are ignored or not well estimated although they might make key contributions to images. In this paper, we propose a new filtering approach which takes approximated occluded pixels into account to synthesize the DOF effects for images. In our approach, images are separated into different layers based on depth. Besides, we utilize adaptive PatchMatch method to estimate the intensities of occluded pixels, especially in the background region. We again propose a new multilayer-neighborhood optimization to estimate occluded pixels contributions and render the images. Finally, we apply gathering filter to achieve the rendered images with elite DOF effects. Multiple experiments have shown that our approach can handle color leakage, blurring discontinuity and partial occlusion problem while providing high-quality DOF rendering effects.
AB - Depth of field (DOF) is utilized widely to deliver artistic effects in photography. However, existing post-processing techniques for rendering DOF effects introduce visual artifacts such as color leakage, blurring discontinuity, and the partial occlusion problems which limit the application of DOF. Traditionally, occluded pixels are ignored or not well estimated although they might make key contributions to images. In this paper, we propose a new filtering approach which takes approximated occluded pixels into account to synthesize the DOF effects for images. In our approach, images are separated into different layers based on depth. Besides, we utilize adaptive PatchMatch method to estimate the intensities of occluded pixels, especially in the background region. We again propose a new multilayer-neighborhood optimization to estimate occluded pixels contributions and render the images. Finally, we apply gathering filter to achieve the rendered images with elite DOF effects. Multiple experiments have shown that our approach can handle color leakage, blurring discontinuity and partial occlusion problem while providing high-quality DOF rendering effects.
UR - http://www.scopus.com/inward/record.url?scp=85077737605&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85077737605&partnerID=8YFLogxK
U2 - 10.1109/TVCG.2019.2894627
DO - 10.1109/TVCG.2019.2894627
M3 - Article
C2 - 30676963
AN - SCOPUS:85077737605
SN - 1077-2626
VL - 26
SP - 2546
EP - 2559
JO - IEEE Transactions on Visualization and Computer Graphics
JF - IEEE Transactions on Visualization and Computer Graphics
IS - 8
M1 - 8624466
ER -