Rapid image completion system using multiresolution patch-based directional and nondirectional approaches

Chih Wei Fang, James Jenn-Jier Lien

Research output: Contribution to journalArticle

41 Citations (Scopus)

Abstract

This study presents a rapid image completion system comprising a training (or analysis) process and an image completion (or synthesis) process. The proposed system adopts a multiresolution approach, which not only improves the convergence rate of the synthesis process, but also provides the ability to deal with large replaced regions. In the training process, a down-sampling approach is applied to create a patch-based texture eigenspace based on multiresolution background region information. In the image completion process, an up-sampling approach is applied to synthesize the replaced foreground regions. To ensure the continuity of the geometric texture structure between the original background scene regions and the replaced foreground regions, directional and nondirectional image completion approaches are developed to reconstruct the global geometric structure and to enhance the local detailed features of the replaced foreground regions in the lower and higher resolution level images, respectively. Moreover, the synthesis priority order of the individual patches and the appropriate choice of completion scheme (i.e., directional or nondirectional) are both determined in accordance with a Hessian matrix decision value (HMDV) parameter. Finally, a texture refinement process is performed to optimize the resolution of the synthesized result.

Original languageEnglish
Pages (from-to)2769-2779
Number of pages11
JournalIEEE Transactions on Image Processing
Volume18
Issue number12
DOIs
Publication statusPublished - 2009 Dec 1

Fingerprint

Textures
Sampling

All Science Journal Classification (ASJC) codes

  • Software
  • Medicine(all)
  • Computer Graphics and Computer-Aided Design

Cite this

@article{410fc149f22643da9073b3fbbfcc3cd8,
title = "Rapid image completion system using multiresolution patch-based directional and nondirectional approaches",
abstract = "This study presents a rapid image completion system comprising a training (or analysis) process and an image completion (or synthesis) process. The proposed system adopts a multiresolution approach, which not only improves the convergence rate of the synthesis process, but also provides the ability to deal with large replaced regions. In the training process, a down-sampling approach is applied to create a patch-based texture eigenspace based on multiresolution background region information. In the image completion process, an up-sampling approach is applied to synthesize the replaced foreground regions. To ensure the continuity of the geometric texture structure between the original background scene regions and the replaced foreground regions, directional and nondirectional image completion approaches are developed to reconstruct the global geometric structure and to enhance the local detailed features of the replaced foreground regions in the lower and higher resolution level images, respectively. Moreover, the synthesis priority order of the individual patches and the appropriate choice of completion scheme (i.e., directional or nondirectional) are both determined in accordance with a Hessian matrix decision value (HMDV) parameter. Finally, a texture refinement process is performed to optimize the resolution of the synthesized result.",
author = "Fang, {Chih Wei} and Lien, {James Jenn-Jier}",
year = "2009",
month = "12",
day = "1",
doi = "10.1109/TIP.2009.2027635",
language = "English",
volume = "18",
pages = "2769--2779",
journal = "IEEE Transactions on Image Processing",
issn = "1057-7149",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "12",

}

Rapid image completion system using multiresolution patch-based directional and nondirectional approaches. / Fang, Chih Wei; Lien, James Jenn-Jier.

In: IEEE Transactions on Image Processing, Vol. 18, No. 12, 01.12.2009, p. 2769-2779.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Rapid image completion system using multiresolution patch-based directional and nondirectional approaches

AU - Fang, Chih Wei

AU - Lien, James Jenn-Jier

PY - 2009/12/1

Y1 - 2009/12/1

N2 - This study presents a rapid image completion system comprising a training (or analysis) process and an image completion (or synthesis) process. The proposed system adopts a multiresolution approach, which not only improves the convergence rate of the synthesis process, but also provides the ability to deal with large replaced regions. In the training process, a down-sampling approach is applied to create a patch-based texture eigenspace based on multiresolution background region information. In the image completion process, an up-sampling approach is applied to synthesize the replaced foreground regions. To ensure the continuity of the geometric texture structure between the original background scene regions and the replaced foreground regions, directional and nondirectional image completion approaches are developed to reconstruct the global geometric structure and to enhance the local detailed features of the replaced foreground regions in the lower and higher resolution level images, respectively. Moreover, the synthesis priority order of the individual patches and the appropriate choice of completion scheme (i.e., directional or nondirectional) are both determined in accordance with a Hessian matrix decision value (HMDV) parameter. Finally, a texture refinement process is performed to optimize the resolution of the synthesized result.

AB - This study presents a rapid image completion system comprising a training (or analysis) process and an image completion (or synthesis) process. The proposed system adopts a multiresolution approach, which not only improves the convergence rate of the synthesis process, but also provides the ability to deal with large replaced regions. In the training process, a down-sampling approach is applied to create a patch-based texture eigenspace based on multiresolution background region information. In the image completion process, an up-sampling approach is applied to synthesize the replaced foreground regions. To ensure the continuity of the geometric texture structure between the original background scene regions and the replaced foreground regions, directional and nondirectional image completion approaches are developed to reconstruct the global geometric structure and to enhance the local detailed features of the replaced foreground regions in the lower and higher resolution level images, respectively. Moreover, the synthesis priority order of the individual patches and the appropriate choice of completion scheme (i.e., directional or nondirectional) are both determined in accordance with a Hessian matrix decision value (HMDV) parameter. Finally, a texture refinement process is performed to optimize the resolution of the synthesized result.

UR - http://www.scopus.com/inward/record.url?scp=77958026935&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77958026935&partnerID=8YFLogxK

U2 - 10.1109/TIP.2009.2027635

DO - 10.1109/TIP.2009.2027635

M3 - Article

VL - 18

SP - 2769

EP - 2779

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

SN - 1057-7149

IS - 12

ER -