Interactive high-relief reconstruction for organic and double-sided objects from a photo

Chih Kuo Yeh, Shi Yang Huang, Pradeep Kumar Jayaraman, Chi Wing Fu, Tong Yee Lee

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

We introduce an interactive user-driven method to reconstruct high-relief 3D geometry from a single photo. Particularly, we consider two novel but challenging reconstruction issues: i) common non-rigid objects whose shapes are organic rather than polyhedral/symmetric, and ii) double-sided structures, where front and back sides of some curvy object parts are revealed simultaneously on image. To address these issues, we develop a three-stage computational pipeline. First, we construct a 2.5D model from the input image by user-driven segmentation, automatic layering, and region completion, handling three common types of occlusion. Second, users can interactively mark-up slope and curvature cues on the image to guide our constrained optimization model to inflate and lift up the image layers. We provide real-time preview of the inflated geometry to allow interactive editing. Third, we stitch and optimize the inflated layers to produce a high-relief 3D model. Compared to previous work, we can generate high-relief geometry with large viewing angles, handle complex organic objects with multiple occluded regions and varying shape profiles, and reconstruct objects with double-sided structures. Lastly, we demonstrate the applicability of our method on a wide variety of input images with human, animals, flowers, etc.

Original languageEnglish
Article number7482721
Pages (from-to)1796-1808
Number of pages13
JournalIEEE Transactions on Visualization and Computer Graphics
Volume23
Issue number7
DOIs
Publication statusPublished - 2017 Jul

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Cite this