High relief from brush painting

Yunfei Fu, Hongchuan Yu, Chih Kuo Yeh, Jianjun Zhang, Tong-Yee Lee

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Relief is an art form part way between 3D sculpture and 2D painting. We present a novel approach for generating a texture-mapped high-relief model from a single brush painting. Our aim is to extract the brushstrokes from a painting and generate the individual corresponding relief proxies rather than recovering the exact depth map from the painting, which is a tricky computer vision problem, requiring assumptions that are rarely satisfied. The relief proxies of brushstrokes are then combined together to form a 2.5D high-relief model. To extract brushstrokes from 2D paintings, we apply layer decomposition and stroke segmentation by imposing boundary constraints. The segmented brushstrokes preserve the style of the input painting. By inflation and a displacement map of each brushstroke, the features of brushstrokes are preserved by the resultant high-relief model of the painting. We demonstrate that our approach is able to produce convincing high-reliefs from a variety of paintings(with humans, animals, flowers, etc.). As a secondary application, we show how our brushstroke extraction algorithm could be used for image editing. As a result, our brushstroke extraction algorithm is specifically geared towards paintings with each brushstroke drawn very purposefully, such as Chinese paintings, Rosemailing paintings, etc.

Original languageEnglish
Article number8419282
Pages (from-to)2763-2776
Number of pages14
JournalIEEE Transactions on Visualization and Computer Graphics
Volume25
Issue number9
DOIs
Publication statusPublished - 2019 Sep 1

Fingerprint

Painting
Brushes
Computer vision
Animals
Textures
Decomposition

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Cite this

Fu, Yunfei ; Yu, Hongchuan ; Yeh, Chih Kuo ; Zhang, Jianjun ; Lee, Tong-Yee. / High relief from brush painting. In: IEEE Transactions on Visualization and Computer Graphics. 2019 ; Vol. 25, No. 9. pp. 2763-2776.
@article{9a345c1b864f4ad1a808dd8c3d2d3520,
title = "High relief from brush painting",
abstract = "Relief is an art form part way between 3D sculpture and 2D painting. We present a novel approach for generating a texture-mapped high-relief model from a single brush painting. Our aim is to extract the brushstrokes from a painting and generate the individual corresponding relief proxies rather than recovering the exact depth map from the painting, which is a tricky computer vision problem, requiring assumptions that are rarely satisfied. The relief proxies of brushstrokes are then combined together to form a 2.5D high-relief model. To extract brushstrokes from 2D paintings, we apply layer decomposition and stroke segmentation by imposing boundary constraints. The segmented brushstrokes preserve the style of the input painting. By inflation and a displacement map of each brushstroke, the features of brushstrokes are preserved by the resultant high-relief model of the painting. We demonstrate that our approach is able to produce convincing high-reliefs from a variety of paintings(with humans, animals, flowers, etc.). As a secondary application, we show how our brushstroke extraction algorithm could be used for image editing. As a result, our brushstroke extraction algorithm is specifically geared towards paintings with each brushstroke drawn very purposefully, such as Chinese paintings, Rosemailing paintings, etc.",
author = "Yunfei Fu and Hongchuan Yu and Yeh, {Chih Kuo} and Jianjun Zhang and Tong-Yee Lee",
year = "2019",
month = "9",
day = "1",
doi = "10.1109/TVCG.2018.2860004",
language = "English",
volume = "25",
pages = "2763--2776",
journal = "IEEE Transactions on Visualization and Computer Graphics",
issn = "1077-2626",
publisher = "IEEE Computer Society",
number = "9",

}

High relief from brush painting. / Fu, Yunfei; Yu, Hongchuan; Yeh, Chih Kuo; Zhang, Jianjun; Lee, Tong-Yee.

In: IEEE Transactions on Visualization and Computer Graphics, Vol. 25, No. 9, 8419282, 01.09.2019, p. 2763-2776.

Research output: Contribution to journalArticle

TY - JOUR

T1 - High relief from brush painting

AU - Fu, Yunfei

AU - Yu, Hongchuan

AU - Yeh, Chih Kuo

AU - Zhang, Jianjun

AU - Lee, Tong-Yee

PY - 2019/9/1

Y1 - 2019/9/1

N2 - Relief is an art form part way between 3D sculpture and 2D painting. We present a novel approach for generating a texture-mapped high-relief model from a single brush painting. Our aim is to extract the brushstrokes from a painting and generate the individual corresponding relief proxies rather than recovering the exact depth map from the painting, which is a tricky computer vision problem, requiring assumptions that are rarely satisfied. The relief proxies of brushstrokes are then combined together to form a 2.5D high-relief model. To extract brushstrokes from 2D paintings, we apply layer decomposition and stroke segmentation by imposing boundary constraints. The segmented brushstrokes preserve the style of the input painting. By inflation and a displacement map of each brushstroke, the features of brushstrokes are preserved by the resultant high-relief model of the painting. We demonstrate that our approach is able to produce convincing high-reliefs from a variety of paintings(with humans, animals, flowers, etc.). As a secondary application, we show how our brushstroke extraction algorithm could be used for image editing. As a result, our brushstroke extraction algorithm is specifically geared towards paintings with each brushstroke drawn very purposefully, such as Chinese paintings, Rosemailing paintings, etc.

AB - Relief is an art form part way between 3D sculpture and 2D painting. We present a novel approach for generating a texture-mapped high-relief model from a single brush painting. Our aim is to extract the brushstrokes from a painting and generate the individual corresponding relief proxies rather than recovering the exact depth map from the painting, which is a tricky computer vision problem, requiring assumptions that are rarely satisfied. The relief proxies of brushstrokes are then combined together to form a 2.5D high-relief model. To extract brushstrokes from 2D paintings, we apply layer decomposition and stroke segmentation by imposing boundary constraints. The segmented brushstrokes preserve the style of the input painting. By inflation and a displacement map of each brushstroke, the features of brushstrokes are preserved by the resultant high-relief model of the painting. We demonstrate that our approach is able to produce convincing high-reliefs from a variety of paintings(with humans, animals, flowers, etc.). As a secondary application, we show how our brushstroke extraction algorithm could be used for image editing. As a result, our brushstroke extraction algorithm is specifically geared towards paintings with each brushstroke drawn very purposefully, such as Chinese paintings, Rosemailing paintings, etc.

UR - http://www.scopus.com/inward/record.url?scp=85050637483&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050637483&partnerID=8YFLogxK

U2 - 10.1109/TVCG.2018.2860004

DO - 10.1109/TVCG.2018.2860004

M3 - Article

AN - SCOPUS:85050637483

VL - 25

SP - 2763

EP - 2776

JO - IEEE Transactions on Visualization and Computer Graphics

JF - IEEE Transactions on Visualization and Computer Graphics

SN - 1077-2626

IS - 9

M1 - 8419282

ER -