Image Vectorization with Real-Time Thin-Plate Spline

Kuo Wei Chen, Ying Sheng Luo, Yu Chi Lai, Yan Lin Chen, Chih Yuan Yao, Hung Kuo Chu, Tong Yee Lee

Research output: Contribution to journalArticle

Abstract

The vector graphics with gradient mesh can be attributed to their compactness and scalability; however, they tend to fall short when it comes to real-time editing due to a lack of real-time rasterization and an efficient editing tool for image details. In this paper, we encode global manipulation geometries and local image details within a hybrid vector structure, using parametric patches and detailed features for localized and parallelized thin-plate spline interpolation in order to achieve good compressibility, interactive expressibility, and editability. The proposed system then automatically extracts an optimal set of detailed color features while considering the compression ratio of the image as well as reconstruction error and its characteristics applicable to the preservation of structural and irregular saliency of the image. The proposed real-time vector representation makes it possible to construct an interactive editing system for detail-maintained image magnification and color editing as well as material replacement in cross mapping, without maintaining spatial and temporal consistency while editing in a raster space. Experiments demonstrate that our representation method is superior to several state-of-the-art methods and as good as JPEG, while providing real-time editability and preserving structural and irregular saliency information.

Original languageEnglish
Article number8734892
Pages (from-to)15-29
Number of pages15
JournalIEEE Transactions on Multimedia
Volume22
Issue number1
DOIs
Publication statusPublished - 2020 Jan

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Chen, K. W., Luo, Y. S., Lai, Y. C., Chen, Y. L., Yao, C. Y., Chu, H. K., & Lee, T. Y. (2020). Image Vectorization with Real-Time Thin-Plate Spline. IEEE Transactions on Multimedia, 22(1), 15-29. [8734892]. https://doi.org/10.1109/TMM.2019.2922126