Facial sketch synthesis using direct combined model

Ching Ting Tu, Jenn Jier James Lien

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Automatically synthesizing the facial sketches of a facial image is highly challenging since facial images typically exhibit a wide range of poses, expressions and scales, and have differing degrees of illumination and/or occlusion. When the facial sketches are to be synthesized in the unique sketching style of a particular artist, the problem becomes even more complex. This study develops an automatic facial sketch synthesis system based on a novel direct combined model (DCM) algorithm carrying three major advantages: First, DCM approach takes account of both the local details of each facial feature and the global geometric structure of the face, and thus the synthesized sketches more accurately mimic the caricatures drawn by the artist. Second, although the training database contains only full-frontal facial images with a neutral expression, sketches with a wide variety of facial poses, gaze directions and facial expressions can be successfully synthesized. Third, previous synthesizing proposals are heavily reliant on the quality of the texture reconstruction results, which in turn are highly sensitive to occlusion and lighting effects in the input image. DCM approach accurately produces lifelike synthesized facial sketches without the need to restore the texture information lost as a result of such unfavorable conditions.

Original languageEnglish
Title of host publication2010 IEEE International Conference on Multimedia and Expo, ICME 2010
Pages1196-1201
Number of pages6
DOIs
Publication statusPublished - 2010 Nov 22
Event2010 IEEE International Conference on Multimedia and Expo, ICME 2010 - Singapore, Singapore
Duration: 2010 Jul 192010 Jul 23

Publication series

Name2010 IEEE International Conference on Multimedia and Expo, ICME 2010

Other

Other2010 IEEE International Conference on Multimedia and Expo, ICME 2010
CountrySingapore
CitySingapore
Period10-07-1910-07-23

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Software

Cite this

Tu, C. T., & Lien, J. J. J. (2010). Facial sketch synthesis using direct combined model. In 2010 IEEE International Conference on Multimedia and Expo, ICME 2010 (pp. 1196-1201). [5583537] (2010 IEEE International Conference on Multimedia and Expo, ICME 2010). https://doi.org/10.1109/ICME.2010.5583537