Multi-feature shape regression for face alignment

Wei Jong Yang, Yi Chen Chen, Pau-Choo Chung, Jar-Ferr Yang

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

For smart living applications, personal identification as well as behavior and emotion detection becomes more and more important in our daily life. For identity classification and facial expression detection, facial features extracted from face images are the most popular and low-cost information. The face shape in terms of landmarks estimated by a face alignment method can be used for many applications including virtual face animation and real face classification. In this paper, we propose a robust face alignment method based on the multi-feature shape regression (MSR), which is evolved from the explicit shape regression (ESR) proposed in Cao et al. (Int, Vis, 2014, 107:177–190, Comput). The proposed MSR face alignment method successfully utilizes color, gradient, and regional information to increase accuracy of landmark estimation. For face recognition algorithms, we further suggest a face warping algorithm, which can cooperate with any face alignment algorithm to adjust facial pose variations to improve their recognition performances. For performance evaluations, the proposed and the existing face alignment methods are compared on the face alignment database. Based on alignment-based face recognition concept, the face alignment methods with the proposed face warping method are tested on the face database. Simulation results verify that the proposed MSR face alignment method achieves better performances than the other existing face alignment methods.

Original languageEnglish
Article number51
JournalEurasip Journal on Advances in Signal Processing
Volume2018
Issue number1
DOIs
Publication statusPublished - 2018 Dec 1

Fingerprint

Face recognition
Animation
Color
Costs

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Cite this

@article{40d164bd4f89435b93e8d5c6cb9c4365,
title = "Multi-feature shape regression for face alignment",
abstract = "For smart living applications, personal identification as well as behavior and emotion detection becomes more and more important in our daily life. For identity classification and facial expression detection, facial features extracted from face images are the most popular and low-cost information. The face shape in terms of landmarks estimated by a face alignment method can be used for many applications including virtual face animation and real face classification. In this paper, we propose a robust face alignment method based on the multi-feature shape regression (MSR), which is evolved from the explicit shape regression (ESR) proposed in Cao et al. (Int, Vis, 2014, 107:177–190, Comput). The proposed MSR face alignment method successfully utilizes color, gradient, and regional information to increase accuracy of landmark estimation. For face recognition algorithms, we further suggest a face warping algorithm, which can cooperate with any face alignment algorithm to adjust facial pose variations to improve their recognition performances. For performance evaluations, the proposed and the existing face alignment methods are compared on the face alignment database. Based on alignment-based face recognition concept, the face alignment methods with the proposed face warping method are tested on the face database. Simulation results verify that the proposed MSR face alignment method achieves better performances than the other existing face alignment methods.",
author = "Yang, {Wei Jong} and Chen, {Yi Chen} and Pau-Choo Chung and Jar-Ferr Yang",
year = "2018",
month = "12",
day = "1",
doi = "10.1186/s13634-018-0572-6",
language = "English",
volume = "2018",
journal = "Eurasip Journal on Advances in Signal Processing",
issn = "1687-6172",
publisher = "Springer Publishing Company",
number = "1",

}

Multi-feature shape regression for face alignment. / Yang, Wei Jong; Chen, Yi Chen; Chung, Pau-Choo; Yang, Jar-Ferr.

In: Eurasip Journal on Advances in Signal Processing, Vol. 2018, No. 1, 51, 01.12.2018.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Multi-feature shape regression for face alignment

AU - Yang, Wei Jong

AU - Chen, Yi Chen

AU - Chung, Pau-Choo

AU - Yang, Jar-Ferr

PY - 2018/12/1

Y1 - 2018/12/1

N2 - For smart living applications, personal identification as well as behavior and emotion detection becomes more and more important in our daily life. For identity classification and facial expression detection, facial features extracted from face images are the most popular and low-cost information. The face shape in terms of landmarks estimated by a face alignment method can be used for many applications including virtual face animation and real face classification. In this paper, we propose a robust face alignment method based on the multi-feature shape regression (MSR), which is evolved from the explicit shape regression (ESR) proposed in Cao et al. (Int, Vis, 2014, 107:177–190, Comput). The proposed MSR face alignment method successfully utilizes color, gradient, and regional information to increase accuracy of landmark estimation. For face recognition algorithms, we further suggest a face warping algorithm, which can cooperate with any face alignment algorithm to adjust facial pose variations to improve their recognition performances. For performance evaluations, the proposed and the existing face alignment methods are compared on the face alignment database. Based on alignment-based face recognition concept, the face alignment methods with the proposed face warping method are tested on the face database. Simulation results verify that the proposed MSR face alignment method achieves better performances than the other existing face alignment methods.

AB - For smart living applications, personal identification as well as behavior and emotion detection becomes more and more important in our daily life. For identity classification and facial expression detection, facial features extracted from face images are the most popular and low-cost information. The face shape in terms of landmarks estimated by a face alignment method can be used for many applications including virtual face animation and real face classification. In this paper, we propose a robust face alignment method based on the multi-feature shape regression (MSR), which is evolved from the explicit shape regression (ESR) proposed in Cao et al. (Int, Vis, 2014, 107:177–190, Comput). The proposed MSR face alignment method successfully utilizes color, gradient, and regional information to increase accuracy of landmark estimation. For face recognition algorithms, we further suggest a face warping algorithm, which can cooperate with any face alignment algorithm to adjust facial pose variations to improve their recognition performances. For performance evaluations, the proposed and the existing face alignment methods are compared on the face alignment database. Based on alignment-based face recognition concept, the face alignment methods with the proposed face warping method are tested on the face database. Simulation results verify that the proposed MSR face alignment method achieves better performances than the other existing face alignment methods.

UR - http://www.scopus.com/inward/record.url?scp=85051233038&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051233038&partnerID=8YFLogxK

U2 - 10.1186/s13634-018-0572-6

DO - 10.1186/s13634-018-0572-6

M3 - Article

VL - 2018

JO - Eurasip Journal on Advances in Signal Processing

JF - Eurasip Journal on Advances in Signal Processing

SN - 1687-6172

IS - 1

M1 - 51

ER -