TY - GEN
T1 - Thermal face recognition based on transformation by residual U-net and pixel shuffle upsampling
AU - Chatterjee, Soumya
AU - Chu, Wei Ta
N1 - Funding Information:
Acknowledgement. This work was partially supported by the Ministry of Science and Technology under the grant 108-2221-E-006-227-MY3, 107-2221-E-006-239-MY2, 107-2923-E-194-003-MY3, 107-2627-H-155-001, and 107-2218-E-002-055.
Publisher Copyright:
© 2020, Springer Nature Switzerland AG.
PY - 2020
Y1 - 2020
N2 - We present a thermal face recognition system that first transforms the given face in the thermal spectrum into the visible spectrum, and then recognizes the transformed face by matching it with the face gallery. To achieve high-fidelity transformation, the U-Net structure with a residual network backbone is developed for generating visible face images from thermal face images. Our work mainly improves upon previous works on the Nagoya University thermal face dataset. In the evaluation, we show that the rank-1 recognition accuracy can be improved by more than 10%. The improvement on visual quality of transformed faces is also measured in terms of PSNR (with 0.36 dB improvement) and SSIM (with 0.07 improvement).
AB - We present a thermal face recognition system that first transforms the given face in the thermal spectrum into the visible spectrum, and then recognizes the transformed face by matching it with the face gallery. To achieve high-fidelity transformation, the U-Net structure with a residual network backbone is developed for generating visible face images from thermal face images. Our work mainly improves upon previous works on the Nagoya University thermal face dataset. In the evaluation, we show that the rank-1 recognition accuracy can be improved by more than 10%. The improvement on visual quality of transformed faces is also measured in terms of PSNR (with 0.36 dB improvement) and SSIM (with 0.07 improvement).
UR - http://www.scopus.com/inward/record.url?scp=85078564884&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85078564884&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-37731-1_55
DO - 10.1007/978-3-030-37731-1_55
M3 - Conference contribution
AN - SCOPUS:85078564884
SN - 9783030377304
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 679
EP - 689
BT - MultiMedia Modeling - 26th International Conference, MMM 2020, Proceedings
A2 - Cheng, Wen-Huang
A2 - Kim, Junmo
A2 - Choi, Jung-Woo
A2 - Chu, Wei-Ta
A2 - Cui, Peng
A2 - Hu, Min-Chun
A2 - De Neve, Wesley
PB - Springer
T2 - 26th International Conference on MultiMedia Modeling, MMM 2020
Y2 - 5 January 2020 through 8 January 2020
ER -