TY - GEN
T1 - Detecting Generated Image Based on a Coupled Network with Two-Step Pairwise Learning
AU - Zhuang, Yi Xiu
AU - Hsu, Chih Chung
N1 - Funding Information:
This work was supported in part by the Ministry of Science and Technology of Taiwan under grants MOST 107-2218-E-020-002-MY3, MOST 107-2218-E-006-059, and MOST 108-2634-F-007-009-.
Publisher Copyright:
© 2019 IEEE.
PY - 2019/9
Y1 - 2019/9
N2 - With the rapid growth of generative adversarial networks (GANs), a photo-realistic image can be easily generated from a low-dimensional random vector nowadays. However, the generated image can be used to synthesize several persons who may have a potential effect on society with radical contents. Considering that many techniques to produce a photo-realistic facial image based on different GANs are already available, collecting training images of all possible generative models is difficult; hence, the learning-based approach would not effectively detect a fake image generated using an excluded generative model. To overcome this shortcoming, we propose a two-step pairwise learning approach to learn common fake features over the training images generated by using different generative models. First, the triplet loss will be used to simulate the relation between fake and real images and utilized to learn the discriminative features to determine whether an image is real or fake. Then, we propose a novel coupled network to accurately capture local and global image features of the fake or real images. The experimental results demonstrate that the proposed method outperforms the baseline supervised learning methods for fake facial image detection.
AB - With the rapid growth of generative adversarial networks (GANs), a photo-realistic image can be easily generated from a low-dimensional random vector nowadays. However, the generated image can be used to synthesize several persons who may have a potential effect on society with radical contents. Considering that many techniques to produce a photo-realistic facial image based on different GANs are already available, collecting training images of all possible generative models is difficult; hence, the learning-based approach would not effectively detect a fake image generated using an excluded generative model. To overcome this shortcoming, we propose a two-step pairwise learning approach to learn common fake features over the training images generated by using different generative models. First, the triplet loss will be used to simulate the relation between fake and real images and utilized to learn the discriminative features to determine whether an image is real or fake. Then, we propose a novel coupled network to accurately capture local and global image features of the fake or real images. The experimental results demonstrate that the proposed method outperforms the baseline supervised learning methods for fake facial image detection.
UR - http://www.scopus.com/inward/record.url?scp=85076800673&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85076800673&partnerID=8YFLogxK
U2 - 10.1109/ICIP.2019.8803464
DO - 10.1109/ICIP.2019.8803464
M3 - Conference contribution
AN - SCOPUS:85076800673
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 3212
EP - 3216
BT - 2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings
PB - IEEE Computer Society
T2 - 26th IEEE International Conference on Image Processing, ICIP 2019
Y2 - 22 September 2019 through 25 September 2019
ER -