Cross-Generating GAN for Facial Identity Preserving

The large variations of pose and illumination have been the great challenges to face recognition for many years. Because of these variations, many classical recognition methods fail to work. The key to solve this problem is to extract identity feature from face images. In recent years, people have been concentrating on synthesizing rotated faces, however, neglected the form of facial identity representation. In this paper, we propose Cross-generating Generative Adversarial Network (CG-GAN) to generate rotated faces while extracting discriminative identity. CG-GAN is allowed to learn a network to exchange poses and illuminations of two different subjects' picture. Within the network, each input image is resolved into a variation code and a identity code at the representation layer; then these codes are randomly combined for generating corresponding pictures. Not only does CG-GAN synthesis vivid face under desired pose from one picture, but also the represention layer is very suitable for face recognition task. We train and test CG-GAN on the Multi-PIE dataset and achieve state-of-the-art results.

[1]  Geoffrey E. Hinton.  Reducing the Dimensionality of Data with Neural , 2008 .

[2]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[3]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[4]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[5]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[6]  김준모,et al.  Rotating Your Face Using Multi-task Deep Neural Network , 2015 .

[7]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[8]  Xiaogang Wang,et al.  Multi-View Perceptron: a Deep Model for Learning Face Identity and View Representations , 2014, NIPS.

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[11]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  LinLin Shen,et al.  Gabor feature based face recognition using kernel methods , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[13]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[14]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Yike Guo,et al.  Unsupervised Image-to-Image Translation with Generative Adversarial Networks , 2017, ArXiv.

[16]  Xiaogang Wang,et al.  Deep Learning Identity-Preserving Face Space , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Xin Liu,et al.  Morphable Displacement Field Based Image Matching for Face Recognition across Pose , 2012, ECCV.

[18]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[19]  Byoung-Tak Zhang,et al.  Ways of Conditioning Generative Adversarial Networks , 2016, ArXiv.

[20]  Michael J. Jones,et al.  Fully automatic pose-invariant face recognition via 3D pose normalization , 2011, 2011 International Conference on Computer Vision.

[21]  Lior Wolf,et al.  Unsupervised Cross-Domain Image Generation , 2016, ICLR.

[22]  Xin Yu,et al.  Ultra-Resolving Face Images by Discriminative Generative Networks , 2016, ECCV.

[23]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[24]  E. Oja,et al.  Independent Component Analysis , 2013 .

[25]  Dimitris N. Metaxas,et al.  StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[26]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[28]  Xiaoming Liu,et al.  Disentangled Representation Learning GAN for Pose-Invariant Face Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).