Learning Continuous Face Age Progression: A Pyramid of GANs

The two underlying requirements of face age progression, i.e., aging accuracy and identity permanence, are not well studied in the literature. This paper presents a novel generative adversarial network based approach to address the issues in a coupled manner. It separately models the constraints for the intrinsic subject-specific characteristics and the age-specific facial changes with respect to the elapsed time, ensuring that the generated faces present desired aging effects while keeping personalized properties stable. To render photo-realistic facial details, high-level age-specific features conveyed by the synthesized face are estimated by a pyramidal adversarial discriminator at multiple scales, which simulates the aging effects in a finer way. Further, an adversarial learning scheme is introduced to simultaneously train a single generator and multiple parallel discriminators, resulting in smooth continuous face aging sequences. The proposed method is applicable even in the presence of variations in pose, expression, makeup, etc., achieving remarkably vivid aging effects. Quantitative evaluations by a COTS face recognition system demonstrate that the target age distributions are accurately recovered, and 99.88 and 99.98 percent age progressed faces can be correctly verified at 0.001 percent FAR after age transformations of approximately 28 and 23 years elapsed time on the MORPH and CACD databases, respectively. Both visual and quantitative assessments show that the approach advances the state-of-the-art.

[1]  Horace Heafner Age-progression technology and its application to law enforcement , 1996, Other Conferences.

[2]  Ira Kemelmacher-Shlizerman,et al.  Illumination-Aware Age Progression , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Anil K. Jain,et al.  Learning Face Age Progression: A Pyramid Architecture of GANs , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Wen Gao,et al.  A Concatenational Graph Evolution Aging Model , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Heng Wang,et al.  Face Aging Effect Simulation Using Hidden Factor Analysis Joint Sparse Representation , 2015, IEEE Transactions on Image Processing.

[6]  Xinggang Lin,et al.  Age simulation for face recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Yiying Tong,et al.  Age-Invariant Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Yao Sun,et al.  Face Aging with Contextual Generative Adversarial Nets , 2017, ACM Multimedia.

[10]  Lior Wolf,et al.  Unsupervised Cross-Domain Image Generation , 2016, ICLR.

[11]  Andreas Lanitis,et al.  Comparative Evaluation of Automatic Age-Progression Methodologies , 2008, EURASIP J. Adv. Signal Process..

[12]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  J. B. Pittenger,et al.  Aging faces as viscal-elastic events: implications for a theory of nonrigid shape perception. , 1975, Journal of experimental psychology. Human perception and performance.

[14]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[15]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Anil K. Jain,et al.  A longitudinal study of automatic face recognition , 2015, 2015 International Conference on Biometrics (ICB).

[17]  Tien D. Bui,et al.  Longitudinal Face Modeling via Temporal Deep Restricted Boltzmann Machines , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[19]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[20]  Guo-Jun Qi,et al.  Loss-Sensitive Generative Adversarial Networks on Lipschitz Densities , 2017, International Journal of Computer Vision.

[21]  Qi Li,et al.  Global and Local Consistent Age Generative Adversarial Networks , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[22]  Yong Yu,et al.  Activation Maximization Generative Adversarial Nets , 2017 .

[23]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[24]  Guo-Jun Qi,et al.  Generalized Loss-Sensitive Adversarial Learning with Manifold Margins , 2018, ECCV.

[25]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[26]  Anil K. Jain,et al.  Automatic Face Recognition of Newborns, Infants, and Toddlers: A Longitudinal Evaluation , 2016, 2016 International Conference of the Biometrics Special Interest Group (BIOSIG).

[27]  Yann LeCun,et al.  Deep multi-scale video prediction beyond mean square error , 2015, ICLR.

[28]  C. Newman A life revealed , 2002 .

[29]  Bernt Schiele,et al.  Generative Adversarial Text to Image Synthesis , 2016, ICML.

[30]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[31]  Hanjiang Lai,et al.  Personalized Age Progression with Aging Dictionary , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[33]  Thomas Brox,et al.  Generating Images with Perceptual Similarity Metrics based on Deep Networks , 2016, NIPS.

[34]  Rama Chellappa,et al.  Modeling shape and textural variations in aging faces , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[35]  Daniel Thalmann,et al.  A plastic-visco-elastic model for wrinkles in facial animation and skin aging , 1994 .

[36]  Yunhong Wang,et al.  Combining Tensor Space Analysis and Active Appearance Models for Aging Effect Simulation on Face Images , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[38]  Anil K. Jain,et al.  Face Recognition Performance under Aging , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[39]  Jonathon Shlens,et al.  Conditional Image Synthesis with Auxiliary Classifier GANs , 2016, ICML.

[40]  Chu-Song Chen,et al.  Face Recognition and Retrieval Using Cross-Age Reference Coding With Cross-Age Celebrity Dataset , 2015, IEEE Transactions on Multimedia.

[41]  Nicu Sebe,et al.  Recurrent Face Aging , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[43]  Shiguang Shan,et al.  A Compositional and Dynamic Model for Face Aging , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Yun Fu,et al.  Age Synthesis and Estimation via Faces: A Survey , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Yang Song,et al.  Age Progression/Regression by Conditional Adversarial Autoencoder , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Marios Savvides,et al.  Temporal Non-volume Preserving Approach to Facial Age-Progression and Age-Invariant Face Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[47]  J. B. Pittenger,et al.  The perception of human growth. , 1980, Scientific American.

[48]  Andreas Lanitis,et al.  Evaluating the performance of face-aging algorithms , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[49]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.