Face image synthesis with weight and age progression using conditional adversarial autoencoder

The appearance of a human face changes with the change in body weight and age. With varying lifestyle choices, it is hard to imagine the appearance of a given human face in years to come. Future self-perception is highly associated with one’s emotional state, as well as health behavior. Negative future self-perception can cause negative lifestyle choice and negative health behavior, leading to depression and eating disorder. In this paper, a new methodology is introduced for future self-face image synthesis using age and weight, resulting in visualization of future face image derived from given weight category and age. A Constrained Local Model is first used for weight progressed future face image synthesized and then age-progressed future face image is generated using Conditional Adversarial Auto Encoder. In the final step, both weight progressed and age-progressed face images fed to face morphing module which synthesized future face image by keeping natural looks. Experimental results show the advantages of proposed method with promising results.

[1]  Timothy F. Cootes,et al.  Face recognition using the active appearance model. , 1998, European Conference on Computer Vision.

[2]  Karl Ricanek,et al.  Improvements in Active Appearance Model based synthetic age progression for adult aging , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[3]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[4]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[5]  Yunhong Wang,et al.  Combining Tensor Space Analysis and Active Appearance Models for Aging Effect Simulation on Face Images , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Ira Kemelmacher-Shlizerman,et al.  Collection flow , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Chu-Song Chen,et al.  Cross-Age Reference Coding for Age-Invariant Face Recognition and Retrieval , 2014, ECCV.

[9]  Chih-Yao Chuang,et al.  Aging simulation using facial muscle model , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[10]  K. Ricanek,et al.  Comparison of synthetic face aging to age progression by forensic sketch artist , 2007 .

[11]  Rama Chellappa,et al.  Modeling Age Progression in Young Faces , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Thomas S. Huang,et al.  Face hallucination VIA sparse coding , 2008, 2008 15th IEEE International Conference on Image Processing.

[13]  D. Perrett,et al.  Perception of age in adult Caucasian male faces: computer graphic manipulation of shape and colour information , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[14]  K. Ricanek,et al.  Aspects of Age Variation in Facial Morphology Affecting Biometrics , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[15]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[16]  Ji-Xiang Du,et al.  Face Aging Simulation Based on NMF Algorithm with Sparseness Constraints , 2011, ICIC.

[17]  Shiguang Shan,et al.  A Compositional and Dynamic Model for Face Aging , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Rob Fergus,et al.  Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks , 2015, NIPS.

[19]  Miriam Furst,et al.  Algorithm for facial weight-change [image weight-change simulator] , 2004, Proceedings of the 2004 11th IEEE International Conference on Electronics, Circuits and Systems, 2004. ICECS 2004..

[20]  Yixiong Liang,et al.  A Multi-layer Model for Face Aging Simulation , 2011, Trans. Edutainment.

[21]  Simon Lucey,et al.  Face alignment through subspace constrained mean-shifts , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Yang Song,et al.  Age Progression/Regression by Conditional Adversarial Autoencoder , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Sheng-Wen Shih,et al.  Exemplar-based Age Progression Prediction in Children Faces , 2011, 2011 IEEE International Symposium on Multimedia.

[24]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[25]  V. Lánská,et al.  Which index best correlates with body fat mass: BAI, BMI, waist or WHR? , 2012, Neuro endocrinology letters.

[26]  Charles X. Ling,et al.  Artificial Aging of Faces by Support Vector Machines , 2004, Canadian Conference on AI.

[27]  Wen Gao,et al.  A Concatenational Graph Evolution Aging Model , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Yunhong Wang,et al.  Facial aging simulation based on super-resolution in tensor space , 2008, 2008 15th IEEE International Conference on Image Processing.

[29]  Philip J. Benson,et al.  A computer-graphic technique for the study of body size perception and body types , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[30]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[31]  Miriam Furst,et al.  A computer-based method for the assessment of body-image distortions in anorexia-nervosa patients , 2001, IEEE Transactions on Information Technology in Biomedicine.

[32]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[33]  S. Shyam Sundar,et al.  Visualizing ideal self vs. actual self through avatars: Impact on preventive health outcomes , 2012, Comput. Hum. Behav..

[34]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[35]  Juan Botella,et al.  BODY-IMAGE DISTURBANCE IN EATING DISORDERS: A META-ANALYSIS , 2002 .

[36]  Hanjiang Lai,et al.  Personalized Age Progression with Aging Dictionary , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[37]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[38]  Maulin R. Gandhi A Method for Automatic Synthesis of Aged Human Facial Images , 2004 .

[39]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[40]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[41]  Kang-Hyun Jo,et al.  Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence , 2008, Lecture Notes in Computer Science.

[42]  Timothy F. Cootes,et al.  Advances in active appearance models , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[43]  D. Perrett,et al.  Deciphering Faces: Quantifiable Visual Cues to Weight , 2010, Perception.

[44]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[45]  M. Jiwa,et al.  Preliminary findings of how visual demonstrations of changes to physical appearance may enhance weight loss attempts. , 2015, European journal of public health.

[46]  Andreas Lanitis,et al.  Comparative Evaluation of Automatic Age-Progression Methodologies , 2008, EURASIP J. Adv. Signal Process..

[47]  K. Ricanek,et al.  AUTOMATIC REPRESENTATION OF ADULT AGING IN FACIAL IMAGES , 2022 .

[48]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[49]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[50]  Ira Kemelmacher-Shlizerman,et al.  Illumination-Aware Age Progression , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[52]  Duncan Rowland,et al.  Manipulating facial appearance through shape and color , 1995, IEEE Computer Graphics and Applications.