Age Synthesis and Estimation via Faces: A Survey

Human age, as an important personal trait, can be directly inferred by distinct patterns emerging from the facial appearance. Derived from rapid advances in computer graphics and machine vision, computer-based age synthesis and estimation via faces have become particularly prevalent topics recently because of their explosively emerging real-world applications, such as forensic art, electronic customer relationship management, security control and surveillance monitoring, biometrics, entertainment, and cosmetology. Age synthesis is defined to rerender a face image aesthetically with natural aging and rejuvenating effects on the individual face. Age estimation is defined to label a face image automatically with the exact age (year) or the age group (year range) of the individual face. Because of their particularity and complexity, both problems are attractive yet challenging to computer-based application system designers. Large efforts from both academia and industry have been devoted in the last a few decades. In this paper, we survey the complete state-of-the-art techniques in the face image-based age synthesis and estimation topics. Existing models, popular algorithms, system performances, technical difficulties, popular face aging databases, evaluation protocols, and promising future directions are also provided with systematic discussions.

[1]  Fabio Lavagetto,et al.  An efficient use of MPEG-4 FAP interpolation for facial animation at 70 bits/frame , 2001, IEEE Trans. Circuits Syst. Video Technol..

[2]  Thomas S. Huang,et al.  Real-time speech-driven face animation with expressions using neural networks , 2002, IEEE Trans. Neural Networks.

[3]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[4]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Fu Yun Merging ratio images based realistic object class re-rendering , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[6]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[7]  Rama Chellappa,et al.  Modeling shape and textural variations in aging faces , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[8]  Nadia Magnenat-Thalmann,et al.  Simulation of Skin Aging and Wrinkles with Cosmetics Insight , 2000, Computer Animation and Simulation.

[9]  Mohammad Mahdi Dehshibi,et al.  Iranian Face Database with age, pose and expression , 2007, 2007 International Conference on Machine Vision.

[10]  J T Todd,et al.  The perception of growth in three dimensions , 1983, Perception & psychophysics.

[11]  Dorin Comaniciu,et al.  Image based regression using boosting method , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Andreas Lanitis,et al.  Comparative Evaluation of Automatic Age-Progression Methodologies , 2008, EURASIP J. Adv. Signal Process..

[14]  V. Sudhakar,et al.  Electronic Customer Relationship Management (E-CRM) , 2009 .

[15]  Thomas R. Alley,et al.  Head shape and the perception of cuteness. , 1981 .

[16]  Tetsunori Kobayashi,et al.  Subspace-based age-group classification using facial images under various lighting conditions , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[17]  D I Perrett,et al.  Extracting Prototypical Facial Images from Exemplars , 1993, Perception.

[18]  Feng Gao,et al.  Face Age Classification on Consumer Images with Gabor Feature and Fuzzy LDA Method , 2009, ICB.

[19]  Daniel Thalmann,et al.  A plastic-visco-elastic model for wrinkles in facial animation and skin aging , 1994 .

[20]  Yun Fu,et al.  A Probabilistic Fusion Approach to human age prediction , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[21]  C. Cacou Anthropometry of the head and face , 1995 .

[22]  D'arcy W. Thompson,et al.  On Growth and Form , 1917, Nature.

[23]  Hiroshi Ando,et al.  Extraction and manipulation of wrinkles and spots for facial image synthesis , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[24]  Tomaso A. Poggio,et al.  Multidimensional morphable models , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[25]  Takaaki Kuratate,et al.  A simple method for modeling wrinkles on human skin , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[26]  Daniel Thalmann,et al.  A dynamic wrinkle model in facial animation and skin ageing , 1995, Comput. Animat. Virtual Worlds.

[27]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[28]  Tomaso Poggio,et al.  Image Representations for Visual Learning , 1996, Science.

[29]  J. Langlois,et al.  Attractive Faces Are Only Average , 1990 .

[30]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[31]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[32]  Rama Chellappa,et al.  Modeling Age Progression in Young Faces , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[33]  A J O'Toole,et al.  Facial Aging, Attractiveness, and Distinctiveness , 1998, Perception.

[34]  Hans-Peter Seidel,et al.  Prediction of Individual Non‐Linear Aging Trajectories of Faces , 2007, Comput. Graph. Forum.

[35]  John Yen,et al.  Emotionally expressive agents , 1999, Proceedings Computer Animation 1999.

[36]  Yun Fu,et al.  Humanoid Audio–Visual Avatar With Emotive Text-to-Speech Synthesis , 2008, IEEE Transactions on Multimedia.

[37]  Alexander C. Loui,et al.  Automatic face-based image grouping for albuming , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[38]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[39]  Demetri Terzopoulos,et al.  Facial modeling and animation , 2004, SIGGRAPH '04.

[40]  Christopher J. Solomon,et al.  Aging the human face - a statistically rigorous approach , 2005 .

[41]  Nanning Zheng,et al.  Facetransfer: a system model of facial image rendering , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[42]  Yun Fu,et al.  A study on automatic age estimation using a large database , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[43]  V. Bruce,et al.  Further experiments on the perception of growth in three dimensions , 1989, Perception & psychophysics.

[44]  Zicheng Liu,et al.  Expressive expression mapping with ratio images , 2001, SIGGRAPH.

[45]  J. B. Pittenger,et al.  Perceptual information for the age level of faces as a higher order invariant of growth. , 1979, Journal of experimental psychology. Human perception and performance.

[46]  Zicheng Liu,et al.  Image-based surface detail transfer , 2004, IEEE Computer Graphics and Applications.

[47]  Haizhou Ai,et al.  Demographic Classification with Local Binary Patterns , 2007, ICB.

[48]  Keith Waters,et al.  Computer facial animation , 1996 .

[49]  Hiroyasu Koshimizu,et al.  Method for estimating and modeling age and gender using facial image processing , 2001, Proceedings Seventh International Conference on Virtual Systems and Multimedia.

[50]  D. Perrett,et al.  Computer-enhanced emotion in facial expressions , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[51]  Wen Gao,et al.  Design sparse features for age estimation using hierarchical face model , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[52]  K. Ricanek,et al.  The effect of normal adult aging on standard PCA face recognition accuracy rates , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[53]  A. Albert,et al.  A review of the literature on the aging adult skull and face: implications for forensic science research and applications. , 2007, Forensic science international.

[54]  Rama Chellappa,et al.  Face Verification Across Age Progression , 2006, IEEE Transactions on Image Processing.

[55]  Harry Shum,et al.  Example-based caricature generation with exaggeration , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[56]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[57]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[58]  Shuicheng Yan,et al.  Synchronized Submanifold Embedding for Person-Independent Pose Estimation and Beyond , 2009, IEEE Transactions on Image Processing.

[59]  A. Gunay,et al.  Automatic age classification with LBP , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[60]  Hiroshi Nagahashi,et al.  Classification of Age Group Based on Facial Images of Young Males by Using Neural Networks , 2001 .

[61]  Ye Xu,et al.  Estimating Human Age by Manifold Analysis of Face Pictures and Regression on Aging Features , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[62]  Xinggang Lin,et al.  Age simulation for face recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[63]  M GONZALEZ-ULLOA,et al.  SENILITY OF THE FACE—BASIC STUDY TO UNDERSTAND ITS CAUSES AND EFFECTS , 1965, Plastic and reconstructive surgery.

[64]  Yun Fu,et al.  Human age estimation using bio-inspired features , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[65]  Zhigang Deng,et al.  Computer Facial Animation: A Survey , 2008 .

[66]  Demetri Terzopoulos,et al.  Multilinear Analysis of Image Ensembles: TensorFaces , 2002, ECCV.

[67]  J. B. Pittenger,et al.  Wrinkling and head shape as coordinated sources of age-level information , 1980 .

[68]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[69]  K. Ricanek,et al.  Comparison of synthetic face aging to age progression by forensic sketch artist , 2007 .

[70]  Frederick I. Parke,et al.  Computer gernerated animation of faces , 1998 .

[71]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[72]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[73]  Jun-yong Noh,et al.  A Survey of Facial Modeling and Animation Techniques , 2001 .

[74]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[75]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[76]  Arne Stoschek,et al.  Image-based re-rendering of faces for continuous pose and illumination directions , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[77]  Bingbing Ni,et al.  Web image mining towards universal age estimator , 2009, ACM Multimedia.

[78]  Shuicheng Yan,et al.  Ranking with Uncertain Labels , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[79]  D. Perrett,et al.  Perception of age in adult Caucasian male faces: computer graphic manipulation of shape and colour information , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[80]  Pengfei Shi,et al.  Age Estimation Robust to Expression Variations , 2008, 2008 International Conference on Computational Intelligence for Modelling Control & Automation.

[81]  Rama Chellappa,et al.  Computational methods for modeling facial aging: A survey , 2009, J. Vis. Lang. Comput..

[82]  K. Ricanek,et al.  Aspects of Age Variation in Facial Morphology Affecting Biometrics , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[83]  Stefano Soatto,et al.  A Study of Face Recognition as People Age , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[84]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[85]  Kate Smith-Miles,et al.  Facial age estimation by multilinear subspace analysis , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[86]  Timothy F. Cootes,et al.  Toward Automatic Simulation of Aging Effects on Face Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[87]  Thomas S. Huang Locally Linear Embedded Eigenspace Analysis , 2005 .

[88]  Yunhong Wang,et al.  Facial aging simulation based on super-resolution in tensor space , 2008, 2008 15th IEEE International Conference on Image Processing.

[89]  Hongyuan Zha,et al.  Learning distance metric for regression by semidefinite programming with application to human age estimation , 2009, ACM Multimedia.

[90]  K. Ricanek,et al.  AUTOMATIC REPRESENTATION OF ADULT AGING IN FACIAL IMAGES , 2022 .

[91]  Riad I. Hammoud,et al.  Face Biometrics for Personal Identification , 2007 .

[92]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[93]  Niels da Vitoria Lobo,et al.  Age Classification from Facial Images , 1999, Comput. Vis. Image Underst..

[94]  L S Mark,et al.  Structural support for the perception of growth. , 1986, Journal of experimental psychology. Human perception and performance.

[95]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[96]  Yu Zhang,et al.  Learning from facial aging patterns for automatic age estimation , 2006, MM '06.

[97]  Yun Fu,et al.  Locally Adjusted Robust Regression for Human Age Estimation , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[98]  Seiji Inokuchi,et al.  Subjective age estimation system using facial images - how old we feel compared to others , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[99]  G. Rhodes,et al.  Averageness, Exaggeration, and Facial Attractiveness , 1996 .

[100]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[101]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[102]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[103]  Christopher J. Solomon,et al.  A person-specific, rigorous aging model of the human face , 2006, Pattern Recognit. Lett..

[104]  Y. Mitsukura,et al.  Appearance-age feature extraction from facial image based on age perception , 2007, SICE Annual Conference 2007.

[105]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[106]  J. Thompson,et al.  MOVPE growth for the fabrication of OEICs , 1992 .

[107]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[108]  J. B. Pittenger,et al.  Aging faces as viscal-elastic events: implications for a theory of nonrigid shape perception. , 1975, Journal of experimental psychology. Human perception and performance.

[109]  Thomas S. Huang,et al.  3D Face Processing: Modeling, Analysis and Synthesis , 2004 .

[110]  W. Arthur D'Arcy Thompson and the theory of transformations , 2006, Nature Reviews Genetics.

[111]  Shuicheng Yan,et al.  Learning Auto-Structured Regressor from Uncertain Nonnegative Labels , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[112]  Narendra Ahuja,et al.  Facial expression decomposition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[113]  D. Berry,et al.  Perceiving character in faces: the impact of age-related craniofacial changes on social perception. , 1986, Psychological bulletin.

[114]  Sung Yong Shin,et al.  An example-based approach for facial expression cloning , 2003, SCA '03.

[115]  David Salesin,et al.  Modeling and Animating Realistic Faces from Images , 2002, International Journal of Computer Vision.

[116]  A.J O'Toole,et al.  3D shape and 2D surface textures of human faces: the role of "averages" in attractiveness and age , 1999, Image Vis. Comput..

[117]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[118]  J L Hoeyberghs,et al.  Cosmetic surgery , 1999, BMJ.

[119]  Rama Chellappa,et al.  Recognizing Faces Across Age Progression , 2007 .

[120]  Patrik Sörqvist,et al.  Experts on age estimation. , 2009, Scandinavian journal of psychology.

[121]  Malik Beshir Malik,et al.  Applied Linear Regression , 2005, Technometrics.

[122]  T. Valentine The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[123]  H. Sebastian Seung,et al.  The Manifold Ways of Perception , 2000, Science.

[124]  Asuman Gunay,et al.  Automatic Detection of Anthropometric Features from Facial Images , 2007, 2007 IEEE 15th Signal Processing and Communications Applications.

[125]  Zhi-Hua Zhou,et al.  Automatic Age Estimation Based on Facial Aging Patterns , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[126]  Yun Fu,et al.  Conformal Embedding Analysis with Local Graph Modeling on the Unit Hypersphere , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[127]  Song-Chun Zhu,et al.  A Multi-Resolution Dynamic Model for Face Aging Simulation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[128]  Tetsuya Ohtani,et al.  A gender and age estimation system from face images , 2003, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[129]  Nadia Magnenat-Thalmann,et al.  Simulating wrinkles and skin aging , 1999, The Visual Computer.

[130]  N. Zheng,et al.  M-Face: An Appearance-Based Photorealistic Model for Multiple Facial Attributes Rendering , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[131]  Frederick I. Parke,et al.  Computer generated animation of faces , 1972, ACM Annual Conference.

[132]  Josef Kittler,et al.  3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approachest , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[133]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[134]  Markus H. Gross,et al.  Simulating facial surgery using finite element models , 1996, SIGGRAPH.

[135]  Andrew C. Gallagher,et al.  Understanding images of groups of people , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[136]  Yun Fu,et al.  Human Age Estimation With Regression on Discriminative Aging Manifold , 2008, IEEE Transactions on Multimedia.

[137]  C. Christodoulou,et al.  Comparing different classifiers for automatic age estimation , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[138]  G. Hole,et al.  Factors Influencing the Accuracy of Age Estimates of Unfamiliar Faces , 1995, Perception.

[139]  David I. Perrett,et al.  Synthesising continuous-tone caricatures , 1991, Image Vis. Comput..

[140]  J. B. Pittenger,et al.  The perception of human growth. , 1980, Scientific American.

[141]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[142]  Y. Mitsukura,et al.  Apparent age estimation system based on age perception , 2007, SICE Annual Conference 2007.

[143]  Thomas S. Huang,et al.  Face age estimation using patch-based hidden Markov model supervectors , 2008, 2008 19th International Conference on Pattern Recognition.

[144]  Yun Fu,et al.  Image-Based Human Age Estimation by Manifold Learning and Locally Adjusted Robust Regression , 2008, IEEE Transactions on Image Processing.

[145]  Hiroyasu Koshimizu,et al.  Age and Gender Estimations by Modeling Statistical Relationship among Faces , 2003, KES.

[146]  Maulin R. Gandhi A Method for Automatic Synthesis of Aged Human Facial Images , 2004 .

[147]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[148]  A. O'Toole,et al.  Three-Dimensional Caricatures of Human Heads: Distinctiveness and the Perception of Facial Age , 1997, Perception.

[149]  Anil K. Jain,et al.  Generating Discriminating Cartoon Faces Using Interacting Snakes , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[150]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[151]  Y. Mitsukura,et al.  A Design of Gender and Age Estimation System Based on Facial Knowledge , 2006, 2006 SICE-ICASE International Joint Conference.

[152]  J T Todd,et al.  Perception of growth: a geometric analysis of how different styles of change are distinguished. , 1981, Journal of experimental psychology. Human perception and performance.

[153]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[154]  Shuicheng Yan,et al.  Extracting age information from local spatially flexible patches , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[155]  Ming Liu,et al.  Regression from patch-kernel , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[156]  Hiroyasu Koshimizu,et al.  Age and gender estimation from facial image processing , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[157]  Tsuhan Chen,et al.  Estimating age, gender, and identity using first name priors , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.