Personalized Age Progression with Bi-Level Aging Dictionary Learning

Age progression is defined as aesthetically re-rendering the aging face at any future age for an individual face. In this work, we aim to automatically render aging faces in a personalized way. Basically, for each age group, we learn an aging dictionary to reveal its aging characteristics (e.g., wrinkles), where the dictionary bases corresponding to the same index yet from two neighboring aging dictionaries form a particular aging pattern cross these two age groups, and a linear combination of all these patterns expresses a particular personalized aging process. Moreover, two factors are taken into consideration in the dictionary learning process. First, beyond the aging dictionaries, each person may have extra personalized facial characteristics, e.g., mole, which are invariant in the aging process. Second, it is challenging or even impossible to collect faces of all age groups for a particular person, yet much easier and more practical to get face pairs from neighboring age groups. To this end, we propose a novel Bi-level Dictionary Learning based Personalized Age Progression (BDL-PAP) method. Here, bi-level dictionary learning is formulated to learn the aging dictionaries based on face pairs from neighboring age groups. Extensive experiments well demonstrate the advantages of the proposed BDL-PAP over other state-of-the-arts in term of personalized age progression, as well as the performance gain for cross-age face verification by synthesizing aging faces.

[1]  Xinggang Lin,et al.  Age simulation for face recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[2]  Rama Chellappa,et al.  Age Estimation and Face Verification Across Aging Using Landmarks , 2012, IEEE Transactions on Information Forensics and Security.

[3]  Karl Ricanek,et al.  A hierarchical approach to facial aging , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[4]  Xian-Sheng Hua,et al.  Two-Dimensional Multilabel Active Learning with an Efficient Online Adaptation Model for Image Classification , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  D. Perrett,et al.  Perception of age in adult Caucasian male faces: computer graphic manipulation of shape and colour information , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[6]  Rama Chellappa,et al.  Computational methods for modeling facial aging: A survey , 2009, J. Vis. Lang. Comput..

[7]  Jonghyun Choi,et al.  Multi-Directional Multi-Level Dual-Cross Patterns for Robust Face Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Andreas Lanitis A survey of the effects of aging on biometric identity verification , 2010, Int. J. Biom..

[9]  Stefano Soatto,et al.  A Study of Face Recognition as People Age , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Shiguang Shan,et al.  Shape driven kernel adaptation in Convolutional Neural Network for robust facial trait recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Min Chen,et al.  Image‐based Aging Using Evolutionary Computing , 2008, Comput. Graph. Forum.

[12]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[14]  K. Ricanek,et al.  AUTOMATIC REPRESENTATION OF ADULT AGING IN FACIAL IMAGES , 2022 .

[15]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  Shuicheng Yan,et al.  Image Classification With Tailored Fine-Grained Dictionaries , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  LingHaibin,et al.  Face verification across age progression using discriminative methods , 2010 .

[18]  Stefano Soatto,et al.  Face Verification Across Age Progression Using Discriminative Methods , 2010, IEEE Transactions on Information Forensics and Security.

[19]  A. Albert,et al.  A review of the literature on the aging adult skull and face: implications for forensic science research and applications. , 2007, Forensic science international.

[20]  Richa Singh,et al.  Bacteria Foraging Fusion for Face Recognition across Age Progression , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[21]  HuaXian-Sheng,et al.  Two-Dimensional Multilabel Active Learning with an Efficient Online Adaptation Model for Image Classification , 2009 .

[22]  Susana Martinez-Conde Age progression , 2015, Nature.

[23]  Pascal Paysan,et al.  Statistical modeling of facial aging based on 3D scans , 2010 .

[24]  Zhi-Hua Zhou,et al.  Automatic Age Estimation Based on Facial Aging Patterns , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  R. Chellappa,et al.  Age progression in Human Faces : A Survey , 2008 .

[26]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[27]  Yi-Ping Hung,et al.  Ordinal hyperplanes ranker with cost sensitivities for age estimation , 2011, CVPR 2011.

[28]  Dahua Lin,et al.  Hidden Factor Analysis for Age Invariant Face Recognition , 2013, 2013 IEEE International Conference on Computer Vision.

[29]  Charu C. Aggarwal,et al.  Joint Intermodal and Intramodal Label Transfers for Extremely Rare or Unseen Classes , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Hans-Peter Seidel,et al.  Prediction of Individual Non‐Linear Aging Trajectories of Faces , 2007, Comput. Graph. Forum.

[31]  Sheng-Wen Shih,et al.  Exemplar-based Age Progression Prediction in Children Faces , 2011, 2011 IEEE International Symposium on Multimedia.

[32]  Guodong Guo,et al.  Cross-Age Face Recognition on a Very Large Database: The Performance versus Age Intervals and Improvement Using Soft Biometric Traits , 2010, 2010 20th International Conference on Pattern Recognition.

[33]  Yixiong Liang,et al.  A Multi-layer Model for Face Aging Simulation , 2011, Trans. Edutainment.

[34]  Yun Fu,et al.  Human age estimation using bio-inspired features , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Timothy F. Cootes,et al.  Toward Automatic Simulation of Aging Effects on Face Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Wen Gao,et al.  A Concatenational Graph Evolution Aging Model , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Francisco J. Perales López,et al.  A Facial Aging Simulation Method Using flaccidity deformation criteria , 2006, Tenth International Conference on Information Visualisation (IV'06).

[38]  Xuelong Li,et al.  A maximum entropy feature descriptor for age invariant face recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Rama Chellappa,et al.  Face Verification Across Age Progression , 2006, IEEE Transactions on Image Processing.

[42]  Hanjiang Lai,et al.  Kinship-Guided Age Progression , 2016, Pattern Recognit..

[43]  Nicu Sebe,et al.  Recurrent Face Aging , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Hanjiang Lai,et al.  Personalized Age Progression with Aging Dictionary , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[45]  Yiying Tong,et al.  Face recognition with temporal invariance: A 3D aging model , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[46]  Shigeo Morishima,et al.  Facial aging simulator considering geometry and patch-tiled texture , 2012, SIGGRAPH '12.

[47]  Jinhui Tang,et al.  Age progression: Current technologies and applications , 2016, Neurocomputing.

[48]  Ira Kemelmacher-Shlizerman,et al.  Collection flow , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Yiying Tong,et al.  Age-Invariant Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[51]  Heng Ji,et al.  Exploring Context and Content Links in Social Media: A Latent Space Method , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Greyce N. Schroeder,et al.  Facial Aging Using Image Warping , 2007 .

[53]  Bernard Tiddeman,et al.  Prototyping and Transforming Facial Textures for Perception Research , 2001, IEEE Computer Graphics and Applications.

[54]  Thomas S. Huang,et al.  Bilevel sparse coding for coupled feature spaces , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[55]  Chu-Song Chen,et al.  Cross-Age Reference Coding for Age-Invariant Face Recognition and Retrieval , 2014, ECCV.

[56]  K. Ricanek,et al.  Comparison of synthetic face aging to age progression by forensic sketch artist , 2007 .

[57]  Song-Chun Zhu,et al.  A Multi-Resolution Dynamic Model for Face Aging Simulation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[58]  Meng Wang,et al.  Deep Aging Face Verification With Large Gaps , 2016, IEEE Transactions on Multimedia.

[59]  Shiguang Shan,et al.  A Compositional and Dynamic Model for Face Aging , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Yixiong Liang,et al.  Age Simulation in Young Face Images , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[61]  Yun Fu,et al.  Age Synthesis and Estimation via Faces: A Survey , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Ira Kemelmacher-Shlizerman,et al.  Illumination-Aware Age Progression , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[63]  Wen Gao,et al.  Learning long term face aging patterns from partially dense aging databases , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[64]  Christopher J. Solomon,et al.  A person-specific, rigorous aging model of the human face , 2006, Pattern Recognit. Lett..

[65]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[66]  David W. Hunter,et al.  Synthesis of facial ageing transforms using three-dimensional morphable models , 2009 .

[67]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[68]  Maulin R. Gandhi A Method for Automatic Synthesis of Aged Human Facial Images , 2004 .