Age Estimation and Face Verification Across Aging Using Landmarks

Age estimation and face verification across aging are important problems with a wide range of applications. It is well known that age and identity information are encoded in both texture and shape of the face. Building on recent advances in landmark extraction and statistical techniques for landmark-based shape analysis, we consider these problems using facial shapes. We show that by using well-defined shape spaces and their associated geometry, one can obtain significant performance improvements in both age estimation and face verification. Toward this end, we propose to model the facial shapes as points on a Grassmann manifold. Age estimation and face verification are then considered as regression and classification problems on this manifold. Algorithms for regression and classification are designed to take into account the geometry of the underlying space. The proposed method is flexible and can be used as a standalone age estimator or classifier, and we also present methods for fusion with texture-based algorithms.

[1]  H. Karcher.  Riemannian center of mass and mollifier smoothing , 1977 .

[2]  D. Kendall.  SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[3]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[4]  A.J O'Toole,et al.  3D shape and 2D surface textures of human faces: the role of "averages" in attractiveness and age , 1999, Image Vis. Comput..

[5]  K. Mardia,et al.  Projective Shape Analysis , 1999 .

[6]  Timothy F. Cootes,et al.  Toward Automatic Simulation of Aging Effects on Face Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  E. Klassen.  Bayesian, Geometric Subspace Tracking , 2002 .

[8]  K.A. Gallivan,et al.  Efficient algorithms for inferences on Grassmann manifolds , 2004, IEEE Workshop on Statistical Signal Processing, 2003.

[9]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[10]  Anuj Srivastava,et al.  Bayesian and geometric subspace tracking , 2004, Advances in Applied Probability.

[11]  C. Christodoulou,et al.  Comparing different classifiers for automatic age estimation , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Anuj Srivastava,et al.  Optimal linear representations of images for object recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Rama Chellappa,et al.  Face Verification Across Age Progression , 2006, IEEE Transactions on Image Processing.

[14]  Ashok Samal,et al.  How effective are landmarks and their geometry for face recognition? , 2006, Comput. Vis. Image Underst..

[15]  Rama Chellappa,et al.  Modeling Age Progression in Young Faces , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[16]  Wen Gao,et al.  Histogram of Gabor Phase Patterns (HGPP): A Novel Object Representation Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[17]  Shuicheng Yan,et al.  Learning Auto-Structured Regressor from Uncertain Nonnegative Labels , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  Ye Xu,et al.  Estimating Human Age by Manifold Analysis of Face Pictures and Regression on Aging Features , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[19]  Richa Singh,et al.  Age Transformation for Improving Face Recognition Performance , 2007, PReMI.

[20]  Zhi-Hua Zhou,et al.  Automatic Age Estimation Based on Facial Aging Patterns , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  M. Kirby,et al.  Set-to-Set Face Recognition Under Variations in Pose and Illumination , 2007, 2007 Biometrics Symposium.

[22]  R. Chellappa,et al.  A Non-generative Approach for Face Recognition Across Aging , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[23]  Bruce A. Draper,et al.  Image-set matching using a geodesic distance and cohort normalization , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[24]  Yun Fu,et al.  Image-Based Human Age Estimation by Manifold Learning and Locally Adjusted Robust Regression , 2008, IEEE Transactions on Image Processing.

[25]  Daniel D. Lee,et al.  Grassmann discriminant analysis: a unifying view on subspace-based learning , 2008, ICML '08.

[26]  R. Chellappa,et al.  Age progression in Human Faces : A Survey , 2008 .

[27]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[28]  D. Petrovska-Delacretaz,et al.  Automatic landmark location with a Combined Active Shape Model , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[29]  Peter H. Tu,et al.  Automatic facial landmark labeling with minimal supervision , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Zhan Yu,et al.  Facial landmark detection system using interest-region model and edge energy function , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[31]  Marios Savvides,et al.  Robust modified Active Shape Model for automatic facial landmark annotation of frontal faces , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[32]  Maurício Pamplona Segundo,et al.  Automatic Face Segmentation and Facial Landmark Detection in Range Images , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Yun Fu,et al.  Age Synthesis and Estimation via Faces: A Survey , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Rama Chellappa,et al.  The role of geometry in age estimation , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[35]  Stefano Soatto,et al.  Face Verification Across Age Progression Using Discriminative Methods , 2010, IEEE Transactions on Information Forensics and Security.

[36]  Yiying Tong,et al.  Age-Invariant Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[38]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Bruce A. Draper,et al.  An introduction to the good, the bad, & the ugly face recognition challenge problem , 2011, Face and Gesture 2011.

[40]  Lionel Prevost,et al.  Multiple kernel learning SVM and statistical validation for facial landmark detection , 2011, Face and Gesture 2011.

[41]  Rama Chellappa,et al.  Towards view-invariant expression analysis using analytic shape manifolds , 2011, Face and Gesture 2011.

[42]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[43]  Ioannis A. Kakadiaris,et al.  Facial component-landmark detection , 2011, Face and Gesture 2011.

[44]  Marios Savvides,et al.  The multifactor extension of Grassmann manifolds for face recognition , 2011, Face and Gesture 2011.

[45]  Fei Yang,et al.  Sparse shape registration for occluded facial feature localization , 2011, Face and Gesture 2011.

[46]  Shiguang Shan,et al.  Context constrained facial landmark localization based on discontinuous Haar-like feature , 2011, Face and Gesture 2011.

[47]  J. Ross Beveridge,et al.  Tangent bundle for human action recognition , 2011, Face and Gesture 2011.

[48]  Brian C. Lovell,et al.  Graph embedding discriminant analysis on Grassmannian manifolds for improved image set matching , 2011, CVPR 2011.