A smile can reveal your age: enabling facial dynamics in age estimation

Estimation of a person's age from the facial image has many applications, ranging from biometrics and access control to cosmetics and entertainment. Many image-based methods have been proposed for this problem. In this paper, we propose a method for the use of dynamic features in age estimation, and show that 1) the temporal dynamics of facial features can be used to improve image-based age estimation; 2) considered alone, static image-based features are more accurate than dynamic features. We have collected and annotated an extensive database of face videos from 400 subjects with an age range between 8 and 76, which allows us to extensively analyze the relevant aspects of the problem. The proposed system, which fuses facial appearance and expression dynamics, performs with a mean absolute error of 4.81 (4.87) years. This represents a significant improvement of accuracy in comparison to the sole use of appearance-based features.

[1]  P. Ekman.  Telling lies: clues to deceit in the marketplace , 1985 .

[2]  Thomas R. Alley,et al.  Social and Applied Aspects of Perceiving Faces , 2013 .

[3]  Yun Fu,et al.  Age Synthesis and Estimation via Faces: A Survey , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Albert Ali Salah,et al.  Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles , 2012, ECCV.

[5]  Bernard Tiddeman,et al.  Prototyping and Transforming Facial Textures for Perception Research , 2001, IEEE Computer Graphics and Applications.

[6]  Karen L. Schmidt,et al.  Signal characteristics of spontaneous facial expressions: automatic movement in solitary and social smiles , 2003, Biological Psychology.

[7]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[8]  Albert Ali Salah,et al.  A Statistical Method for 2-D Facial Landmarking , 2012, IEEE Transactions on Image Processing.

[9]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Massimo Tistarelli,et al.  On the Quantitative Estimation of Short-Term Aging in Human Faces , 2009, ICIAP.

[11]  Abdenour Hadid,et al.  Analyzing Facial Behavioral Features from Videos , 2011, HBU.

[12]  Rama Chellappa,et al.  Computational methods for modeling facial aging: A survey , 2009, J. Vis. Lang. Comput..

[13]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  A. Albert,et al.  A review of the literature on the aging adult skull and face: implications for forensic science research and applications. , 2007, Forensic science international.

[15]  Françoise Pottier,et al.  Aging of orbicularis oculi: anatomophysiologic consideration in upper blepharoplasty. , 2008, Archives of facial plastic surgery.

[16]  Yun Fu,et al.  Image-Based Human Age Estimation by Manifold Learning and Locally Adjusted Robust Regression , 2008, IEEE Transactions on Image Processing.

[17]  A. O'Toole,et al.  Three-Dimensional Caricatures of Human Heads: Distinctiveness and the Perception of Facial Age , 1997, Perception.

[18]  Niels da Vitoria Lobo,et al.  Age Classification from Facial Images , 1999, Comput. Vis. Image Underst..

[19]  Paul F. Velleman,et al.  Definition and Comparison of Robust Nonlinear Data Smoothing Algorithms , 1980 .

[20]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[21]  R. Sanders,et al.  Torsional elasticity of human skin in vivo , 1973, Pflügers Archiv.

[22]  Zhi-Hua Zhou,et al.  Facial age estimation by nonlinear aging pattern subspace , 2008, ACM Multimedia.

[23]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[24]  Shiguang Shan,et al.  A Compositional and Dynamic Model for Face Aging , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Wanqing Li,et al.  Age estimation based on extended non-negative matrix factorization , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[26]  Yu Zhang,et al.  Learning from facial aging patterns for automatic age estimation , 2006, MM '06.

[27]  Thomas S. Huang,et al.  Explanation-based facial motion tracking using a piecewise Bezier volume deformation model , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[28]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Timothy F. Cootes,et al.  Toward Automatic Simulation of Aging Effects on Face Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Bingbing Ni,et al.  Web Image and Video Mining Towards Universal and Robust Age Estimator , 2011, IEEE Transactions on Multimedia.

[31]  Daniel Thalmann,et al.  A dynamic wrinkle model in facial animation and skin ageing , 1995, Comput. Animat. Virtual Worlds.