Human Age Estimation and Sex Classification

Collecting demographic information from the customers, such as age and sex, is very important for marketing and customer group analysis. For instance, the marketing study has an interest to know how many people visited a shopping mall, and what is the distribution of the customers, such as how many males and females; how many young, adult, and senior people. Instead of hiring human workers to observe the customers, a computational system might be developed to analyze people who appeared in images and videos captured by cameras installed in a shopping mall, and then gather the demographic information. To develop a real system for age estimation and sex classification, many essential issues have to be addressed. In this chapter, a detailed introduction of the computational approaches to human age estimation and sex classification will be given. Various methods for feature extraction and learning will be described. Major challenges and future research directions will also be discussed. The goal is to inspire new research and encourage deeper investigation towards developing a working system for business intelligence.

[1]  Guodong Guo,et al.  Human age estimation: What is the influence across race and gender? , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[2]  Haizhou Ai,et al.  Demographic Classification with Local Binary Patterns , 2007, ICB.

[3]  Hiroyasu Koshimizu,et al.  Method for estimating and modeling age and gender using facial image processing , 2001, Proceedings Seventh International Conference on Virtual Systems and Multimedia.

[4]  Bingbing Ni,et al.  Web image mining towards universal age estimator , 2009, ACM Multimedia.

[5]  Alfred C. Weaver,et al.  Biometric authentication , 2006, Computer.

[6]  Xun Xu,et al.  SODA-Boosting and Its Application to Gender Recognition , 2007, AMFG.

[7]  Kaare Christensen,et al.  Perceived age as clinically useful biomarker of ageing: cohort study , 2009, BMJ : British Medical Journal.

[8]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[9]  David G. Lowe,et al.  University of British Columbia. , 1945, Canadian Medical Association journal.

[10]  Yun Fu,et al.  Gender recognition from body , 2008, ACM Multimedia.

[11]  Matti Pietikäinen,et al.  Face Recognition with Local Binary Patterns , 2004, ECCV.

[12]  Yun Fu,et al.  Human Age Estimation With Regression on Discriminative Aging Manifold , 2008, IEEE Transactions on Multimedia.

[13]  Ye Xu,et al.  Estimating Human Age by Manifold Analysis of Face Pictures and Regression on Aging Features , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[14]  C. Christodoulou,et al.  Comparing different classifiers for automatic age estimation , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Ching Y. Suen,et al.  Age estimation using Active Appearance Models and Support Vector Machine regression , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[16]  Rama Chellappa,et al.  Face Verification Across Age Progression , 2006, IEEE Trans. Image Process..

[17]  Shuicheng Yan,et al.  Learning Auto-Structured Regressor from Uncertain Nonnegative Labels , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  Nicholas Costen,et al.  Sparse models for gender classification , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[19]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[20]  Yun Fu,et al.  Age Synthesis and Estimation via Faces: A Survey , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  So Kanazawa,et al.  Judgment of Gender through Facial Parts , 1995, Perception.

[22]  Heather A. Wild,et al.  Recognition and sex categorization of adults' and children's faces: examining performance in the absence of sex-stereotyped cues. , 2000, Journal of experimental child psychology.

[23]  Hongyuan Zha,et al.  Learning distance metric for regression by semidefinite programming with application to human age estimation , 2009, ACM Multimedia.

[24]  A. M. Burton,et al.  Sex Discrimination: How Do We Tell the Difference between Male and Female Faces? , 1993, Perception.

[25]  Thomas E. Johnson,et al.  Recent results: Biomarkers of aging , 2006, Experimental Gerontology.

[26]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[27]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Amit Jain,et al.  Integrating independent components and linear discriminant analysis for gender classification , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[29]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[30]  Shiguang Shan,et al.  A Compositional and Dynamic Model for Face Aging , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[32]  Rama Chellappa,et al.  Face Recognition by Computers and Humans , 2010, Computer.

[33]  Bao-Liang Lu,et al.  Multi-view Gender Classification Using Hierarchical Classifiers Structure , 2010, ICONIP.

[34]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[35]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[36]  Shuicheng Yan,et al.  Extracting age information from local spatially flexible patches , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[37]  Matthew G. Rhodes,et al.  Age estimation of faces: a review† , 2009 .

[38]  Ming Liu,et al.  Regression from patch-kernel , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Tetsunori Kobayashi,et al.  Subspace-based age-group classification using facial images under various lighting conditions , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[41]  Sushil J. Louis,et al.  Genetic feature subset selection for gender classification: a comparison study , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[42]  Guodong Guo,et al.  Gender from Body: A Biologically-Inspired Approach with Manifold Learning , 2009, ACCV.

[43]  Feng Gao,et al.  Face Age Classification on Consumer Images with Gabor Feature and Fuzzy LDA Method , 2009, ICB.

[44]  Shuicheng Yan,et al.  Ranking with Uncertain Labels , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[45]  Yun Fu,et al.  A Probabilistic Fusion Approach to human age prediction , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[46]  Rama Chellappa,et al.  Computational methods for modeling facial aging: A survey , 2009, J. Vis. Lang. Comput..

[47]  Tsuhan Chen,et al.  Understanding images of groups of people , 2009, CVPR.

[48]  Terrence J. Sejnowski,et al.  SEXNET: A Neural Network Identifies Sex From Human Faces , 1990, NIPS.

[49]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[50]  Paul A. Viola,et al.  A unified learning framework for real time face detection and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[51]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[52]  Niels da Vitoria Lobo,et al.  Age Classification from Facial Images , 1999, Comput. Vis. Image Underst..

[53]  Rama Chellappa,et al.  Recent advances in age and height estimation from still images and video , 2011, Face and Gesture 2011.

[54]  Timothy F. Cootes,et al.  Toward Automatic Simulation of Aging Effects on Face Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Wei Gao,et al.  Face Gender Classification on Consumer Images in a Multiethnic Environment , 2009, ICB.

[56]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[58]  Torben A. Kruse,et al.  Design and analysis in genetic studies of human ageing and longevity , 2006, Ageing Research Reviews.

[59]  Roope Raisamo,et al.  Evaluation of Gender Classification Methods with Automatically Detected and Aligned Faces , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[61]  Asuman Gunay,et al.  Automatic Detection of Anthropometric Features from Facial Images , 2007, 2007 IEEE 15th Signal Processing and Communications Applications.

[62]  Thomas S. Huang,et al.  Human age estimation using bio-inspired features , 2009, CVPR.

[63]  Rama Chellappa,et al.  Modeling Age Progression in Young Faces , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[64]  Hongbin Zha,et al.  Computer Vision - ACCV 2009, 9th Asian Conference on Computer Vision, Xi'an, China, September 23-27, 2009, Revised Selected Papers, Part III , 2010, Asian Conference on Computer Vision.

[65]  Cuixian Chen,et al.  Feature selection for improved automatic gender classification , 2011, 2011 IEEE Workshop on Computational Intelligence in Biometrics and Identity Management (CIBIM).

[66]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[67]  Caifeng Shan.  Learning local features for age estimation on real-life faces , 2010, MPVA '10.

[68]  Bjarne K. Ersbøll,et al.  FAME-a flexible appearance modeling environment , 2003, IEEE Transactions on Medical Imaging.

[69]  Felix A. Wichmann,et al.  Gender Classification of Human Faces , 2002, Biologically Motivated Computer Vision.

[70]  Jiawei Han,et al.  Semi-supervised Discriminant Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[71]  Thomas S. Huang,et al.  Soft biometrics for video surveillance , 2009 .

[72]  Ming-Hsuan Yang,et al.  Learning Gender with Support Faces , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[73]  Guodong Guo,et al.  Cross-Age Face Recognition on a Very Large Database: The Performance versus Age Intervals and Improvement Using Soft Biometric Traits , 2010, 2010 20th International Conference on Pattern Recognition.

[74]  A. Gunay,et al.  Automatic age classification with LBP , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[75]  Hiroshi Nagahashi,et al.  Classification of Age Group Based on Facial Images of Young Males by Using Neural Networks , 2001 .

[76]  Thomas Serre,et al.  Object recognition with features inspired by visual cortex , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[77]  Yun Fu,et al.  Is gender recognition affected by age? , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[78]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[79]  Y. Mitsukura,et al.  Apparent age estimation system based on age perception , 2007, SICE Annual Conference 2007.

[80]  Yun Fu,et al.  Image-Based Human Age Estimation by Manifold Learning and Locally Adjusted Robust Regression , 2008, IEEE Transactions on Image Processing.

[81]  Cuixian Chen,et al.  Face age estimation using model selection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[82]  J. Vaupel,et al.  Ageing populations: the challenges ahead , 2009, The Lancet.

[83]  Yunqian Ma,et al.  Intelligent Video Surveillance : Systems and Technology , 2009 .

[84]  Caifeng Shan,et al.  Gender Classification on Real-Life Faces , 2010, ACIVS.

[85]  Jiří Matas,et al.  Computer Vision - ECCV 2004 , 2004, Lecture Notes in Computer Science.

[86]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[87]  Zhi-Hua Zhou,et al.  Automatic Age Estimation Based on Facial Aging Patterns , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[88]  Kaare Christensen,et al.  The quest for genetic determinants of human longevity: challenges and insights , 2006, Nature Reviews Genetics.

[89]  L. Farkas.  Anthropometry of the head and face , 1994 .

[90]  G. Isac.  Models and applications , 1992 .

[91]  Cuixian Chen,et al.  Gender classification from infants to seniors , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[92]  Hong Chen,et al.  A Hierarchical Compositional Model for Face Representation and Sketching , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[93]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[94]  Shumeet Baluja,et al.  Boosting Sex Identification Performance , 2005, International Journal of Computer Vision.

[95]  Shaogang Gong,et al.  Fusing gait and face cues for human gender recognition , 2008, Neurocomputing.

[96]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[97]  Yu Zhang,et al.  Learning from facial aging patterns for automatic age estimation , 2006, MM '06.

[98]  Yun Fu,et al.  Locally Adjusted Robust Regression for Human Age Estimation , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[99]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[100]  Matthew Toews,et al.  Detection, Localization, and Sex Classification of Faces from Arbitrary Viewpoints and under Occlusion , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[101]  Yiying Tong,et al.  Face recognition with temporal invariance: A 3D aging model , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[102]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[103]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[104]  Guodong Guo,et al.  Simultaneous dimensionality reduction and human age estimation via kernel partial least squares regression , 2011, CVPR 2011.

[105]  H. Ai,et al.  LUT-Based Adaboost for Gender Classification , 2003, AVBPA.