Pyramid multi-level features for facial demographic estimation

The proposed approach can run in real-time applications.The use of specific hierarchical order for demographic estimation.Several public databases are used to assess the advantages of the approach.The advantages of Pyramid Multi-Level face representation. We present a novel learning system for human demographic estimation in which the ethnicity, gender and age attributes are estimated from facial images. The proposed approach consists of the following three main stages: 1) face alignment and preprocessing; 2) constructing a Pyramid Multi-Level face representation from which the local features are extracted from the blocks of the whole pyramid; 3) feeding the obtained features to an hierarchical estimator having three layers. Due to the fact that ethnicity is by far the easiest attribute to estimate, the adopted hierarchy is as follows. The first layer predicts ethnicity of the input face. Based on that prediction, the second layer estimates the gender using the corresponding gender classifier. Based on the predicted ethnicity and gender, the age is finally estimated using the corresponding regressor.Experiments are conducted on five public databases (MORPH II, PAL, IoG, LFW and FERET) and another two challenge databases (Apparent age; Smile and Gender) of the 2016 ChaLearn Looking at People and Faces of the World Challenge and Workshop. These experiments show stable and good results. We present many comparisons against state-of-the-art methods. We also provide a study about cross-database evaluation. We quantitatively measure the performance drop in age estimation and in gender classification when the ethnicity attribute is misclassified.

[1]  ShanCaifeng.  Learning local binary patterns for gender classification on real-world face images , 2012 .

[2]  Rama Chellappa,et al.  Unconstrained Age Estimation with Deep Convolutional Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[3]  Yu Qiao,et al.  Gender and Smile Classification Using Deep Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Xu Yang,et al.  Deep Age Distribution Learning for Apparent Age Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Manasa.  HUMAN AGE ESTIMATION , 2017 .

[6]  Timothy F. Cootes,et al.  Toward Automatic Simulation of Aging Effects on Face Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Guodong Guo,et al.  Joint estimation of age, gender and ethnicity: CCA vs. PLS , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[8]  Yi Pan,et al.  Future Information Technology , 2011 .

[9]  Ching Y. Suen,et al.  Contourlet appearance model for facial age estimation , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[10]  A. Gunay,et al.  Automatic age classification with LBP , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[11]  Roope Raisamo,et al.  An experimental comparison of gender classification methods , 2008, Pattern Recognit. Lett..

[12]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[13]  Jean-Luc Dugelay,et al.  Minimalistic CNN-based ensemble model for gender prediction from face images , 2016, Pattern Recognit. Lett..

[14]  Kang Ryoung Park,et al.  A comparative study of local feature extraction for age estimation , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[15]  Carlos Segura,et al.  A deep analysis on age estimation , 2015, Pattern Recognit. Lett..

[16]  Dong Cao,et al.  Human Age Estimation Using Ranking SVM , 2012, CCBR.

[17]  Matti Pietikäinen,et al.  Demographic classification from face videos using manifold learning , 2013, Neurocomputing.

[18]  Yu Zhang,et al.  Learning from facial aging patterns for automatic age estimation , 2006, MM '06.

[19]  Maher Awad,et al.  Age and gender recognition using informative features of various types , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[20]  Caifeng Shan.  Learning local features for age estimation on real-life faces , 2010, MPVA '10.

[21]  Changsheng Li,et al.  Learning ordinal discriminative features for age estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Xiaoming Liu,et al.  Demographic Estimation from Face Images: Human vs. Machine Performance , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Luc Van Gool,et al.  Structured Output SVM Prediction of Apparent Age, Gender and Smile from Deep Features , 2016, CVPR 2016.

[24]  Ieee Staff.  2007 IEEE 15th Signal Processing and Communications Applications , 2007 .

[25]  Sergio Escalera,et al.  ChaLearn Looking at People and Faces of the World: Face AnalysisWorkshop and Challenge 2016 , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[26]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Wei Wang,et al.  Pyramid-Based Multi-scale LBP Features for Face Recognition , 2011, 2011 International Conference on Multimedia and Signal Processing.

[28]  Anil K. Jain,et al.  Face Matching and Retrieval Using Soft Biometrics , 2010, IEEE Transactions on Information Forensics and Security.

[29]  Wenhao Zhang,et al.  Gender and gaze gesture recognition for human-computer interaction , 2016, Comput. Vis. Image Underst..

[30]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[31]  Ajmal S. Mian,et al.  Biologically Significant Facial Landmarks: How Significant Are They for Gender Classification? , 2013, 2013 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[32]  Kang Ryoung Park,et al.  Comparative Study of Human Age Estimation with or without Preclassification of Gender and Facial Expression , 2014, TheScientificWorldJournal.

[33]  Caifeng Shan,et al.  Learning local binary patterns for gender classification on real-world face images , 2012, Pattern Recognit. Lett..

[34]  Daniel González-Jiménez,et al.  Single- and cross- database benchmarks for gender classification under unconstrained settings , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[35]  Matti Pietikäinen,et al.  Age Classification in Unconstrained Conditions Using LBP Variants , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[36]  Jean-Luc Dugelay,et al.  Apparent Age Estimation from Face Images Combining General and Children-Specialized Deep Learning Models , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[37]  Andrew C. Gallagher,et al.  Understanding images of groups of people , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Abdelmalik Taleb-Ahmed,et al.  Facial age estimation using BSIF and LBP , 2016, ArXiv.

[39]  Thomas S. Huang,et al.  Human age estimation using bio-inspired features , 2009, CVPR.

[40]  Erol Gelenbe,et al.  Information Sciences and Systems 2015 - 30th International Symposium on Computer and Information Sciences, ISCIS 2015, London, UK, 21-24 September 2015 , 2016, ISCIS.

[41]  Niels da Vitoria Lobo,et al.  Age classification from facial images , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Roberto Paredes,et al.  Local Deep Neural Networks for gender recognition , 2016, Pattern Recognit. Lett..

[43]  Teresa Correa,et al.  Who interacts on the Web?: The intersection of users' personality and social media use , 2010, Comput. Hum. Behav..

[44]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[45]  Tal Hassner,et al.  Age and Gender Estimation of Unfiltered Faces , 2014, IEEE Transactions on Information Forensics and Security.

[46]  Zhi-Hua Zhou,et al.  Facial Age Estimation by Learning from Label Distributions , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Balasubramanian Raman,et al.  Multi-quantized local binary patterns for facial gender classification , 2016, Comput. Electr. Eng..

[48]  Guodong Guo,et al.  Simultaneous dimensionality reduction and human age estimation via kernel partial least squares regression , 2011, CVPR 2011.

[49]  Abderrahim Elmoataz,et al.  Image and Signal Processing - 3rd International Conference, ICISP 2008, Cherbourg-Octeville, France, July 1-3, 2008, Proceedings , 2008, ICISP.

[50]  Yi-Ping Hung,et al.  Ordinal hyperplanes ranker with cost sensitivities for age estimation , 2011, CVPR 2011.

[51]  Esa Rahtu,et al.  BSIF: Binarized statistical image features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[52]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[53]  Zhi-Hua Zhou,et al.  Automatic Age Estimation Based on Facial Aging Patterns , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Denise C. Park,et al.  A lifespan database of adult facial stimuli , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[55]  Tsuhan Chen,et al.  Clothing cosegmentation for recognizing people , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Stan Z. Li,et al.  Advances in Biometrics, International Conference, ICB 2007, Seoul, Korea, August 27-29, 2007, Proceedings , 2007, ICB.

[57]  Salah Eddine Bekhouche,et al.  Automatic age estimation and gender classification in the wild , 2015 .

[58]  Ze-Nian Li,et al.  Gender Recognition Using Complexity-Aware Local Features , 2014, 2014 22nd International Conference on Pattern Recognition.

[59]  Claudio A. Perez,et al.  Gender Classification Based on Fusion of Different Spatial Scale Features Selected by Mutual Information From Histogram of LBP, Intensity, and Shape , 2013, IEEE Transactions on Information Forensics and Security.

[60]  Tal Hassner,et al.  Age and gender classification using convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[61]  Tsuhan Chen,et al.  Understanding images of groups of people , 2009, CVPR.

[62]  Guodong Guo,et al.  A framework for joint estimation of age, gender and ethnicity on a large database , 2014, Image Vis. Comput..

[63]  Yun Fu,et al.  Human Age Estimation With Regression on Discriminative Aging Manifold , 2008, IEEE Transactions on Multimedia.

[64]  Anil K. Jain,et al.  Can soft biometric traits assist user recognition? , 2004, SPIE Defense + Commercial Sensing.

[65]  Abdenour Hadid,et al.  Facial age estimation and gender classification using multi level local phase quantization , 2015, 2015 3rd International Conference on Control, Engineering & Information Technology (CEIT).

[66]  Shree K. Nayar,et al.  FaceTracer: A Search Engine for Large Collections of Images with Faces , 2008, ECCV.