Utilizing CNNs and transfer learning of pre-trained models for age range classification from unconstrained face images

Abstract Automatic age classification from real-world and wild face images is a challenging task and has an increasing importance due to its wide range of applications in current and future lifestyles. As a result of increasing age specific human-computer interactions, it is expected that computerized systems should be capable of estimating the age from face images and respond accordingly. Over the past decade, many research studies have been conducted on automatic age classification from face images. However, the performance of the developed age classification systems suffered due to the absence of large, comprehensive benchmarks. In this work, we propose and show that pre-trained CNNs which were trained on large benchmarks for different purposes can be retrained and fine-tuned for age range classification from unconstrained face images. Also, we propose to reduce the dimension of the output of the last convolutional layer in pre-trained CNNs to improve the performance of the designed CNNs architectures. The experimental results show significant improvements in exact and 1-off accuracies on the Adience benchmark.

[1]  Rama Chellappa,et al.  Unconstrained Age Estimation with Deep Convolutional Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[2]  Luc Van Gool,et al.  Deep Expectation of Real and Apparent Age from a Single Image Without Facial Landmarks , 2016, International Journal of Computer Vision.

[3]  Shuicheng Yan,et al.  Extracting age information from local spatially flexible patches , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Ali Ghodsi,et al.  Dimensionality Reduction A Short Tutorial , 2006 .

[5]  Hiroyasu Koshimizu,et al.  Method for estimating and modeling age and gender using facial image processing , 2001, Proceedings Seventh International Conference on Virtual Systems and Multimedia.

[6]  Ming Liu,et al.  Regression from patch-kernel , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Hiroyasu Koshimizu,et al.  Age and gender estimation from facial image processing , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[8]  A. Gunay,et al.  Automatic age classification with LBP , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[9]  Xiaoming Liu,et al.  Demographic Estimation from Face Images: Human vs. Machine Performance , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[11]  Ye Xu,et al.  Estimating Human Age by Manifold Analysis of Face Pictures and Regression on Aging Features , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[12]  M. Abdullah-Al-Wadud,et al.  Directional Age-Primitive Pattern (DAPP) for Human Age Group Recognition and Age Estimation , 2017, IEEE Transactions on Information Forensics and Security.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Thomas S. Huang,et al.  Human age estimation using bio-inspired features , 2009, CVPR.

[15]  Jian-Jiun Ding,et al.  Facial age estimation based on label-sensitive learning and age-oriented regression , 2013, Pattern Recognit..

[16]  Feng Gao,et al.  Face Age Classification on Consumer Images with Gabor Feature and Fuzzy LDA Method , 2009, ICB.

[17]  Tal Hassner,et al.  Age and gender classification using convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Chu-Song Chen,et al.  Automatic Age Estimation from Face Images via Deep Ranking , 2015, BMVC.

[19]  Stan Z. Li,et al.  Age Estimation by Multi-scale Convolutional Network , 2014, ACCV.

[20]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[21]  Zhi-Hua Zhou,et al.  Automatic Age Estimation Based on Facial Aging Patterns , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Tal Hassner,et al.  Age and Gender Estimation of Unfiltered Faces , 2014, IEEE Transactions on Information Forensics and Security.

[24]  Yun Fu,et al.  A study on automatic age estimation using a large database , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[25]  Niels da Vitoria Lobo,et al.  Age classification from facial images , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Yun Fu,et al.  Human Age Estimation With Regression on Discriminative Aging Manifold , 2008, IEEE Transactions on Multimedia.

[27]  Timothy F. Cootes,et al.  Toward Automatic Simulation of Aging Effects on Face Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Xin Liu,et al.  AgeNet: Deeply Learned Regressor and Classifier for Robust Apparent Age Estimation , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[29]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[30]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[31]  Theo Gevers,et al.  Learning-based encoding with soft assignment for age estimation under unconstrained imaging conditions , 2012, Image Vis. Comput..

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[33]  Tsuhan Chen,et al.  Understanding images of groups of people , 2009, CVPR.

[34]  Sergio Escalera,et al.  ChaLearn Looking at People 2015: Apparent Age and Cultural Event Recognition Datasets and Results , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[35]  L. Farkas Anthropometry of the head and face , 1994 .

[36]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[37]  Rama Chellappa,et al.  A cascaded convolutional neural network for age estimation of unconstrained faces , 2016, 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[38]  Yun Fu,et al.  Age Synthesis and Estimation via Faces: A Survey , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Jiwen Lu,et al.  Label-Sensitive Deep Metric Learning for Facial Age Estimation , 2018, IEEE Transactions on Information Forensics and Security.

[40]  Yu Zhang,et al.  Learning from facial aging patterns for automatic age estimation , 2006, MM '06.

[41]  Carlos D. Castillo,et al.  An All-In-One Convolutional Neural Network for Face Analysis , 2016, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[42]  Anil K. Jain,et al.  Age estimation from face images: Human vs. machine performance , 2013, 2013 International Conference on Biometrics (ICB).

[43]  Lei Zhang,et al.  Learning a lightweight deep convolutional network for joint age and gender recognition , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[44]  Lijuan Cao,et al.  A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine , 2003, Neurocomputing.

[45]  Rama Chellappa,et al.  Modeling Age Progression in Young Faces , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[46]  Hans-Peter Seidel,et al.  Prediction of Individual Non‐Linear Aging Trajectories of Faces , 2007, Comput. Graph. Forum.

[47]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[48]  Wen Gao,et al.  Design sparse features for age estimation using hierarchical face model , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[49]  Caifeng Shan Learning local features for age estimation on real-life faces , 2010, MPVA '10.

[50]  Buket D. Barkana,et al.  Age and gender classification from speech and face images by jointly fine-tuned deep neural networks , 2017, Expert Syst. Appl..