A Multifeature Learning and Fusion Network for Facial Age Estimation

Age estimation from face images has attracted much attention due to its favorable and many real-world applications such as video surveillance and social networking. However, most existing studies usually learn a single kind of age feature and ignore other appearance features such as gender and race, which have a great influence on the age pattern. In this paper, we proposed a compact multifeature learning and fusion method for age estimation. Specifically, we first used three subnetworks to learn gender, race, and age information. Then, we fused these complementary features to further form more robust features for age estimation. Finally, we engineered a regression-ranking age-feature estimator to convert the fusion features into the exact age numbers. Experimental results on three benchmark databases demonstrated the effectiveness and efficiency of the proposed method on facial age estimation in comparison to previous state-of-the-art methods. Moreover, compared with previous state-of-the-art methods, our model was more compact with only a 20 MB memory overhead and is suitable for deployment on mobile or embedded devices for age estimation.

[1]  Jing Wang,et al.  Deep Learning with PCANet for Human Age Estimation , 2016, ICIC.

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Kenli Li,et al.  An Ensemble CNN2ELM for Age Estimation , 2018, IEEE Transactions on Information Forensics and Security.

[4]  Kai Li,et al.  Deep Cost-Sensitive and Order-Preserving Feature Learning for Cross-Population Age Estimation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Med Salim Bouhlel,et al.  Age estimation using deep learning , 2018, Comput. Electr. Eng..

[6]  Pi-Cheng Hsiu,et al.  SSR-Net: A Compact Soft Stagewise Regression Network for Age Estimation , 2018, IJCAI.

[7]  Haifeng Hu,et al.  Multiscale illumination normalization for face recognition using dual-tree complex wavelet transform in logarithm domain , 2011, Comput. Vis. Image Underst..

[8]  Hazim Kemal Ekenel,et al.  Multimodal Age and Gender Classification Using Ear and Profile Face Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[10]  Gang Wang,et al.  Multi-Task CNN Model for Attribute Prediction , 2015, IEEE Transactions on Multimedia.

[11]  A. Gunay,et al.  Automatic age classification with LBP , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[12]  Carlos Segura,et al.  A deep analysis on age estimation , 2015, Pattern Recognit. Lett..

[13]  Feng Gao,et al.  Face Age Classification on Consumer Images with Gabor Feature and Fuzzy LDA Method , 2009, ICB.

[14]  Hamdi Dibeklioglu,et al.  Attended End-to-End Architecture for Age Estimation From Facial Expression Videos , 2020, IEEE Transactions on Image Processing.

[15]  Moi Hoon Yap,et al.  A Comprehensive Study on Loss Functions for Cross-Factor Face Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  Xin Liu,et al.  AgeNet: Deeply Learned Regressor and Classifier for Robust Apparent Age Estimation , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[17]  Chi-Man Pun,et al.  Deep and Ordinal Ensemble Learning for Human Age Estimation From Facial Images , 2020, IEEE Transactions on Information Forensics and Security.

[18]  Tal Hassner,et al.  Age and gender classification using convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[19]  Thomas S. Huang,et al.  Human age estimation using bio-inspired features , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[21]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Guodong Guo,et al.  Efficient Group-n Encoding and Decoding for Facial Age Estimation , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Sergio Escalera,et al.  ChaLearn Looking at People 2015: Apparent Age and Cultural Event Recognition Datasets and Results , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[25]  Stan Z. Li,et al.  Age Estimation by Multi-scale Convolutional Network , 2014, ACCV.

[26]  Ming Dong,et al.  Using Ranking-CNN for Age Estimation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Yong Xu,et al.  Jointly Heterogeneous Palmprint Discriminant Feature Learning , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Xiaolong Wang,et al.  Deeply-Learned Feature for Age Estimation , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[29]  Gang Hua,et al.  Ordinal Regression with Multiple Output CNN for Age Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Zhi-Hua Zhou,et al.  Facial Age Estimation by Learning from Label Distributions , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Lin Zhang,et al.  Learning Compact Multifeature Codes for Palmprint Recognition From a Single Training Image per Palm , 2021, IEEE Transactions on Multimedia.

[32]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[33]  Jean-Luc Dugelay,et al.  Apparent Age Estimation from Face Images Combining General and Children-Specialized Deep Learning Models , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[34]  Luc Van Gool,et al.  Deep Expectation of Real and Apparent Age from a Single Image Without Facial Landmarks , 2016, International Journal of Computer Vision.

[35]  Timothy F. Cootes,et al.  Comparing Variations on the Active Appearance Model Algorithm , 2002, BMVC.

[36]  Jiwen Lu,et al.  Group-aware deep feature learning for facial age estimation , 2017, Pattern Recognit..

[37]  Timothy F. Cootes,et al.  Toward Automatic Simulation of Aging Effects on Face Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Yan Wang,et al.  Deep Differentiable Random Forests for Age Estimation , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Gerard de Melo,et al.  OOGAN: Disentangling GAN with One-Hot Sampling and Orthogonal Regularization , 2019 .

[40]  Li Liu,et al.  Quantifying Facial Age by Posterior of Age Comparisons , 2017, BMVC.

[41]  Chih-Jen Lin,et al.  A tutorial on?-support vector machines , 2005 .

[42]  Yi-Ping Hung,et al.  Illumination Compensation Using Oriented Local Histogram Equalization and its Application to Face Recognition , 2012, IEEE Transactions on Image Processing.

[43]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[44]  Xu Zhang,et al.  Multi-Stage Feature Constraints Learning for Age Estimation , 2020, IEEE Transactions on Information Forensics and Security.

[45]  Xun Xu,et al.  C3AE: Exploring the Limits of Compact Model for Age Estimation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Bernhard Schölkopf,et al.  A tutorial on v-support vector machines , 2005 .

[47]  Luc Van Gool,et al.  Anchored Regression Networks Applied to Age Estimation and Super Resolution , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[48]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.