A Flatter Loss for Bias Mitigation in Cross-dataset Facial Age Estimation

The most existing studies in the facial age estimation assume training and test images are captured under similar shooting conditions. However, this is rarely valid in real-world applications, where training and test sets usually have different characteristics. In this paper, we advocate a cross-dataset protocol for age estimation benchmarking. In order to improve the cross-dataset age estimation performance, we mitigate the inherent bias caused by the learning algorithm itself. To this end, we propose a novel loss function that is more effective for neural network training. The relative smoothness of the proposed loss function is its advantage with regards to the optimisation process performed by stochastic gradient descent (SGD). Compared with existing loss functions, the lower gradient of the proposed loss function leads to the convergence of SGD to a better optimum point, and consequently a better generalisation. The cross-dataset experimental results demonstrate the superiority of the proposed method over the state-of-the-art algorithms in terms of accuracy and generalisation capability.

[1]  Shiguang Shan,et al.  Mean-Variance Loss for Deep Age Estimation from a Face , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Xin Geng,et al.  Label Distribution Learning , 2013, 2013 IEEE 13th International Conference on Data Mining Workshops.

[3]  Yi-Ping Hung,et al.  Ordinal hyperplanes ranker with cost sensitivities for age estimation , 2011, CVPR 2011.

[4]  Alister G. Burr,et al.  Exploiting Deep Learning in Limited-Fronthaul Cell-Free Massive MIMO Uplink , 2020, IEEE Journal on Selected Areas in Communications.

[5]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[6]  Changxing Ding,et al.  Soft-Ranking Label Encoding for Robust Facial Age Estimation , 2019, IEEE Access.

[7]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[8]  Alexandr A. Kalinin,et al.  Albumentations: fast and flexible image augmentations , 2018, Inf..

[9]  Josef Kittler,et al.  Distribution Cognisant Loss for Cross-Database Facial Age Estimation With Sensitivity Analysis , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jiwen Lu,et al.  Label-Sensitive Deep Metric Learning for Facial Age Estimation , 2018, IEEE Transactions on Information Forensics and Security.

[11]  Mario Vento,et al.  Age from Faces in the Deep Learning Revolution , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Thomas S. Huang,et al.  Human age estimation using bio-inspired features , 2009, CVPR.

[13]  Yueting Zhuang,et al.  Data-Dependent Label Distribution Learning for Age Estimation , 2017, IEEE Transactions on Image Processing.

[14]  Guodong Guo,et al.  Efficient Group-n Encoding and Decoding for Facial Age Estimation , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Timothy F. Cootes,et al.  Overview of research on facial ageing using the FG-NET ageing database , 2016, IET Biom..

[16]  Zhi-Hua Zhou,et al.  Facial Age Estimation by Learning from Label Distributions , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Chi-Ho Chan,et al.  Resolution Invariant Face Recognition Using a Distillation Approach , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[18]  Yang Song,et al.  Age Progression/Regression by Conditional Adversarial Autoencoder , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jianxin Wu,et al.  Deep Label Distribution Learning With Label Ambiguity , 2016, IEEE Transactions on Image Processing.

[20]  Josef Kittler,et al.  Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Sung-Hyuk Cha Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions , 2007 .

[22]  Shie Mannor,et al.  Robustness and generalization , 2010, Machine Learning.

[23]  Mislav Grgic,et al.  SCface – surveillance cameras face database , 2011, Multimedia Tools and Applications.

[24]  Bertrand Granado,et al.  Image error concealment based on joint sparse representation and non-local similarity , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[25]  Ming Dong,et al.  Using Ranking-CNN for Age Estimation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Xiaoming Liu,et al.  Demographic Estimation from Face Images: Human vs. Machine Performance , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Luc Van Gool,et al.  Deep Expectation of Real and Apparent Age from a Single Image Without Facial Landmarks , 2016, International Journal of Computer Vision.

[28]  Maria Trocan,et al.  Image error concealment using sparse representations over a trained dictionary , 2016, 2016 Picture Coding Symposium (PCS).

[29]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[30]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[31]  Youngwook Kee,et al.  Towards Flatter Loss Surface via Nonmonotonic Learning Rate Scheduling , 2018, UAI.

[32]  Fernando De la Torre,et al.  Soft-Margin Mixture of Regressions , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Bo Wang,et al.  Deep Regression Forests for Age Estimation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  Stefanos Zafeiriou,et al.  AgeDB: The First Manually Collected, In-the-Wild Age Database , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Alister G. Burr,et al.  Deep Learning-Aided Finite-Capacity Fronthaul Cell-Free Massive MIMO with Zero Forcing , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[36]  Natalie C. Ebner,et al.  FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation , 2010, Behavior research methods.

[37]  Kai Zhao,et al.  Label Distribution Learning Forests , 2017, NIPS.

[38]  Josef Kittler,et al.  A Stacking Ensemble for Anomaly Based Client-Specific Face Spoofing Detection , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[39]  Jianxin Wu,et al.  Age Estimation Using Expectation of Label Distribution Learning , 2018, IJCAI.

[40]  Maria Trocan,et al.  Joint-domain dictionary learning-based error concealment using common space mapping , 2017, 2017 22nd International Conference on Digital Signal Processing (DSP).

[41]  Josef Kittler,et al.  Sensitivity of Age Estimation Systems to Demographic Factors and Image Quality: Achievements and Challenges , 2020, 2020 IEEE International Joint Conference on Biometrics (IJCB).

[42]  Dong Xu,et al.  Recent Advances in Transfer Learning for Cross-Dataset Visual Recognition , 2017, ACM Comput. Surv..

[43]  Tal Hassner,et al.  Age and Gender Estimation of Unfiltered Faces , 2014, IEEE Transactions on Information Forensics and Security.

[44]  Bertrand Granado,et al.  Joint Sparse Learning With Nonlocal and Local Image Priors for Image Error Concealment , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[45]  Miao Sun,et al.  Age Group and Gender Estimation in the Wild With Deep RoR Architecture , 2017, IEEE Access.

[46]  Jules-Raymond Tapamo,et al.  Age estimation via face images: a survey , 2018, EURASIP Journal on Image and Video Processing.