Are Adaptive Face Recognition Systems still Necessary? Experiments on the APE Dataset

In the last five years, deep learning methods, in particular CNN, have attracted considerable attention in the field of face-based recognition, achieving impressive results. Despite this progress, it is not yet clear precisely to what extent deep features are able to follow all the intra-class variations that the face can present over time. In this paper we investigate the performance the performance improvement of face recognition systems by adopting self updating strategies of the face templates. For that purpose, we evaluate the performance of a well-known deep-learning face representation, namely, FaceNet, on a dataset that we generated explicitly conceived to embed intra-class variations of users on a large time span of captures: the APhotoEveryday (APE) dataset. Moreover, we compare these deep features with handcrafted features extracted using the BSIF algorithm. In both cases, we evaluate various template update strategies, in order to detect the most useful for such kind of features. Experimental results show the effectiveness of "optimized" self-update methods with respect to systems without update or random selection of templates.

[1]  Wen Gao,et al.  Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Gian Luca Marcialis,et al.  Semi-supervised PCA-Based Face Recognition Using Self-training , 2006, SSPR/SPR.

[3]  Gian Luca Marcialis,et al.  A novel classification-selection approach for the self updating of template-based face recognition systems , 2019, Pattern Recognit..

[4]  Dacheng Tao,et al.  A Comprehensive Survey on Pose-Invariant Face Recognition , 2015, ACM Trans. Intell. Syst. Technol..

[5]  Julian Fierrez,et al.  Aging in Biometrics: An Experimental Analysis on On-Line Signature , 2013, PloS one.

[6]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[7]  Hsinchun Chen,et al.  Trends and Controversies , 2011, IEEE Intelligent Systems.

[8]  Yuxiao Hu,et al.  MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition , 2016, ECCV.

[9]  Gian Luca Marcialis,et al.  A Classification-Selection Approach for Self Updating of Face Verification Systems Under Stringent Storage and Computational Requirements , 2015, ICIAP.

[10]  Esa Rahtu,et al.  BSIF: Binarized statistical image features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[11]  Anil K. Jain,et al.  IARPA Janus Benchmark-B Face Dataset , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[13]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Gian Luca Marcialis,et al.  Self adaptive systems: An experimental analysis of the performance over time , 2011, 2011 IEEE Workshop on Computational Intelligence in Biometrics and Identity Management (CIBIM).

[15]  Shengcai Liao,et al.  Learning Face Representation from Scratch , 2014, ArXiv.

[16]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[18]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Julian Fiérrez,et al.  Bayesian adaptation for user-dependent multimodal biometric authentication , 2005, Pattern Recognit..

[20]  Gian Luca Marcialis,et al.  Adaptive Biometric Systems That Can Improve with Use , 2008 .

[21]  Gian Luca Marcialis,et al.  Template Update Methods in Adaptive Biometric Systems: A Critical Review , 2009, ICB.

[22]  Omkar M. Parkhi,et al.  VGGFace2: A Dataset for Recognising Faces across Pose and Age , 2017, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[23]  Arun Ross,et al.  Biometric template selection and update: a case study in fingerprints , 2004, Pattern Recognit..

[24]  Julian Fiérrez,et al.  Quality Measures in Biometric Systems , 2012, IEEE Security & Privacy.

[25]  Julian Fiérrez,et al.  Adapted user-dependent multimodal biometric authentication exploiting general information , 2005, Pattern Recognit. Lett..

[26]  Jiwen Lu,et al.  Transform-Invariant PCA: A Unified Approach to Fully Automatic FaceAlignment, Representation, and Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Mei Wang,et al.  Deep Face Recognition: A Survey , 2018, Neurocomputing.

[28]  Gian Luca Marcialis,et al.  A multi-modal dataset, protocol and tools for adaptive biometric systems: a benchmarking study , 2013, Int. J. Biom..

[29]  Anil K. Jain,et al.  Pushing the frontiers of unconstrained face detection and recognition: IARPA Janus Benchmark A , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Julian Fierrez,et al.  Facial Soft Biometrics for Recognition in the Wild: Recent Works, Annotation, and COTS Evaluation , 2018, IEEE Transactions on Information Forensics and Security.

[31]  Julian Fierrez,et al.  EXPLORING FACIAL REGIONS IN UNCONSTRAINED SCENARIOS : EXPERIENCE ON ICB-RW , 2018 .

[32]  Julian Fiérrez,et al.  Multiple classifiers in biometrics. Part 2: Trends and challenges , 2018, Inf. Fusion.

[33]  Klemen Grm,et al.  Strengths and weaknesses of deep learning models for face recognition against image degradations , 2017, IET Biom..

[34]  Gian Luca Marcialis,et al.  An experimental investigation on self adaptive facial recognition algorithms using a long time span data set , 2018, 2018 Eighth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[35]  Julian Fierrez,et al.  Reducing the template ageing effect in on-line signature biometrics , 2019, IET Biom..

[36]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Jian Sun,et al.  Face recognition with learning-based descriptor , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Eric Granger,et al.  A dual-staged classification-selection approach for automated update of biometric templates , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[39]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[40]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.