Anomaly Detection With Convolutional Autoencoders for Fingerprint Presentation Attack Detection

In recent years, the popularity of fingerprint-based biometric authentication systems significantly increased. However, together with many advantages, biometric systems are still vulnerable to presentation attacks (PAs). In particular, this applies for unsupervised applications, where new attacks unknown to the system operator may occur. Therefore, presentation attack detection (PAD) methods are used to determine whether samples stem from a bona fide subject or from a presentation attack instrument (PAI). In this context, most works are dedicated to solve PAD as a two-class classification problem, which includes training a model on both bona fide and PA samples. In spite of the good detection rates reported, these methods still face difficulties detecting PAIs from unknown materials. To address this issue, we propose a new PAD technique based on autoencoders (AEs) trained only on bona fide samples (i.e., one-class), which are captured in the short wave infrared domain. On the experimental evaluation over a database of 19,711 bona fide and 4,339 PA images including 45 different PAI species, a detection equal error rate (D-EER) of 2.00% was achieved. Additionally, our best performing AE model is compared to further one-class classifiers (support vector machine, Gaussian mixture model). The results show the effectiveness of the AE model as it significantly outperforms the previously proposed methods.

[1]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[2]  T. Fitzpatrick The validity and practicality of sun-reactive skin types I through VI. , 1988, Archives of dermatology.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Thomas S. Huang,et al.  One-class SVM for learning in image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[5]  Anil K. Jain,et al.  Handbook of Fingerprint Recognition , 2005, Springer Professional Computing.

[6]  Robert K. Rowe,et al.  Multispectral Fingerprint Image Acquisition , 2008 .

[7]  Klaus Püschel,et al.  Dynamic liveness and forgeries detection of the finger surface on the basis of spectroscopy in the 400-1650 nm region. , 2011, Forensic science international.

[8]  Mia Hubert,et al.  Robust statistics for outlier detection , 2011, WIREs Data Mining Knowl. Discov..

[9]  Gian Luca Marcialis,et al.  LivDet 2011 — Fingerprint liveness detection competition 2011 , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[10]  Sébastien Marcel,et al.  On the effectiveness of local binary patterns in face anti-spoofing , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[11]  Nan Li,et al.  Laser Speckle Contrast Imaging: Theory, Instrumentation and Applications , 2013, IEEE Reviews in Biomedical Engineering.

[12]  Martin Drahansky,et al.  New Optical Methods for Liveness Detection on Fingers , 2013, BioMed Research International.

[13]  Julian Fierrez,et al.  Image Quality Assessment for Fake Biometric Detection: Application to Iris, Fingerprint, and Face Recognition , 2014, IEEE Transactions on Image Processing.

[14]  Christoph Busch,et al.  Presentation attack detection methods for fingerprint recognition systems: a survey , 2014, IET Biom..

[15]  Arun Ross,et al.  A Survey on Anti-Spoofing Schemes for Fingerprint Recognition Systems , 2014 .

[16]  Douglas A. Reynolds,et al.  Gaussian Mixture Models , 2018, Encyclopedia of Biometrics.

[17]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[18]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[20]  Anil K. Jain,et al.  Face Spoof Detection With Image Distortion Analysis , 2015, IEEE Transactions on Information Forensics and Security.

[21]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[22]  Sven Meissner,et al.  Full fingerprint scanner using optical coherence tomography , 2015, 3rd International Workshop on Biometrics and Forensics (IWBF 2015).

[23]  Anne Humeau-Heurtier,et al.  Laser Speckle Imaging to Monitor Microvascular Blood Flow: A Review , 2016, IEEE Reviews in Biomedical Engineering.

[24]  Arun Ross,et al.  An ensemble of one-class SVMs for fingerprint spoof detection across different fabrication materials , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[25]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[26]  Andreas Kolb,et al.  Reliable face anti-spoofing using multispectral SWIR imaging , 2016, 2016 International Conference on Biometrics (ICB).

[27]  Sébastien Marcel,et al.  The Replay-Mobile Face Presentation-Attack Database , 2016, 2016 International Conference of the Biometrics Special Interest Group (BIOSIG).

[28]  Natasha Botha,et al.  Automated spoof-detection for fingerprints using optical coherence tomography. , 2016, Applied optics.

[29]  Qinghua Huang,et al.  Anomaly detection of Logo images in the mobile phone using convolutional autoencoder , 2017, 2017 4th International Conference on Systems and Informatics (ICSAI).

[30]  Sébastien Marcel,et al.  On Effectiveness of Anomaly Detection Approaches against Unseen Presentation Attacks in Face Anti-spoofing , 2018, 2018 International Conference on Biometrics (ICB).

[31]  Wael Abd-Almageed,et al.  Fingerprint Presentation Attack Detection Using A Novel Multi-Spectral Capture Device and Patch-Based Convolutional Neural Networks , 2018, 2018 IEEE International Workshop on Information Forensics and Security (WIFS).

[32]  Jascha Kolberg,et al.  Towards Multi-modal Finger Presentation Attack Detection , 2018, 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[33]  Jascha Kolberg,et al.  Towards Fingerprint Presentation Attack Detection Based on Convolutional Neural Networks and Short Wave Infrared Imaging , 2018, 2018 International Conference of the Biometrics Special Interest Group (BIOSIG).

[34]  Ondrej Kanich,et al.  Use of creative materials for fingerprint spoofs , 2018, 2018 International Workshop on Biometrics and Forensics (IWBF).

[35]  Jascha Kolberg,et al.  Fingerprint Presentation Attack Detection using Laser Speckle Contrast Imaging , 2018, 2018 International Conference of the Biometrics Special Interest Group (BIOSIG).

[36]  Jascha Kolberg,et al.  Towards Fingerprint Presentation Attack Detection Based on Short Wave Infrared Imaging and Spectral Signatures , 2018 .

[37]  Feng Liu,et al.  High-accurate and robust fingerprint anti-spoofing system using Optical Coherence Tomography , 2019, Expert Syst. Appl..

[38]  Ameeth Sharma,et al.  Optical Coherence Tomography for Fingerprint Presentation Attack Detection , 2019, Handbook of Biometric Anti-Spoofing, 2nd Ed..

[39]  Richa Singh,et al.  Review of Iris Presentation Attack Detection Competitions , 2019, Handbook of Biometric Anti-Spoofing, 2nd Ed..

[40]  Wael Abd-Almageed,et al.  On the Effectiveness of Laser Speckle Contrast Imaging and Deep Neural Networks for Detecting Known and Unknown Fingerprint Presentation Attacks , 2019, 2019 International Conference on Biometrics (ICB).

[41]  Gian Luca Marcialis,et al.  Review of Fingerprint Presentation Attack Detection Competitions , 2019, Handbook of Biometric Anti-Spoofing, 2nd Ed..

[42]  Sébastien Marcel,et al.  Domain Adaptation in Multi-Channel Autoencoder based Features for Robust Face Anti-Spoofing , 2019, 2019 International Conference on Biometrics (ICB).

[43]  Masaki Takanashi,et al.  Low-cost Unsupervised Outlier Detection by Autoencoders with Robust Estimation , 2019, J. Inf. Process..

[44]  Jascha Kolberg,et al.  Multi-algorithm Benchmark for Fingerprint Presentation Attack Detection with Laser Speckle Contrast Imaging , 2019, 2019 International Conference of the Biometrics Special Interest Group (BIOSIG).

[45]  Jascha Kolberg,et al.  Presentation Attack Detection for Finger Recognition , 2019, Handbook of Vascular Biometrics.

[46]  Anil K. Jain,et al.  Generalizing Fingerprint Spoof Detector: Learning a One-Class Classifier , 2019, 2019 International Conference on Biometrics (ICB).

[47]  Anil K. Jain,et al.  OCT Fingerprints: Resilience to Presentation Attacks , 2019, ArXiv.

[48]  Raja Giryes,et al.  Autoencoders , 2020, ArXiv.

[49]  Olegs Nikisins,et al.  Biometric Face Presentation Attack Detection With Multi-Channel Convolutional Neural Network , 2019, IEEE Transactions on Information Forensics and Security.

[50]  Raghavendra Ramachandra,et al.  A Survey on Unknown Presentation Attack Detection for Fingerprint , 2020, INTAP.

[51]  Christoph Busch,et al.  Biometric Presentation Attack Detection: Beyond the Visible Spectrum , 2019, IEEE Transactions on Information Forensics and Security.

[52]  Jascha Kolberg,et al.  Analysing the Performance of LSTMs and CNNs on 1310 nm Laser Data for Fingerprint Presentation Attack Detection , 2020, 2020 IEEE International Joint Conference on Biometrics (IJCB).

[53]  Christoph Busch,et al.  Multi-spectral Short-Wave Infrared Sensors and Convolutional Neural Networks for Biometric Presentation Attack Detection , 2021 .

[54]  Mohamed Hussein,et al.  Multi-Modal Fingerprint Presentation Attack Detection: Evaluation on a New Dataset , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.