Fingerprint Spoof Generalization

We present a style-transfer based wrapper, called Universal Material Generator (UMG), to improve the generalization performance of any fingerprint spoof detector against spoofs made from materials not seen during training. Specifically, we transfer the style (texture) characteristics between fingerprint images of known materials with the goal of synthesizing fingerprint images corresponding to unknown materials, that may occupy the space between the known materials in the deep feature space. Synthetic live fingerprint images are also added to the training dataset to force the CNN to learn generative-noise invariant features which discriminate between lives and spoofs. The proposed approach is shown to improve the generalization performance of a state-of-the-art spoof detector, namely Fingerprint Spoof Buster, from TDR of 75.24% to 91.78% @ FDR = 0.2%. These results are based on a large-scale dataset of 5,743 live and 4,912 spoof images fabricated using 12 different materials. Additionally, the UMG wrapper is shown to improve the average cross-sensor spoof detection performance from 67.60% to 80.63% when tested on the LivDet 2017 dataset. Training the UMG wrapper requires only 100 live fingerprint images from the target sensor, alleviating the time and resources required to generate large-scale live and spoof datasets for a new sensor. We also fabricate physical spoof artifacts using a mixture of known spoof materials to explore the role of cross-material style transfer in improving generalization performance.

[1]  Chengsheng Yuan,et al.  A Novel Weber Local Binary Descriptor for Fingerprint Liveness Detection , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[2]  Dario Maio,et al.  Fake finger detection by skin distortion analysis , 2006, IEEE Transactions on Information Forensics and Security.

[3]  Anil K. Jain,et al.  RaspiReader: An Open Source Fingerprint Reader Facilitating Spoof Detection , 2017, ArXiv.

[4]  Fisher Yu,et al.  TextureGAN: Controlling Deep Image Synthesis with Texture Patches , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Gian Luca Marcialis,et al.  Review of Fingerprint Presentation Attack Detection Competitions , 2019, Handbook of Biometric Anti-Spoofing, 2nd Ed..

[6]  Shi-Min Hu,et al.  Sketch2Photo: internet image montage , 2009, ACM Trans. Graph..

[7]  Christoph Busch,et al.  Biometric Presentation Attack Detection: Beyond the Visible Spectrum , 2019, IEEE Transactions on Information Forensics and Security.

[8]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Bir Bhanu,et al.  Deep Triplet Embedding Representations for Liveness Detection , 2017 .

[10]  Anil K. Jain,et al.  Design and Fabrication of 3D Fingerprint Targets , 2016, IEEE Transactions on Information Forensics and Security.

[11]  Anil K. Jain,et al.  Gold Fingers: 3D Targets for Evaluating Capacitive Readers , 2017, IEEE Transactions on Information Forensics and Security.

[12]  Chuan Li,et al.  Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks , 2016, ECCV.

[13]  Anil K. Jain,et al.  Altered Fingerprints: Analysis and Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Dario Maio,et al.  Fake Fingerprint Detection by Odor Analysis , 2006, ICB.

[15]  Christoph Busch,et al.  Fingerprint Presentation Attack Detection Based on Local Features Encoding for Unknown Attacks , 2019, IEEE Access.

[16]  Anil K. Jain,et al.  Hacking Mobile Phones Using 2 D Printed Fingerprints , 2016 .

[17]  Anil K. Jain,et al.  End-to-End Latent Fingerprint Search , 2018, IEEE Transactions on Information Forensics and Security.

[18]  Heung-Kyu Lee,et al.  Fingerprint Spoof Detection Using Contrast Enhancement and Convolutional Neural Networks , 2017, ICISA.

[19]  Roberto de Alencar Lotufo,et al.  Fingerprint Liveness Detection Using Convolutional Neural Networks , 2016, IEEE Transactions on Information Forensics and Security.

[20]  Andrea Vedaldi,et al.  Improved Texture Networks: Maximizing Quality and Diversity in Feed-Forward Stylization and Texture Synthesis , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Arun Ross,et al.  Open Set Fingerprint Spoof Detection Across Novel Fabrication Materials , 2015, IEEE Transactions on Information Forensics and Security.

[22]  Anil K. Jain,et al.  Fingerprint spoof detection using minutiae-based local patches , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[23]  Arun Ross,et al.  An ensemble of one-class SVMs for fingerprint spoof detection across different fabrication materials , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[24]  Xin Wang,et al.  Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jiaying Liu,et al.  Demystifying Neural Style Transfer , 2017, IJCAI.

[26]  Anil K. Jain,et al.  Fingerprint Presentation Attack Detection: Generalization and Efficiency , 2018, 2019 International Conference on Biometrics (ICB).

[27]  Satoshi Hoshino,et al.  Impact of artificial "gummy" fingers on fingerprint systems , 2002, IS&T/SPIE Electronic Imaging.

[28]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[29]  Carlo Sansone,et al.  Combining perspiration- and morphology-based static features for fingerprint liveness detection , 2012, Pattern Recognit. Lett..

[30]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[31]  Jascha Kolberg,et al.  Towards Fingerprint Presentation Attack Detection Based on Convolutional Neural Networks and Short Wave Infrared Imaging , 2018, 2018 International Conference of the Biometrics Special Interest Group (BIOSIG).

[32]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[33]  Anil K. Jain,et al.  Universal 3D Wearable Fingerprint Targets: Advancing Fingerprint Reader Evaluations , 2017, IEEE Transactions on Information Forensics and Security.

[34]  Anil K. Jain,et al.  Generalizing Fingerprint Spoof Detector: Learning a One-Class Classifier , 2019, 2019 International Conference on Biometrics (ICB).

[35]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[36]  Ameeth Sharma,et al.  Optical Coherence Tomography for Fingerprint Presentation Attack Detection , 2019, Handbook of Biometric Anti-Spoofing, 2nd Ed..

[37]  Jonathon Shlens,et al.  A Learned Representation For Artistic Style , 2016, ICLR.

[38]  Gian Luca Marcialis,et al.  LivDet in Action - Fingerprint Liveness Detection Competition 2019 , 2019, 2019 International Conference on Biometrics (ICB).

[39]  Anil K. Jain,et al.  Altered Fingerprints: Detection and Localization , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[40]  Rohit Gajawada,et al.  Universal Material Translator: Towards Spoof Fingerprint Generalization , 2019, 2019 International Conference on Biometrics (ICB).

[41]  Arun Ross,et al.  A Survey on Anti-Spoofing Schemes for Fingerprint Recognition Systems , 2014 .

[42]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[43]  Gian Luca Marcialis,et al.  LivDet 2017 Fingerprint Liveness Detection Competition 2017 , 2018, 2018 International Conference on Biometrics (ICB).

[44]  Serge J. Belongie,et al.  Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[45]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[46]  Leon A. Gatys,et al.  A Neural Algorithm of Artistic Style , 2015, ArXiv.

[47]  Anil K. Jain,et al.  RaspiReader: Open Source Fingerprint Reader , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  cige Sigrist,et al.  FINGERPRINT PORE ANALYSIS FOR LIVENESS DETECTION CROSS REFERENCE TO RELATED APPLICATIONS , 2017 .

[50]  Anil K. Jain,et al.  Fingerprint Spoof Buster: Use of Minutiae-Centered Patches , 2018, IEEE Transactions on Information Forensics and Security.

[51]  Ahmed M. Elgammal,et al.  CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Norms , 2017, ICCC.

[52]  Anil K. Jain,et al.  OCT Fingerprints: Resilience to Presentation Attacks , 2019, ArXiv.