Universal Material Translator: Towards Spoof Fingerprint Generalization

Spoof detectors are classifiers that are trained to distinguish spoof fingerprints from bonafide ones. However, state of the art spoof detectors do not generalize well on unseen spoof materials. This study proposes a style transfer based augmentation wrapper that can be used on any existing spoof detector and can dynamically improve the robustness of the spoof detection system on spoof materials for which we have very low data. Our method is an approach for synthesizing new spoof images from a few spoof examples that transfers the style or material properties of the spoof examples to the content of bonafide fingerprints to generate a larger number of examples to train the classifier on. We demonstrate the effectiveness of our approach on materials in the publicly available LivDet 2015 dataset and show that the proposed approach leads to robustness to fingerprint spoofs of the target material.

[1]  Serge J. Belongie,et al.  Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Carlo Sansone,et al.  On the Robustness of Fingerprint Liveness Detection Algorithms against New Materials used for Spoofing , 2017, BIOSIGNALS.

[3]  Andrea Vedaldi,et al.  Texture Networks: Feed-forward Synthesis of Textures and Stylized Images , 2016, ICML.

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Anil K. Jain,et al.  Fingerprint Spoof Buster: Use of Minutiae-Centered Patches , 2018, IEEE Transactions on Information Forensics and Security.

[6]  Gian Luca Marcialis,et al.  Analysis of Fingerprint Pores for Vitality Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[7]  Gian Luca Marcialis,et al.  LivDet 2015 fingerprint liveness detection competition 2015 , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[8]  Anil K. Jain,et al.  Robust Minutiae Extractor: Integrating Deep Networks and Fingerprint Domain Knowledge , 2017, 2018 International Conference on Biometrics (ICB).

[9]  Dario Maio,et al.  Fake Fingerprint Detection by Odor Analysis , 2006, ICB.

[10]  Gian Luca Marcialis,et al.  Review of the Fingerprint Liveness Detection (LivDet) competition series: 2009 to 2015 , 2016, Image Vis. Comput..

[11]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Ahmed M. Elgammal,et al.  CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Norms , 2017, ICCC.

[13]  Arun Ross,et al.  MasterPrint: Exploring the Vulnerability of Partial Fingerprint-Based Authentication Systems , 2017, IEEE Transactions on Information Forensics and Security.

[14]  Gian Luca Marcialis,et al.  Fingerprint liveness detection by local phase quantization , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[15]  Arun Ross,et al.  An ensemble of one-class SVMs for fingerprint spoof detection across different fabrication materials , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[16]  Bir Bhanu,et al.  Deep Triplet Embedding Representations for Liveness Detection , 2017 .

[17]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[18]  Anil K. Jain,et al.  Fingerprint Presentation Attack Detection: Generalization and Efficiency , 2018, 2019 International Conference on Biometrics (ICB).

[19]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[20]  Jiaying Liu,et al.  Demystifying Neural Style Transfer , 2017, IJCAI.

[21]  Roberto de Alencar Lotufo,et al.  Fingerprint Liveness Detection Using Convolutional Neural Networks , 2016, IEEE Transactions on Information Forensics and Security.

[22]  Abdenour Hadid,et al.  Fingerprint Liveness Detection using Binarized Statistical Image Features , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[23]  Shi-Min Hu,et al.  Sketch2Photo: internet image montage , 2009, ACM Trans. Graph..

[24]  Jonathon Shlens,et al.  A Learned Representation For Artistic Style , 2016, ICLR.

[25]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Andrea Vedaldi,et al.  Improved Texture Networks: Maximizing Quality and Diversity in Feed-Forward Stylization and Texture Synthesis , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Arun Ross,et al.  Open Set Fingerprint Spoof Detection Across Novel Fabrication Materials , 2015, IEEE Transactions on Information Forensics and Security.

[28]  Leon A. Gatys,et al.  Texture Synthesis Using Convolutional Neural Networks , 2015, NIPS.

[29]  Xin Wang,et al.  Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Chuan Li,et al.  Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks , 2016, ECCV.

[31]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[32]  Carlo Sansone,et al.  Combining perspiration- and morphology-based static features for fingerprint liveness detection , 2012, Pattern Recognit. Lett..

[33]  Leon A. Gatys,et al.  A Neural Algorithm of Artistic Style , 2015, ArXiv.

[34]  Anil K. Jain,et al.  RaspiReader: Open Source Fingerprint Reader , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Fisher Yu,et al.  TextureGAN: Controlling Deep Image Synthesis with Texture Patches , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.