Learning a Fixed-Length Fingerprint Representation

We present DeepPrint, a deep network, which learns to extract fixed-length fingerprint representations of only 200 bytes. DeepPrint incorporates fingerprint domain knowledge, including alignment and minutiae detection, into the deep network architecture to maximize the discriminative power of its representation. The compact, DeepPrint representation has several advantages over the prevailing variable length minutiae representation which (i) requires computationally expensive graph matching techniques, (ii) is difficult to secure using strong encryption schemes (e.g. homomorphic encryption), and (iii) has low discriminative power in poor quality fingerprints where minutiae extraction is unreliable. We benchmark DeepPrint against two top performing COTS SDKs (Verifinger and Innovatrics) from the NIST and FVC evaluations. Coupled with a re-ranking scheme, the DeepPrint rank-1 search accuracy on the NIST SD4 dataset against a gallery of 1.1 million fingerprints is comparable to the top COTS matcher, but it is significantly faster (DeepPrint: 98.80% in 0.3 seconds vs. COTS A: 98.85% in 27 seconds). To the best of our knowledge, the DeepPrint representation is the most compact and discriminative fixed-length fingerprint representation reported in the academic literature.

[1]  Nalini K. Ratha,et al.  Anonymous and Revocable Fingerprint Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Jianjiang Feng,et al.  Fingerprint indexing with pose constraint , 2016, Pattern Recognit..

[3]  Christoph Busch,et al.  Deep expectation for estimation of fingerprint orientation fields , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[4]  Vincenzo Piuri,et al.  A privacy-compliant fingerprint recognition system based on homomorphic encryption and Fingercode templates , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[5]  Anil K. Jain,et al.  FVC2004: Third Fingerprint Verification Competition , 2004, ICBA.

[6]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[7]  Shengcai Liao,et al.  Learning Face Representation from Scratch , 2014, ArXiv.

[8]  Yuhang Liu,et al.  Learning Global Fingerprint Features by Training a Fully Convolutional Network with Local Patches , 2019, 2019 International Conference on Biometrics (ICB).

[9]  Anil K. Jain,et al.  Biometric Template Security , 2008, EURASIP J. Adv. Signal Process..

[10]  Cordelia Schmid,et al.  Product Quantization for Nearest Neighbor Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Anthony Vetro,et al.  Privacy and security of features extracted from minutiae aggregates , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Bir Bhanu,et al.  Fingerprint Indexing Based on Novel Features of Minutiae Triplets , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Anil K. Jain,et al.  Robust Minutiae Extractor: Integrating Deep Networks and Fingerprint Domain Knowledge , 2017, 2018 International Conference on Biometrics (ICB).

[14]  Sharath Pankanti,et al.  Fuzzy Vault for Fingerprints , 2005, AVBPA.

[15]  Bir Bhanu,et al.  Latent Fingerprint Image Segmentation Using Deep Neural Network , 2017 .

[16]  Manhua Liu,et al.  Invariant representation of orientation fields for fingerprint indexing , 2012, Pattern Recognit..

[17]  K. Srinathan,et al.  Efficient Biometric Verification in Encrypted Domain , 2009, ICB.

[18]  Raymond N. J. Veldhuis,et al.  Fingerprint Verification Using Spectral Minutiae Representations , 2009, IEEE Transactions on Information Forensics and Security.

[19]  Anil K. Jain,et al.  Longitudinal study of fingerprint recognition , 2015, Proceedings of the National Academy of Sciences.

[20]  Xudong Jiang,et al.  Fingerprint Retrieval for Identification , 2006, IEEE Transactions on Information Forensics and Security.

[21]  Anil K. Jain,et al.  Automated Latent Fingerprint Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Jiankun Hu,et al.  Latent fingerprint segmentation based on convolutional neural networks , 2017, 2017 IEEE Workshop on Information Forensics and Security (WIFS).

[23]  Anil K. Jain,et al.  Automatic Latent Fingerprint Segmentation , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[24]  Bernadette Dorizzi,et al.  Fingerprint and On-Line Signature Verification Competitions at ICB 2009 , 2009, ICB.

[25]  Feng Liu,et al.  Fingerprint Segmentation via Convolutional Neural Networks , 2017, CCBR.

[26]  Davide Maltoni,et al.  Minutia Cylinder-Code: A New Representation and Matching Technique for Fingerprint Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Husrev T. Sencar,et al.  A geometric transformation to protect minutiae-based fingerprint templates , 2007, SPIE Defense + Commercial Sensing.

[28]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[29]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[30]  Anil K. Jain,et al.  Face Search at Scale , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Zhe Jin,et al.  Generating Fixed-Length Representation From Minutiae Using Kernel Methods for Fingerprint Authentication , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  Yuhang Liu,et al.  FingerNet: An unified deep network for fingerprint minutiae extraction , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[33]  Karthik Nandakumar,et al.  A fingerprint cryptosystem based on minutiae phase spectrum , 2010, 2010 IEEE International Workshop on Information Forensics and Security.

[34]  K. Srinathan,et al.  Blind Authentication: A Secure Crypto-Biometric Verification Protocol , 2010, IEEE Transactions on Information Forensics and Security.

[35]  Eryun Liu,et al.  Random local region descriptor (RLRD): A new method for fixed-length feature representation of fingerprint image and its application to template protection , 2012, Future Gener. Comput. Syst..

[36]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Frederik Vercauteren,et al.  Somewhat Practical Fully Homomorphic Encryption , 2012, IACR Cryptol. ePrint Arch..

[38]  Vishnu Naresh Boddeti Secure Face Matching Using Fully Homomorphic Encryption , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[39]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[40]  Yang Liu,et al.  A Novel System for Fingerprint Orientation Estimation , 2018, IGTA.

[41]  Davide Maltoni,et al.  Fingerprint Indexing Based on Minutia Cylinder-Code , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Sharath Pankanti,et al.  Filterbank-based fingerprint matching , 2000, IEEE Trans. Image Process..

[43]  Sharath Pankanti,et al.  FingerCode: a filterbank for fingerprint representation and matching , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[44]  Anil K. Jain,et al.  Latent orientation field estimation via convolutional neural network , 2015, 2015 International Conference on Biometrics (ICB).

[45]  Stark C. Draper,et al.  Feature extraction for a Slepian-Wolf biometric system using LDPC codes , 2008, 2008 IEEE International Symposium on Information Theory.

[46]  Xi Yin,et al.  Multi-Task Convolutional Neural Network for Pose-Invariant Face Recognition. , 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[47]  Julien Bringer,et al.  Binary feature vector fingerprint representation from minutiae vicinities , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[48]  Jufu Feng,et al.  Fingerprint indexing based on pyramid deep convolutional feature , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[49]  Anil K. Jain,et al.  Fingerprint indexing and matching: An integrated approach , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[50]  Benjamin Rosman,et al.  Fingerprint minutiae extraction using deep learning , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[51]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[52]  Jufu Feng,et al.  Aggregating minutia-centred deep convolutional features for fingerprint indexing , 2019, Pattern Recognit..

[53]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Craig I. Watson,et al.  Fingerprint Vendor Technology Evaluation , 2014 .

[55]  Anil K. Jain,et al.  End-to-End Latent Fingerprint Search , 2018, IEEE Transactions on Information Forensics and Security.