Automated Latent Fingerprint Recognition

Latent fingerprints are one of the most important and widely used evidence in law enforcement and forensic agencies worldwide. Yet, NIST evaluations show that the performance of state-of-the-art latent recognition systems is far from satisfactory. An automated latent fingerprint recognition system with high accuracy is essential to compare latents found at crime scenes to a large collection of reference prints to generate a candidate list of possible mates. In this paper, we propose an automated latent fingerprint recognition algorithm that utilizes Convolutional Neural Networks (ConvNets) for ridge flow estimation and minutiae descriptor extraction, and extract complementary templates (two minutiae templates and one texture template) to represent the latent. The comparison scores between the latent and a reference print based on the three templates are fused to retrieve a short candidate list from the reference database. Experimental results show that the rank-1 identification accuracies (query latent is matched with its true mate in the reference database) are 64.7 percent for the NIST SD27 and 75.3 percent for the WVU latent databases, against a reference database of 100K rolled prints. These results are the best among published papers on latent recognition and competitive with the performance (66.7 and 70.8 percent rank-1 accuracies on NIST SD27 and WVU DB, respectively) of a leading COTS latent Automated Fingerprint Identification System (AFIS). By score-level (rank-level) fusion of our system with the commercial off-the-shelf (COTS) latent AFIS, the overall rank-1 identification performance can be improved from 64.7 and 75.3 to 73.3 percent (74.4 percent) and 76.6 percent (78.4 percent) on NIST SD27 and WVU latent databases, respectively.

[1]  Anil K. Jain,et al.  Longitudinal study of fingerprint recognition , 2015, Proceedings of the National Academy of Sciences.

[2]  Xiao Yang,et al.  Localized Dictionaries Based Orientation Field Estimation for Latent Fingerprints , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  R. A. Hicklin,et al.  Interexaminer variation of minutia markup on latent fingerprints. , 2016, Forensic science international.

[4]  David R. Ashbaugh,et al.  Quantitative-Qualitative Friction Ridge Analysis: An Introduction to Basic and Advanced Ridgeology , 1999 .

[5]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Julian Fiérrez,et al.  Pre-registration for Improved Latent Fingerprint Identification , 2014, 2014 22nd International Conference on Pattern Recognition.

[7]  Jie Zhou,et al.  Dense registration of fingerprints , 2017, Pattern Recognit..

[8]  Anil K. Jain,et al.  Automatic segmentation of latent fingerprints , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[9]  Davide Maltoni,et al.  Minutia Cylinder-Code: A New Representation and Matching Technique for Fingerprint Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Richa Singh,et al.  On latent fingerprint minutiae extraction using stacked denoising sparse AutoEncoders , 2014, IEEE International Joint Conference on Biometrics.

[11]  Anil K. Jain,et al.  Adaptive flow orientation-based feature extraction in fingerprint images , 1995, Pattern Recognit..

[12]  R. A. Hicklin,et al.  Understanding the sufficiency of information for latent fingerprint value determinations. , 2013, Forensic science international.

[13]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[14]  Jessica Brand,et al.  It is Now Up to the Courts: "Forensic Science in Criminal Courts: Ensuring Scientific Validity of Feature-Comparison Methods" , 2017 .

[15]  Mark R. Hawthorne Fingerprints: Analysis and Understanding , 2008 .

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Anil K. Jain,et al.  Crowd powered latent Fingerprint Identification: Fusing AFIS with examiner markups , 2015, 2015 International Conference on Biometrics (ICB).

[18]  Jean Ponce,et al.  A Tensor-Based Algorithm for High-Order Graph Matching , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Anil K. Jain,et al.  Latent Fingerprint Matching , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Manhua Liu,et al.  Latent Fingerprint Enhancement via Multi-Scale Patch Based Sparse Representation , 2015, IEEE Transactions on Information Forensics and Security.

[21]  Richa Singh,et al.  Latent Fingerprint Matching: A Survey , 2014, IEEE Access.

[22]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  R. A. Hicklin,et al.  ELFT-EFS Evaluation of Latent Fingerprint Technologies: Extended Feature Sets [Evaluation #2] , 2011 .

[24]  S. Meagher,et al.  Defining AFIS latent print "Lights-Out , 2011 .

[25]  Anil K. Jain,et al.  Latent orientation field estimation via convolutional neural network , 2015, 2015 International Conference on Biometrics (ICB).

[26]  Arun Ross,et al.  Handbook of Multibiometrics , 2006, The Kluwer international series on biometrics.

[27]  C.-C. Jay Kuo,et al.  Adaptive Directional Total-Variation Model for Latent Fingerprint Segmentation , 2013, IEEE Transactions on Information Forensics and Security.

[28]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[29]  C.-C. Jay Kuo,et al.  A robust technique for latent fingerprint image segmentation and enhancement , 2008, 2008 15th IEEE International Conference on Image Processing.

[30]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Xiang Fu,et al.  Extended clique models: A new matching strategy for fingerprint recognition , 2013, 2013 International Conference on Biometrics (ICB).

[32]  Venu Govindaraju,et al.  Fingerprint enhancement using STFT analysis , 2007, Pattern Recognit..

[33]  R. A. Hicklin,et al.  Repeatability and Reproducibility of Decisions by Latent Fingerprint Examiners , 2012, PloS one.

[34]  Michael S. Hsiao,et al.  Latent fingerprint segmentation using ridge template correlation , 2011, ICDP.

[35]  Jufu Feng,et al.  Latent fingerprint minutia extraction using fully convolutional network , 2016, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[36]  Anil K. Jain,et al.  Segmentation and Enhancement of Latent Fingerprints: A Coarse to Fine RidgeStructure Dictionary , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Jiayu Zhou,et al.  Automatic latent value determination , 2016, 2016 International Conference on Biometrics (ICB).

[38]  Anil K. Jain,et al.  Latent Fingerprint Matching Using Descriptor-Based Hough Transform , 2011, IEEE Transactions on Information Forensics and Security.

[39]  C. Barden,et al.  Proficiency Testing Trends Following the 2009 National Academy of Sciences Report, “Strengthening Forensic Science in the United States: A Path Forward” , 2016 .