End-to-End Latent Fingerprint Search

Latent fingerprints are one of the most important and widely used sources of evidence in law enforcement and forensic agencies. Yet the performance of the state-of-the-art latent recognition systems is far from satisfactory, and they often require manual markups to boost the latent search performance. Further, the COTS systems are proprietary and do not output the true comparison scores between a latent and reference prints to conduct quantitative evidential analysis. We present an end-to-end latent fingerprint search system, including automated region of interest (ROI) cropping, latent image preprocessing, feature extraction, feature comparison, and outputs a candidate list. Two separate minutiae extraction models provide complementary minutiae templates. To compensate for the small number of minutiae in small ridge area and poor quality latents, a virtual minutiae set is generated to construct a texture template. A 96-dimensional descriptor is extracted for each minutia from its neighborhood. For computational efficiency, the descriptor length for virtual minutiae is further reduced to 16 using product quantization. Our end-to-end system is evaluated on four latent databases: NIST SD27 (258 latents); MSP (1200 latents), WVU (449 latents), and N2N (10 000 latents) against a background set of 100K rolled prints, which includes the true rolled mates of the latents with rank-1 retrieval rates of 65.7%, 69.4%, 65.5%, and 7.6%, respectively. A multi-core solution implemented on 24 cores obtains 1-ms per latent to rolled comparison.

[1]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Julian Fiérrez,et al.  Pre-registration of latent fingerprints based on orientation field , 2015, IET Biom..

[3]  R. A. Hicklin,et al.  Repeatability and Reproducibility of Decisions by Latent Fingerprint Examiners , 2012, PloS one.

[4]  Vishnu Naresh Boddeti,et al.  On the Intrinsic Dimensionality of Face Representation , 2018, ArXiv.

[5]  Jian Li,et al.  Deep convolutional neural network for latent fingerprint enhancement , 2018, Signal Process. Image Commun..

[6]  Anil K. Jain,et al.  Longitudinal study of fingerprint recognition , 2015, Proceedings of the National Academy of Sciences.

[7]  Xiao Yang,et al.  Localized Dictionaries Based Orientation Field Estimation for Latent Fingerprints , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Davide Maltoni,et al.  Minutia Cylinder-Code: A New Representation and Matching Technique for Fingerprint Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Josef Bigün,et al.  Frequency Map by Structure Tensor in Logarithmic Scale Space and Forensic Fingerprints , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[10]  Venu Govindaraju,et al.  Fingerprint enhancement using STFT analysis , 2007, Pattern Recognit..

[11]  Anil K. Jain,et al.  On matching latent fingerprints , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Christoph Busch,et al.  Towards NFIQ II Lite :: self-organizing maps for fingerprint image quality assessment , 2013 .

[13]  Anil K. Jain,et al.  Automatic segmentation of latent fingerprints , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[14]  Jessica Brand,et al.  It is Now Up to the Courts: "Forensic Science in Criminal Courts: Ensuring Scientific Validity of Feature-Comparison Methods" , 2017 .

[15]  Anil K. Jain,et al.  Latent Fingerprint Matching , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yuhang Liu,et al.  FingerNet: An unified deep network for fingerprint minutiae extraction , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[17]  Anil K. Jain,et al.  Segmentation and Enhancement of Latent Fingerprints: A Coarse to Fine RidgeStructure Dictionary , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Jiayu Zhou,et al.  Automatic latent value determination , 2016, 2016 International Conference on Biometrics (ICB).

[19]  Francesco Visin,et al.  A guide to convolution arithmetic for deep learning , 2016, ArXiv.

[20]  Benjamin Rosman,et al.  Fingerprint minutiae extraction using deep learning , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[21]  Anxiao Jiang,et al.  U-Finger: Multi-Scale Dilated Convolutional Network for Fingerprint Image Denoising and Inpainting , 2018, Inpainting and Denoising Challenges.

[22]  Anil K. Jain,et al.  Handbook of Fingerprint Recognition , 2005, Springer Professional Computing.

[23]  C. Barden,et al.  Proficiency Testing Trends Following the 2009 National Academy of Sciences Report, “Strengthening Forensic Science in the United States: A Path Forward” , 2016 .

[24]  Craig I. Watson,et al.  Fingerprint Vendor Technology Evaluation , 2014 .

[25]  Richa Singh,et al.  Latent Fingerprint Enhancement Using Generative Adversarial Networks , 2019, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[26]  Anil K. Jain,et al.  Automated Latent Fingerprint Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  C.-C. Jay Kuo,et al.  Adaptive Directional Total-Variation Model for Latent Fingerprint Segmentation , 2013, IEEE Transactions on Information Forensics and Security.

[28]  Anil K. Jain,et al.  Latent Fingerprint Recognition: Role of Texture Template , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[29]  Vishnu Naresh Boddeti,et al.  On the Intrinsic Dimensionality of Image Representations , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  R. A. Hicklin,et al.  ELFT-EFS Evaluation of Latent Fingerprint Technologies: Extended Feature Sets [Evaluation #2] , 2011 .

[31]  Josef Bigün,et al.  SAFE features for matching fingermarks by neighbourhoods of single minutiae , 2014, 2014 14th International Symposium on Communications and Information Technologies (ISCIT).

[32]  Jianjiang Feng,et al.  Combining minutiae descriptors for fingerprint matching , 2008, Pattern Recognit..

[33]  Anil K. Jain,et al.  Automatic Latent Fingerprint Segmentation , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[34]  Anil K. Jain,et al.  Latent orientation field estimation via convolutional neural network , 2015, 2015 International Conference on Biometrics (ICB).

[35]  Seyed-Mohsen Moosavi-Dezfooli,et al.  DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Anil K. Jain,et al.  FM Model Based Fingerprint Reconstruction from Minutiae Template , 2009, ICB.

[37]  Jufu Feng,et al.  Latent fingerprint minutia extraction using fully convolutional network , 2016, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[38]  Anil K. Jain,et al.  Robust Minutiae Extractor: Integrating Deep Networks and Fingerprint Domain Knowledge , 2017, 2018 International Conference on Biometrics (ICB).

[39]  Anil K. Jain,et al.  Orientation Field Estimation for Latent Fingerprint Enhancement , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.