Segmentation and Enhancement of Latent Fingerprints: A Coarse to Fine RidgeStructure Dictionary

Latent fingerprint matching has played a critical role in identifying suspects and criminals. However, compared to rolled and plain fingerprint matching, latent identification accuracy is significantly lower due to complex background noise, poor ridge quality and overlapping structured noise in latent images. Accordingly, manual markup of various features (e.g., region of interest, singular points and minutiae) is typically necessary to extract reliable features from latents. To reduce this markup cost and to improve the consistency in feature markup, fully automatic and highly accurate (“lights-out” capability) latent matching algorithms are needed. In this paper, a dictionary-based approach is proposed for automatic latent segmentation and enhancement towards the goal of achieving “lights-out” latent identification systems. Given a latent fingerprint image, a total variation (TV) decomposition model with L1 fidelity regularization is used to remove piecewise-smooth background noise. The texture component image obtained from the decomposition of latent image is divided into overlapping patches. Ridge structure dictionary, which is learnt from a set of high quality ridge patches, is then used to restore ridge structure in these latent patches. The ridge quality of a patch, which is used for latent segmentation, is defined as the structural similarity between the patch and its reconstruction. Orientation and frequency fields, which are used for latent enhancement, are then extracted from the reconstructed patch. To balance robustness and accuracy, a coarse to fine strategy is proposed. Experimental results on two latent fingerprint databases (i.e., NIST SD27 and WVU DB) show that the proposed algorithm outperforms the state-of-the-art segmentation and enhancement algorithms and boosts the performance of a state-of-the-art commercial latent matcher.

[1]  Dario Maio,et al.  Improving Fingerprint Orientation Extraction , 2011, IEEE Transactions on Information Forensics and Security.

[2]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[3]  I. Dror,et al.  The Impact of Human–Technology Cooperation and Distributed Cognition in Forensic Science: Biasing Effects of AFIS Contextual Information on Human Experts * , 2012, Journal of forensic sciences.

[4]  Changhu Wang,et al.  Probabilistic models for supervised dictionary learning , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Jean-Michel Morel,et al.  Fast Cartoon + Texture Image Filters , 2010, IEEE Transactions on Image Processing.

[6]  C.-C. Jay Kuo,et al.  Latent fingerprint segmentation with adaptive total variation model , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[7]  R. A. Hicklin,et al.  Repeatability and Reproducibility of Decisions by Latent Fingerprint Examiners , 2012, PloS one.

[8]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[9]  Shengcai Liao,et al.  Partial Face Recognition: Alignment-Free Approach , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  George W. Quinn,et al.  ELFT phase II :: an evaluation of automated latent fingerprint identification technologies , 2009 .

[11]  Michael S. Hsiao,et al.  Latent fingerprint segmentation using ridge template correlation , 2011, ICDP.

[12]  Anil K. Jain,et al.  Fingerprint Image Enhancement: Algorithm and Performance Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  En Zhu,et al.  A systematic method for fingerprint ridge orientation estimation and image segmentation , 2006, Pattern Recognit..

[14]  Guillermo Sapiro,et al.  Discriminative learned dictionaries for local image analysis , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[16]  L. Weathered The innocence project , 2003 .

[17]  Jiankun Hu,et al.  A Fingerprint Orientation Model Based on 2D Fourier Expansion (FOMFE) and Its Application to Singular-Point Detection and Fingerprint Indexing , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Proceedings of 1st International Conference on Image Processing.

[19]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[20]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[21]  C.-C. Jay Kuo,et al.  Adaptive Directional Total-Variation Model for Latent Fingerprint Segmentation , 2013, IEEE Transactions on Information Forensics and Security.

[22]  C.-C. Jay Kuo,et al.  A robust technique for latent fingerprint image segmentation and enhancement , 2008, 2008 15th IEEE International Conference on Image Processing.

[23]  YangXin,et al.  Segmentation of fingerprint images using linear classifier , 2004 .

[24]  Sabih H. Gerez,et al.  Systematic Methods for the Computation of the Directional Fields and Singular Points of Fingerprints , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Xinjian Chen,et al.  Segmentation of Fingerprint Images Using Linear Classifier , 2004, EURASIP J. Adv. Signal Process..

[26]  Anil K. Jain,et al.  Latent fingerprint enhancement via robust orientation field estimation , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[27]  Anil K. Jain,et al.  Handbook of Fingerprint Recognition , 2005, Springer Professional Computing.

[28]  Anil K. Jain,et al.  Automatic segmentation of latent fingerprints , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[29]  R. A. Hicklin,et al.  ELFT-EFS Evaluation of Latent Fingerprint Technologies: Extended Feature Sets [Evaluation #2] , 2011 .

[30]  Craig I. Watson,et al.  Fingerprint Vendor Technology Evaluation 2003: Summary of Results and Analysis Report , 2004 .

[31]  Venu Govindaraju,et al.  Fingerprint enhancement using STFT analysis , 2007, Pattern Recognit..

[32]  Scott Daly,et al.  Digital Images and Human Vision , 1993 .

[33]  Andrew B. Watson,et al.  Digital images and human vision , 1993 .

[34]  Anil K. Jain,et al.  Orientation Field Estimation for Latent Fingerprint Enhancement , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[36]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[38]  R. A. Hicklin,et al.  Accuracy and reliability of forensic latent fingerprint decisions , 2011, Proceedings of the National Academy of Sciences.

[39]  Xudong Jiang Fingerprint image ridge frequency estimation by higher order spectrum , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[40]  Anil K. Jain,et al.  On latent fingerprint enhancement , 2010, Defense + Commercial Sensing.

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  Brandon Mayfield,et al.  A Review of the FBI ' s Handling of the Brandon Mayfield Case , 2006 .