Deep Dense Multi-level feature for partial high-resolution fingerprint matching

Fingerprint sensors on mobile devices commonly have limited area, which results in partial fingerprints. Optical sensor can capture fingerprints at very high resolution (2000ppi) with abundant details like pores, incipients, etc. It is quite crucial to develop effective partial-to-partial high-resolution fingerprint matching algorithms. Existing fingerprint matching methods are mainly minutiae-based, with fusion of different levels of features. Their accuracy degrades significantly in our application due to minutiae insufficiency and detection error. In this paper, we propose a novel representation for partial high-resolution fingerprint, named Deep Dense Multi-level feature (DDM). We train a deep convolutional neural network that can extract discriminative features inside any local fingerprint block with certain size. We find that not only minutiae but most local blocks contain sufficient features. Moreover, we analyze DDM and find that it contains multi-level information. When utilizing DDM for partial-to-partial matching, we first extract features block by block through a fully convolutional network, next match the two sets of features pairwise exhaustively, and then select the bi-directional best matches to compute matching score. Experiments indicate that our method outperforms several state-of-the-art approaches.

[1]  Jufu Feng,et al.  A Robust Fingerprint Matching Approach: Growing and Fusing of Local Structures , 2007, ICB.

[2]  J. Kim,et al.  Fingerprint Matching Incorporating Ridge Features With Minutiae , 2011, IEEE Transactions on Information Forensics and Security.

[3]  Xinjian Chen,et al.  A Matching Algorithm Based on Local Topologic Structure , 2004, ICIAR.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jufu Feng,et al.  A robust fingerprint matching algorithm based on compatibility of star structures , 2009, International Symposium on Multispectral Image Processing and Pattern Recognition.

[6]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Pauli Kuosmanen,et al.  Fingerprint Matching Using an Orientation-Based Minutia Descriptor , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Yi Chen,et al.  Pores and Ridges: High-Resolution Fingerprint Matching Using Level 3 Features , 2007 .

[9]  Xiang Fu,et al.  Spectral correspondence method for fingerprint minutia matching , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[10]  Yanmin Niu,et al.  Fingerprint matching using OrientationCodes and PolyLines , 2007, Pattern Recognit..

[11]  Tiejun Huang,et al.  Deep Relative Distance Learning: Tell the Difference between Similar Vehicles , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[13]  Anil K. Jain,et al.  Automated Latent Fingerprint Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Venu Govindaraju,et al.  Fingerprint enhancement using STFT analysis , 2007, Pattern Recognit..

[16]  Sharath Pankanti,et al.  Filterbank-based fingerprint matching , 2000, IEEE Trans. Image Process..

[17]  Davide Maltoni,et al.  Minutia Cylinder-Code: A New Representation and Matching Technique for Fingerprint Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[19]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[20]  J. Dillinger FINGERPRINTS , 1938 .

[21]  Yi Chen,et al.  Dots and Incipients: Extended Features for Partial Fingerprint Matching , 2007, 2007 Biometrics Symposium.

[22]  Weixing Wang,et al.  A novel fingerprint matching method using a curvature-based minutia specifier , 2008, 2008 15th IEEE International Conference on Image Processing.

[23]  Jufu Feng,et al.  High-Resolution Mobile Fingerprint Matching via Deep Joint KNN-Triplet Embedding , 2017, AAAI.

[24]  Kenneth Ko,et al.  Users Guide to Export Controlled Distribution of NIST Biometric Image Software (NBIS-EC) , 2007 .

[25]  Sanjay Agrawal,et al.  Partial fingerprint matching: Fusion of level 2 and level 3 features , 2014, 2014 5th International Conference - Confluence The Next Generation Information Technology Summit (Confluence).

[26]  Tsuyoshi Isshiki,et al.  SIFT-based algorithm for fingerprint authentication on smartphone , 2015, 2015 6th International Conference of Information and Communication Technology for Embedded Systems (IC-ICTES).

[27]  Shreyasi Das,et al.  Methodology for partial fingerprint enrollment and authentication on mobile devices , 2016, 2016 International Conference on Biometrics (ICB).

[28]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[29]  Jianjiang Feng,et al.  Combining minutiae descriptors for fingerprint matching , 2008, Pattern Recognit..

[30]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.