Robust Minutiae Extractor: Integrating Deep Networks and Fingerprint Domain Knowledge

We propose a fully automatic minutiae extractor, called MinutiaeNet, based on deep neural networks with compact feature representation for fast comparison of minutiae sets. Specifically, first a network, called CoarseNet, estimates the minutiae score map and minutiae orientation based on convolutional neural network and fingerprint domain knowledge (enhanced image, orientation field, and segmentation map). Subsequently, another network, called FineNet, refines the candidate minutiae locations based on score map. We demonstrate the effectiveness of using the fingerprint domain knowledge together with the deep networks. Experimental results on both latent (NIST SD27) and plain (FVC 2004) public domain fingerprint datasets provide comprehensive empirical support for the merits of our method. Further, our method finds minutiae sets that are better in terms of precision and recall in comparison with state-of-the-art on these two datasets. Given the lack of annotated fingerprint datasets with minutiae ground truth, the proposed approach to robust minutiae detection will be useful to train network-based fingerprint matching algorithms as well as for evaluating fingerprint individuality at scale. MinutiaeNet is implemented in Tensorflow: https://github.com/luannd/MinutiaeNet

[1]  Jitendra Malik,et al.  Deformable part models are convolutional neural networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[3]  Umut Uludag,et al.  Standard Fingerprint Databases: Manual Minutiae Labeling and Matcher Performance Analyses , 2013, ArXiv.

[4]  Anil K. Jain,et al.  FVC2002: Second Fingerprint Verification Competition , 2002, Object recognition supported by user interaction for service robots.

[5]  Yuhang Liu,et al.  FingerNet: An unified deep network for fingerprint minutiae extraction , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[6]  Richa Singh,et al.  On latent fingerprint minutiae extraction using stacked denoising sparse AutoEncoders , 2014, IEEE International Joint Conference on Biometrics.

[7]  Min Wu,et al.  A direct fingerprint minutiae extraction approach based on convolutional neural networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[8]  Anil K. Jain,et al.  Latent fingerprint enhancement via robust orientation field estimation , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Arun Ross,et al.  50 years of biometric research: Accomplishments, challenges, and opportunities , 2016, Pattern Recognit. Lett..

[11]  Yi Chen,et al.  Pores and Ridges: High-Resolution Fingerprint Matching Using Level 3 Features , 2007 .

[12]  Michael D. Garris,et al.  NIST Special Database 27 Fingerprint Minutiae From Latent and Matching Tenprint Images , 2000 .

[13]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Xiaoou Tang,et al.  Preprocessing and postprocessing for skeleton-based fingerprint minutiae extraction , 2007, Pattern Recognit..

[17]  Kenneth Ko,et al.  User's Guide to NIST Biometric Image Software (NBIS) , 2007 .

[18]  Jufu Feng,et al.  Latent fingerprint minutia extraction using fully convolutional network , 2016, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[19]  Anil K. Jain,et al.  Automated Latent Fingerprint Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jufu Feng,et al.  A novel method of fingerprint minutiae extraction based on Gabor phase , 2010, 2010 IEEE International Conference on Image Processing.

[21]  Anil K. Jain,et al.  On-line fingerprint verification , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[22]  Benjamin Rosman,et al.  Fingerprint minutiae extraction using deep learning , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[23]  Jianjiang Feng,et al.  Combining minutiae descriptors for fingerprint matching , 2008, Pattern Recognit..

[24]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Anil K. Jain,et al.  FVC2004: Third Fingerprint Verification Competition , 2004, ICBA.

[26]  Xiao Yang,et al.  Localized Dictionaries Based Orientation Field Estimation for Latent Fingerprints , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.