Cooperative Orientation Generative Adversarial Network for Latent Fingerprint Enhancement

Robust fingerprint enhancement algorithm is crucial to latent fingerprint recognition. In this paper, a latent fingerprint enhancement model named cooperative orientation generative adversarial network (COOGAN) is proposed. We formulate fingerprint enhancement as an image-to-image translation problem with deep generative adversarial network (GAN) and introduce orientation constraints to it. The deep architecture provides a powerful representation for the translation between latent fingerprint space and enhanced fingerprint space. While the orientation supervision can guide the deep feature learning to focus more on the ridge flows. To further boost the performance, a quality estimation module is proposed to remove the unrecoverable regions while enhancement. Experimental results show that COOGAN achieves state-of-the-art performance on NIST SD27 latent fingerprint database.

[1]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[2]  Nasser M. Nasrabadi,et al.  ID Preserving Generative Adversarial Network for Partial Latent Fingerprint Reconstruction , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Xiang Fu,et al.  Extended clique models: A new matching strategy for fingerprint recognition , 2013, 2013 International Conference on Biometrics (ICB).

[5]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[7]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[8]  Yuhang Liu,et al.  FingerNet: An unified deep network for fingerprint minutiae extraction , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[9]  Anil K. Jain,et al.  Segmentation and Enhancement of Latent Fingerprints: A Coarse to Fine RidgeStructure Dictionary , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Julian Fiérrez,et al.  A Comparative Study of Fingerprint Image-Quality Estimation Methods , 2007, IEEE Transactions on Information Forensics and Security.

[11]  Michael D. Garris,et al.  NIST Special Database 27 Fingerprint Minutiae From Latent and Matching Tenprint Images , 2000 .

[12]  Vutipong Areekul,et al.  Filter Design Based on Spectral Dictionary for Latent Fingerprint Pre-enhancement , 2018, 2018 International Conference on Biometrics (ICB).

[13]  Kieran G Larkin,et al.  A coherent framework for fingerprint analysis: are fingerprints Holograms? , 2007, Optics express.

[14]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Anil K. Jain,et al.  Fingerprint Quality Indices for Predicting Authentication Performance , 2005, AVBPA.

[17]  Richa Singh,et al.  Latent Fingerprint Matching: A Survey , 2014, IEEE Access.

[18]  Anil K. Jain,et al.  Fingerprint Image Enhancement: Algorithm and Performance Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Chuan Li,et al.  Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks , 2016, ECCV.

[20]  Anil K. Jain,et al.  Latent orientation field estimation via convolutional neural network , 2015, 2015 International Conference on Biometrics (ICB).

[21]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Xudong Jiang,et al.  Fingerprint quality and validity analysis , 2002, Proceedings. International Conference on Image Processing.

[23]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[24]  Xiao Yang,et al.  Localized Dictionaries Based Orientation Field Estimation for Latent Fingerprints , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[26]  Michael M. Bronstein,et al.  Generative convolutional networks for latent fingerprint reconstruction , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[27]  Anil K. Jain,et al.  Orientation Field Estimation for Latent Fingerprint Enhancement , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Anil K. Jain,et al.  Handbook of Fingerprint Recognition , 2005, Springer Professional Computing.

[30]  Arun Ross,et al.  50 years of biometric research: Accomplishments, challenges, and opportunities , 2016, Pattern Recognit. Lett..