Latent Fingerprint Image Enhancement Based on Progressive Generative Adversarial Network

Latent fingerprints, a kind of fingerprints which are captured from the finger skin impressions at the crime scene, have been adopted to identify suspected criminals for a long time. However, poor latent fingerprint image quality owing to unstructured overlapping patterns, unclear ridge structure, and various background noise has brought a challenge to the recognition of latent fingerprints. Therefore, image enhancement is a crucial step for more accurate fingerprint recognition. In this paper, a latent fingerprint enhancement method based on the progressive generative adversarial network (GAN) is proposed. The powerful GAN structure provides an efficient translation from latent fingerprint to high-quality fingerprint. Our method consists of two stages: Progressive Offline Training (POT) and Iterative Online Testing (IOT). Progressive training makes our model not only focus on the local features such as minutiae but also preserve structure feature such as the orientation field. We extensively evaluate our model on NIST SD27 latent fingerprint dataset. With the help of orientation estimation task and progressive training scheme, our model achieves better recognition accuracy.

[1]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Xiao Yang,et al.  Localized Dictionaries Based Orientation Field Estimation for Latent Fingerprints , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Michael M. Bronstein,et al.  Generative convolutional networks for latent fingerprint reconstruction , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[4]  Xiaogang Wang,et al.  DeepID3: Face Recognition with Very Deep Neural Networks , 2015, ArXiv.

[5]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[6]  Anil K. Jain,et al.  Orientation Field Estimation for Latent Fingerprint Enhancement , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Anil K. Jain,et al.  Fingerprint Image Enhancement: Algorithm and Performance Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Wotao Yin,et al.  A comparison of three total variation based texture extraction models , 2007, J. Vis. Commun. Image Represent..

[9]  Jian Li,et al.  Deep convolutional neural network for latent fingerprint enhancement , 2018, Signal Process. Image Commun..

[10]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Arun Ross,et al.  50 years of biometric research: Accomplishments, challenges, and opportunities , 2016, Pattern Recognit. Lett..

[13]  Jianjiang Feng,et al.  Robust and Efficient Algorithms for Separating Latent Overlapped Fingerprints , 2012, IEEE Transactions on Information Forensics and Security.

[14]  C.-C. Jay Kuo,et al.  Adaptive Directional Total-Variation Model for Latent Fingerprint Segmentation , 2013, IEEE Transactions on Information Forensics and Security.

[15]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[16]  Tianzi Jiang,et al.  A modified Gabor filter design method for fingerprint image enhancement , 2003, Pattern Recognit. Lett..

[17]  Jiayu Zhou,et al.  Latent Fingerprint Value Prediction: Crowd-Based Learning , 2018, IEEE Transactions on Information Forensics and Security.

[18]  Yuhang Liu,et al.  Cooperative Orientation Generative Adversarial Network for Latent Fingerprint Enhancement , 2019, 2019 International Conference on Biometrics (ICB).

[19]  Manhua Liu,et al.  Latent Fingerprint Enhancement via Multi-Scale Patch Based Sparse Representation , 2015, IEEE Transactions on Information Forensics and Security.

[20]  Anil K. Jain,et al.  Latent orientation field estimation via convolutional neural network , 2015, 2015 International Conference on Biometrics (ICB).

[21]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[22]  Manhua Liu,et al.  Latent Fingerprint Enhancement Based on DenseUNet , 2019, 2019 International Conference on Biometrics (ICB).

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[24]  Michael D. Garris,et al.  NIST Special Database 27 Fingerprint Minutiae From Latent and Matching Tenprint Images , 2000 .

[25]  C.-C. Jay Kuo,et al.  Latent fingerprint segmentation with adaptive total variation model , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[26]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .