Deep Coupled GAN-Based Score-Level Fusion for Multi-Finger Contact to Contactless Fingerprint Matching

Interoperability between contact to contactless images in fingerprint matching is a key factor in the success of contactless fingerprinting devices, which have recently witnessed an increasing demand for biometric authentication. However, due to the presence of perspective distortion and the absence of elastic deformation in contactless fingerphotos, direct matching between contactless fingerprint probe images and legacy contact-based gallery images produces a low accuracy. In this paper, to improve interoperability, we propose a coupled deep learning framework that consists of two Conditional Generative Adversarial Networks. Generative modeling is employed to find a projection that maximizes the pairwise correlation between these two domains in a common latent embedding subspace. Extensive experiments on three challenging datasets demonstrate significant performance improvements over the state-of-the-art methods and two top-performing commercial off-the-shelf SDKs, i.e., Verifinger 12.0 and Innovatrics. We also achieve a high-performance gain by combining multiple fingers of the same subject using a score fusion model.

[1]  Anil K. Jain,et al.  PrintsGAN: Synthetic Fingerprint Generator , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Muhammad Hussain,et al.  Cross-Sensor Fingerprint Matching Using Siamese Network and Adversarial Learning , 2021, Sensors.

[3]  Eryun Liu,et al.  C2CL: Contact to Contactless Fingerprint Matching , 2021, IEEE Transactions on Information Forensics and Security.

[4]  Christoph Busch,et al.  An overview of touchless 2D fingerprint recognition , 2021, EURASIP Journal on Image and Video Processing.

[5]  Ajay Kumar,et al.  A CNN-Based Framework for Comparison of Contactless to Contact-Based Fingerprints , 2019, IEEE Transactions on Information Forensics and Security.

[6]  Shervin Minaee,et al.  Finger-GAN: Generating Realistic Fingerprint Images Using Connectivity Imposed GAN , 2018, ArXiv.

[7]  John D. Grantham,et al.  Guidance for evaluating contactless fingerprint acquisition devices , 2018 .

[8]  Lior Wolf,et al.  Unsupervised Cross-Domain Image Generation , 2016, ICLR.

[9]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ming-Yu Liu,et al.  Coupled Generative Adversarial Networks , 2016, NIPS.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[13]  Tianqi Chen,et al.  Empirical Evaluation of Rectified Activations in Convolutional Network , 2015, ArXiv.

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[16]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[17]  Chulhan Lee,et al.  A new scheme for touchless fingerprint recognition system , 2004, Proceedings of 2004 International Symposium on Intelligent Signal Processing and Communication Systems, 2004. ISPACS 2004..

[18]  Hanzhuo Tan,et al.  Minutiae Attention Network With Reciprocal Distance Loss for Contactless to Contact-Based Fingerprint Identification , 2021, IEEE Transactions on Information Forensics and Security.

[19]  Ajay Kumar,et al.  Matching Contactless and Contact-Based Conventional Fingerprint Images for Biometrics Identification , 2018, IEEE Transactions on Image Processing.