Cross-Sensor Fingerprint Matching Using Siamese Network and Adversarial Learning

The fingerprint is one of the leading biometric modalities that is used worldwide for authenticating the identity of persons. Over time, a lot of research has been conducted to develop automatic fingerprint verification techniques. However, due to different authentication needs, the use of different sensors and the fingerprint verification systems encounter cross-sensor matching or sensor interoperability challenges, where different sensors are used for the enrollment and query phases. The challenge is to develop an efficient, robust and automatic system for cross-sensor matching. This paper proposes a new cross-matching system (SiameseFinger) using the Siamese network that takes the features extracted using the Gabor-HoG descriptor. The proposed Siamese network is trained using adversarial learning. The SiameseFinger was evaluated on two benchmark public datasets FingerPass and MOLF. The results of the experiments presented in this paper indicate that SiameseFinger achieves a comparable performance with that of the state-of-the-art methods.

[1]  Anil K. Jain,et al.  Fingerprint Image Enhancement: Algorithm and Performance Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[4]  Jian Min Guo,et al.  Fingerprint Scaling for Sensor Interoperability , 2013 .

[5]  Arun Ross,et al.  A deformable model for fingerprint matching , 2005, Pattern Recognit..

[6]  Bojan Cukic,et al.  Interoperability in fingerprint recognition: A large-scale empirical study , 2013, 2013 43rd Annual IEEE/IFIP Conference on Dependable Systems and Networks Workshop (DSN-W).

[7]  Xin Yang,et al.  A cross-device matching fingerprint database from multi-type sensors , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[8]  Hatim A. Aboalsamh,et al.  Alignment-Free Cross-Sensor Fingerprint Matching Based on the Co-Occurrence of Ridge Orientations and Gabor-HoG Descriptor , 2019, IEEE Access.

[9]  Baptiste Hemery,et al.  Evaluation of biometric systems: a study of users' acceptance and satisfaction , 2012, Int. J. Biom..

[10]  Ajay Kumar,et al.  Multi-Siamese networks to accurately match contactless to contact-based fingerprint images , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[11]  Zyad Shaaban,et al.  Data Mining: A Preprocessing Engine , 2006 .

[12]  Jianmin Zhao,et al.  Evaluation of minutia cylinder-code on fingerprint cross-matching and its improvement with scale , 2013, 2013 International Conference on Biometrics (ICB).

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Richa Singh,et al.  Multisensor Optical and Latent Fingerprint Database , 2015, IEEE Access.

[15]  Xin Yang,et al.  A coarse-fine fingerprint scaling method , 2013, 2013 International Conference on Biometrics (ICB).

[16]  Davide Maltoni,et al.  Minutia Cylinder-Code: A New Representation and Matching Technique for Fingerprint Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Ajay Kumar,et al.  A CNN-Based Framework for Comparison of Contactless to Contact-Based Fingerprints , 2019, IEEE Transactions on Information Forensics and Security.

[18]  Stephen Mason,et al.  Interoperability between Fingerprint Biometric Systems: An Empirical Study , 2014, 2014 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks.

[19]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[20]  Arun Ross,et al.  Biometric Sensor Interoperability: A Case Study in Fingerprints , 2004, ECCV Workshop BioAW.

[21]  Hatim A. Aboalsamh,et al.  Cross-Sensor Fingerprint Matching Method Based on Orientation, Gradient, and Gabor-HoG Descriptors With Score Level Fusion , 2018, IEEE Access.

[22]  Arun Ross,et al.  A Thin-Plate Spline Calibration Model For Fingerprint Sensor Interoperability , 2008, IEEE Transactions on Knowledge and Data Engineering.

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Raymond N. J. Veldhuis,et al.  Sensor Interoperability and Fusion in Fingerprint Verification: A Case Study using Minutiae-and Ridge-Based Matchers , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[25]  Loris Nanni,et al.  Descriptors for image-based fingerprint matchers , 2009, Expert Syst. Appl..