C2CL: Contact to Contactless Fingerprint Matching

Matching contactless fingerprints or finger photos to contact-based fingerprint impressions has received increased attention in the wake of COVID-19 due to the superior hygiene of the contactless acquisition and the widespread availability of low cost mobile phones capable of capturing photos of fingerprints with sufficient resolution for verification purposes. This paper presents an end-to-end automated system, called C2CL, comprised of a mobile finger photo capture app, preprocessing, and matching algorithms to handle the challenges inhibiting previous cross-matching methods; namely i) low ridge-valley contrast of contactless fingerprints, ii) varying roll, pitch, yaw, and distance of the finger to the camera, iii) non-linear distortion of contact-based fingerprints, and vi) different image qualities of smartphone cameras. Our preprocessing algorithm segments, enhances, scales, and unwarps contactless fingerprints, while our matching algorithm extracts both minutiae and texture representations. A sequestered dataset of 9, 888 contactless 2D fingerprints and corresponding contact-based fingerprints from 206 subjects (2 thumbs and 2 index fingers for each subject) acquired using our mobile capture app is used to evaluate the cross-database performance of our proposed algorithm. Furthermore, additional experimental results on 3 publicly available datasets show substantial improvement in the state-of-the-art for contact to contactless fingerprint matching (TAR in the range of 96.67% to 98.30% at FAR=0.01%).

[1]  Arun Ross,et al.  A deformable model for fingerprint matching , 2005, Pattern Recognit..

[2]  Chulhan Lee,et al.  A new scheme for touchless fingerprint recognition system , 2004, Proceedings of 2004 International Symposium on Intelligent Signal Processing and Communication Systems, 2004. ISPACS 2004..

[3]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Jiankun Hu,et al.  Contactless Fingerprint Recognition Based on Global Minutia Topology and Loose Genetic Algorithm , 2020, IEEE Transactions on Information Forensics and Security.

[5]  Nasser M. Nasrabadi,et al.  Fingerprint Distortion Rectification Using Deep Convolutional Neural Networks , 2018, 2018 International Conference on Biometrics (ICB).

[6]  Anil K. Jain,et al.  Adaptive flow orientation-based feature extraction in fingerprint images , 1995, Pattern Recognit..

[7]  Richa Singh,et al.  On Matching Finger-Selfies Using Deep Scattering Networks , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[8]  Bernadette Dorizzi,et al.  Fingerprint and On-Line Signature Verification Competitions at ICB 2009 , 2009, ICB.

[9]  Anil K. Jain,et al.  Fingerprint Presentation Attack Detection: A Sensor and Material Agnostic Approach , 2020, 2020 IEEE International Joint Conference on Biometrics (IJCB).

[10]  Peter Wild,et al.  Comparative Test of Smartphone Finger Photo vs. Touch-based Cross-sensor Fingerprint Recognition , 2019, 2019 7th International Workshop on Biometrics and Forensics (IWBF).

[11]  Christoph Busch,et al.  Mobile Touchless Fingerprint Recognition: Implementation, Performance and Usability Aspects , 2021, ArXiv.

[12]  Bojan Cukic,et al.  Minimizing the impact of low interoperability between optical fingerprints sensors , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[13]  Dario Maio,et al.  Modelling Plastic Distortion in Fingerprint Images , 2001, ICAPR.

[14]  Ajay Kumar,et al.  Contactless fingerprint identification using level zero features , 2011, CVPR 2011 WORKSHOPS.

[15]  Ajay Kumar,et al.  A CNN-Based Framework for Comparison of Contactless to Contact-Based Fingerprints , 2019, IEEE Transactions on Information Forensics and Security.

[16]  Christopher Boehnen,et al.  NIST Special Database 302: , 2019 .

[17]  Craig I. Watson,et al.  Fingerprint Vendor Technology Evaluation , 2014 .

[18]  Muhammad Hussain,et al.  A Large-Scale Study of Fingerprint Matching Systems for Sensor Interoperability Problem , 2018, Sensors.

[19]  Raymond N. J. Veldhuis,et al.  Sensor Interoperability and Fusion in Fingerprint Verification: A Case Study using Minutiae-and Ridge-Based Matchers , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[20]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[21]  Sharath Pankanti,et al.  On the individuality fingerprints , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Chulhan Lee,et al.  A Study of Touchless Fingerprint Recognition System , 2006, SSPR/SPR.

[23]  Arun Ross,et al.  A calibration model for fingerprint sensor interoperability , 2006, SPIE Defense + Commercial Sensing.

[24]  Pooja Gautam Touch-less fingerprint recognition system , 2011, ICWET.

[25]  Anil K. Jain,et al.  End-to-End Latent Fingerprint Search , 2018, IEEE Transactions on Information Forensics and Security.

[26]  Roberto de Alencar Lotufo,et al.  Fingerprint Liveness Detection Using Convolutional Neural Networks , 2016, IEEE Transactions on Information Forensics and Security.

[27]  Prasad Joshi,et al.  Towards smartphone-based touchless fingerprint recognition , 2019, Sādhanā.

[28]  Ajay Kumar,et al.  Matching Contactless and Contact-Based Conventional Fingerprint Images for Biometrics Identification , 2018, IEEE Transactions on Image Processing.

[29]  Arun Ross,et al.  Biometric Sensor Interoperability: A Case Study in Fingerprints , 2004, ECCV Workshop BioAW.

[30]  Arun Ross,et al.  Fingerprint warping using ridge curve correspondences , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Geppy Parziale,et al.  Touchless Fingerprinting Technology , 2008 .

[32]  Ajay Kumar,et al.  Contactless and partial 3D fingerprint recognition using multi-view deep representation , 2018, Pattern Recognit..

[33]  Ruud M. Bolle Improved Fingerprint Matching by Distortion Removal , 2001 .

[34]  Kenneth Okereafor,et al.  Fingerprint Biometric System Hygiene and the Risk of COVID-19 Transmission , 2020, JMIR Biomedical Engineering.

[35]  Sabih H. Gerez,et al.  Fingerprint matching by thin-plate spline modelling of elastic deformations , 2003, Pattern Recognit..

[36]  Bojan Cukic,et al.  Interoperability in fingerprint recognition: A large-scale empirical study , 2013, 2013 43rd Annual IEEE/IFIP Conference on Dependable Systems and Networks Workshop (DSN-W).

[37]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[38]  Pillai Praveen Thulasidharan,et al.  Detection and rectification of distorted fingerprints , 2017, 2017 International Conference on Intelligent Computing and Control (I2C2).

[39]  Yi Chen,et al.  Advanced Technologies for Touchless Fingerprint Recognition , 2009, Handbook of Remote Biometrics.

[40]  Hakil Kim,et al.  On Improving Interoperability of Fingerprint Recognition Using Resolution Compensation Based on Sensor Evaluation , 2007, ICB.

[41]  Richa Singh,et al.  On smartphone camera based fingerphoto authentication , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[42]  Anil K. Jain,et al.  Longitudinal study of fingerprint recognition , 2015, Proceedings of the National Academy of Sciences.

[43]  Anil K. Jain,et al.  Matching Fingerphotos to Slap Fingerprint Images , 2018, ArXiv.

[44]  Sobhan Soleymani,et al.  Deep Contactless Fingerprint Unwarping , 2019, 2019 International Conference on Biometrics (ICB).

[45]  Anil K. Jain,et al.  Learning a Fixed-Length Fingerprint Representation , 2019, IEEE transactions on pattern analysis and machine intelligence.

[46]  Christoph Busch,et al.  Fingerphoto recognition with smartphone cameras , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[47]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[48]  Jiankun Hu,et al.  A benchmark 3D fingerprint database , 2014, 2014 11th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[49]  Richa Singh,et al.  Fingerphoto Authentication Using Smartphone Camera Captured Under Varying Environmental Conditions , 2017 .