Liveness Detection and Automatic Template Updating Using Fusion of ECG and Fingerprint

Fingerprints have been extensively used for biometric recognition around the world. However, fingerprints are not secrets, and an adversary can synthesis a fake finger to spoof the biometric system. The mainstream of the current fingerprint spoof detection methods are basically binary classifier trained on some real and fake samples. While they perform well on detecting fake samples created by using the same methods used for training, their performance degrades when encountering fake samples created by a novel spoofing method. In this paper, we approach the problem from a different perspective by incorporating electrocardiogram (ECG). Compared with the conventional biometrics, stealing someone’s ECG is far more difficult if not impossible. Considering that ECG is a vital signal and motivated by its inherent liveness, we propose to combine it with a fingerprint liveness detection algorithm. The combination is natural as both ECG and fingerprints can be captured from fingertips. In the proposed framework, the ECG and fingerprint are combined not only for authentication purpose but also for liveness detection. We also examine automatic template updating using ECG and fingerprint. In addition, we propose a stopping criterion that reduces the average waiting time for signal acquisition. We have performed extensive experiments on the LivDet2015 database which is presently the latest available liveness detection database and compare the proposed method with six liveness detection methods as well as 12 participants of LivDet2015 competition. The proposed system has achieved a liveness detection equal error rate (EER) of 4.2% incorporating only 5 s of ECG. By extending the recording time to 30 s, liveness detection EER reduces to 2.6% which is about 4 times better than the best of six comparison methods. This is also about 2 times better than the best results achieved by the participants of the LivDet2015 competition.

[1]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[2]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Stephanie Schuckers,et al.  Determination of vitality from a non-invasive biomedical measurement for use in fingerprint scanners , 2003, Pattern Recognit..

[4]  Brenda K. Wiederhold,et al.  ECG to identify individuals , 2005, Pattern Recognit..

[5]  Stephanie Schuckers,et al.  Time-series detection of perspiration as a liveness test in fingerprint devices , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  Kenneth Ko,et al.  User's Guide to NIST Biometric Image Software (NBIS) , 2007 .

[7]  Adrian D. C. Chan,et al.  Wavelet Distance Measure for Person Identification Using Electrocardiograms , 2008, IEEE Transactions on Instrumentation and Measurement.

[8]  W. Todd Scruggs,et al.  eigenPulse: Robust human identification from cardiovascular function , 2008, Pattern Recognit..

[9]  Dimitrios Hatzinakos,et al.  ECG Based Recognition Using Second Order Statistics , 2008, 6th Annual Communication Networks and Services Research Conference (cnsr 2008).

[10]  Suneeta Agarwal,et al.  Texture and Wavelet-Based Spoof Fingerprint Detection for Fingerprint Biometric Systems , 2008, 2008 First International Conference on Emerging Trends in Engineering and Technology.

[11]  Tieniu Tan,et al.  Efficient Iris Spoof Detection via Boosted Local Binary Patterns , 2009, ICB.

[12]  Phalguni Gupta,et al.  Biometrics Method for Human Identification Using Electrocardiogram , 2009, ICB.

[13]  Hsiao-Lung Chan,et al.  Human identification by quantifying similarity and dissimilarity in electrocardiogram phase space , 2009, Pattern Recognit..

[14]  Gian Luca Marcialis,et al.  First International Fingerprint Liveness Detection Competition - LivDet 2009 , 2009, ICIAP.

[15]  B. V. K. Vijaya Kumar,et al.  Investigation of human identification using two-lead Electrocardiogram (ECG) signals , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[16]  Gian Luca Marcialis,et al.  Analysis of Fingerprint Pores for Vitality Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[17]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[18]  Dimitrios Hatzinakos,et al.  HeartID: Cardiac biometric recognition , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[19]  Joseph A. O'Sullivan,et al.  ECG biometrics: A robust short-time frequency analysis , 2010, 2010 IEEE International Workshop on Information Forensics and Security.

[20]  Ana L. N. Fred,et al.  Unveiling the Biometric Potential of Finger-Based ECG Signals , 2011, Comput. Intell. Neurosci..

[21]  Manal M. Tantawi,et al.  Fiducial feature reduction analysis for electrocardiogram (ECG) based biometric recognition , 2012, Journal of Intelligent Information Systems.

[22]  Gian Luca Marcialis,et al.  LivDet 2011 — Fingerprint liveness detection competition 2011 , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[23]  Joseph A. O'Sullivan,et al.  ECG Biometric Recognition: A Comparative Analysis , 2012, IEEE Transactions on Information Forensics and Security.

[24]  Dimitrios Hatzinakos,et al.  Securing handheld devices and fingerprint readers with ECG biometrics , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[25]  Sanjay Kumar Singh,et al.  Fusion of electrocardiogram with unobtrusive biometrics: An efficient individual authentication system , 2012, Pattern Recognit. Lett..

[26]  Arun Ross,et al.  Combining match scores with liveness values in a fingerprint verification system , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[27]  Saeid Nahavandi,et al.  Human Identification From ECG Signals Via Sparse Representation of Local Segments , 2013, IEEE Signal Processing Letters.

[28]  Ana L. N. Fred,et al.  Outlier Detection in Non-intrusive ECG Biometric System , 2013, ICIAR.

[29]  Ana L. N. Fred,et al.  Finger ECG signal for user authentication: Usability and performance , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[30]  Hsiao-Lung Chan,et al.  QRS detection-free electrocardiogram biometrics in the reconstructed phase space , 2013, Pattern Recognit. Lett..

[31]  Gian Luca Marcialis,et al.  LivDet 2013 Fingerprint Liveness Detection Competition 2013 , 2013, 2013 International Conference on Biometrics (ICB).

[32]  Anthony Kaveh,et al.  Temporal and spectral features of single lead ECG for human identification , 2013, 2013 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications.

[33]  Abdenour Hadid,et al.  Fingerprint Liveness Detection using Binarized Statistical Image Features , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[34]  Christoph Busch,et al.  Presentation attack detection methods for fingerprint recognition systems: a survey , 2014, IET Biom..

[35]  David Menotti,et al.  Evaluating the use of ECG signal in low frequencies as a biometry , 2014, Expert Syst. Appl..

[36]  Dimitrios Hatzinakos,et al.  On Evaluating ECG Biometric Systems: Session-Dependence and Body Posture , 2014, IEEE Transactions on Information Forensics and Security.

[37]  Herbert F. Jelinek,et al.  ECG Biometric with Abnormal Cardiac Conditions in Remote Monitoring System , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[38]  Gian Luca Marcialis,et al.  Toward an attack-sensitive tamper-resistant biometric recognition with a symmetric matcher: A fingerprint case study , 2014, 2014 IEEE Symposium on Computational Intelligence in Biometrics and Identity Management (CIBIM).

[39]  Arun Ross,et al.  A Survey on Anti-Spoofing Schemes for Fingerprint Recognition Systems , 2014 .

[40]  Yogendra Narain Singh,et al.  Human recognition using Fisher's discriminant analysis of heartbeat interval features and ECG morphology , 2015, Neurocomputing.

[41]  Joseph A. O'Sullivan,et al.  Cardiovascular Biometrics: Combining Mechanical and Electrical Signals , 2015, IEEE Transactions on Information Forensics and Security.

[42]  Himanshu S. Bhatt,et al.  QFuse: Online learning framework for adaptive biometric system , 2015, Pattern Recognit..

[43]  Luisa Verdoliva,et al.  Local contrast phase descriptor for fingerprint liveness detection , 2015, Pattern Recognit..

[44]  Majid Komeili,et al.  Feature selection from multisession electrocardiogram signals for identity verification , 2015, 2015 IEEE 28th Canadian Conference on Electrical and Computer Engineering (CCECE).

[45]  Luisa Verdoliva,et al.  An Investigation of Local Descriptors for Biometric Spoofing Detection , 2015, IEEE Transactions on Information Forensics and Security.

[46]  Gian Luca Marcialis,et al.  LivDet 2015 fingerprint liveness detection competition 2015 , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[47]  Jee-Hyong Lee,et al.  Noisy and incomplete fingerprint classification using local ridge distribution models , 2015, Pattern Recognit..

[48]  Roberto de Alencar Lotufo,et al.  Fingerprint Liveness Detection Using Convolutional Neural Networks , 2016, IEEE Transactions on Information Forensics and Security.

[49]  Petru Radu,et al.  Robust multimodal face and fingerprint fusion in the presence of spoofing attacks , 2016, Pattern Recognit..

[50]  Syed Abdul Rahman Al-Haddad,et al.  ECG biometric authentication based on non-fiducial approach using kernel methods , 2016, Digit. Signal Process..

[51]  Richa Singh,et al.  Incremental granular relevance vector machine: A case study in multimodal biometrics , 2016, Pattern Recognit..

[52]  Jianjiang Feng,et al.  Fingerprint indexing with pose constraint , 2016, Pattern Recognit..

[53]  Bojan Cukic,et al.  Robust and interoperable fingerprint spoof detection via convolutional neural networks , 2016, 2016 IEEE Symposium on Technologies for Homeland Security (HST).

[54]  Gian Luca Marcialis,et al.  Review of the Fingerprint Liveness Detection (LivDet) competition series: 2009 to 2015 , 2016, Image Vis. Comput..

[55]  Mark Mohammad Tehranipoor,et al.  Highly Reliable Key Generation From Electrocardiogram (ECG) , 2017, IEEE Transactions on Biomedical Engineering.

[56]  K. Harshika Image Quality Assessment for Fake Biometric Detection : Application to Iris , Fingerprint , and Face Recognition , 2017 .

[57]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Adaptive Biometric Systems , 2019, ACM Comput. Surv..