Heartbeat Signal from Facial Video for Biometric Recognition

Different biometric traits such as face appearance and heartbeat signal from Electrocardiogram (ECG)/Phonocardiogram (PCG) are widely used in the human identity recognition. Recent advances in facial video based measurement of cardio-physiological parameters such as heartbeat rate, respiratory rate, and blood volume pressure provide the possibility of extracting heartbeat signal from facial video instead of using obtrusive ECG or PCG sensors in the body. This paper proposes the Heartbeat Signal from Facial Video (HSFV) as a new biometric trait for human identity recognition, for the first time to the best of our knowledge. Feature extraction from the HSFV is accomplished by employing Radon transform on a waterfall model of the replicated HSFV. The pairwise Minkowski distances are obtained from the Radon image as the features. The authentication is accomplished by a decision tree based supervised approach. The potential of the proposed HSFV biometric for human identification is demonstrated on a public database.

[1]  B. Phibbs,et al.  Comprar The Human Heart 2/e (A Basic Guide to Heart Disease) | Brendan Phibbs MD | 9780781767774 | Lippincott Williams & Wilkins , 2007 .

[2]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[3]  K.R. Venugopal,et al.  Secure Authentication using Image Processing and Visual Cryptography for Banking Applications , 2008, 2008 16th International Conference on Advanced Computing and Communications.

[4]  Thomas B. Moeslund,et al.  Real-time acquisition of high quality face sequences from an active pan-tilt-zoom camera , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[5]  David L. Olson,et al.  Performance Evaluation for Predictive Modeling , 2008 .

[6]  Noureddine Belgacem,et al.  ECG Based Human Authentication using Wavelets and Random Forests , 2012 .

[7]  P. Deepa Shenoy,et al.  Statistical Analysis for Human Authentication Using ECG Waves , 2011, ICISTM.

[8]  A. Nait-Ali,et al.  Human Authentication System Based on ECG Signal Using FFT and Random Forests , 2012 .

[9]  Meenakshi Nawal,et al.  ECG Based Human Authentication: A Review , 2014 .

[10]  Basic Concepts of Reconstruction Algorithms , 2009 .

[11]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[12]  Thomas B. Moeslund,et al.  Constructing facial expression log from video sequences using face quality assessment , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[13]  C. Takano,et al.  Heart rate measurement based on a time-lapse image. , 2007, Medical engineering & physics.

[14]  Qinqin Shen,et al.  Heart Sound Biometric System Based on Marginal Spectrum Analysis , 2013, Sensors.

[15]  P. Deepa Shenoy,et al.  Heartbeat biometrics for human authentication , 2011, Signal Image Video Process..

[16]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[17]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[18]  Francesco Beritelli,et al.  Human Identity Verification based on Heart Sounds: Recent Advances and Future Directions , 2011, ArXiv.

[19]  Arun Ross,et al.  An introduction to biometrics , 2008, ICPR 2008.

[20]  Francesco Beritelli,et al.  Biometric Identification Based on Frequency Analysis of Cardiac Sounds , 2007, IEEE Transactions on Information Forensics and Security.

[21]  Sanjay Kumar Singh,et al.  Evaluation of Electrocardiogram for Biometric Authentication , 2012, J. Information Security.

[22]  Ola Pettersson,et al.  ECG analysis: a new approach in human identification , 2001, IEEE Trans. Instrum. Meas..

[23]  Matti Pietikäinen,et al.  Remote Heart Rate Measurement from Face Videos under Realistic Situations , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  W. C. Tan,et al.  Towards Real Time Implementation of Sparse Representation Classifier (SRC) Based Heartbeat Biometric System , 2014 .

[25]  Dimitrios Hatzinakos,et al.  HeartID: Cardiac biometric recognition , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[26]  Robert K. Rowe,et al.  Spoof Detection Schemes , 2008 .

[27]  Tran Huy Dat,et al.  Heart sound as a biometric , 2008, Pattern Recognit..

[28]  D. Hendrick,et al.  Introduction , 1998, Thorax.

[29]  Leon Hirsch.  The Human Heart A Basic Guide To Heart Disease , 2016 .

[30]  Srinivasan Jayaraman,et al.  Human Electrocardiogram for Biometrics Using DTW and FLDA , 2010, 2010 20th International Conference on Pattern Recognition.