Heart Rate Variability Extraction From Videos Signals: ICA vs. EVM Comparison

Medical researchers have always been interested in heart rate (HR) and heart rate variability (HRV) analysis. However, nowadays, investigators from a variety of other fields are also probing the subject. Recent advancements in non-contact HR and HRV measurement techniques will likely further boost interest in emotional estimation through HRV. Such measurement methods involve the extraction of the photoplethysmography (PPG) signal from the human’s face through a camera. The latest approaches apply independent component analysis (ICA) on the color channels of video recordings to extract a PPG signal. Other investigated methods rely on Eulerian video magnification (EVM) to detect subtle changes in skin color associated with the PPG. To the best of our knowledge, EVM has not been successfully employed to extract HRV features from a video of a human face. In this paper, we present a comparison between our two approaches, one which is based on the ICA and the other is based on EVM. Final results show that the proposed ICA-based method yields better results when it comes to the high frequency (HF) and low frequency over high-frequency (LF/HF) HRV parameters [mean absolute error (MAE) of 0.57 and 0.419] when compared with the EVM-based method (MAE 0.76 and 1.69); however, the second method showed better MAE results for low frequency (LF) and higher correlation with the ground truth. Also our proposed ICA method showed better results in general by improving HF estimates, but the EVM-based method might be more appropriate when motion is involved or when the HF component is not important.

[1]  Richard D. Green,et al.  Calculating a Vagal Tone Index using Webcam Photoplethysmography , 2014, IVCNZ '14.

[2]  Léon J. M. Rothkrantz,et al.  Noncontact automatic heart rate analysis in visible spectrum by specific face regions , 2013, CompSysTech '13.

[3]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[4]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[5]  Nadica Miljković,et al.  Pulse rate assessment: Eulerian Video Magnification vs. electrocardiography recordings , 2014, 12th Symposium on Neural Network Applications in Electrical Engineering (NEUREL).

[6]  Ben J. A. Kröse,et al.  EM detection of common origin of multi-modal cues , 2006, ICMI '06.

[7]  Jean-Franois Cardoso High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[8]  Abdulmotaleb El-Saddik,et al.  U-biofeedback: a multimedia-based reference model for ubiquitous biofeedback systems , 2013, Multimedia Tools and Applications.

[9]  Valery V. Tuchin,et al.  Pulse-wave monitoring by means of focused laser beams scattered by skin surface and membranes , 1993, Photonics West - Lasers and Applications in Science and Engineering.

[10]  D. Brodie,et al.  Effects of Short-Term Psychological Stress on the Time and Frequency Domains of Heart-Rate Variability , 2000, Perceptual and motor skills.

[11]  Marc Garbey,et al.  Contact-Free Measurement of Cardiac Pulse Based on the Analysis of Thermal Imagery , 2007, IEEE Transactions on Biomedical Engineering.

[12]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[13]  Pedro Boloto Chambino Android-based implementation of Eulerian Video Magnification for vital signs monitoring , 2013 .

[14]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[15]  E. F. Greneker,et al.  Radar sensing of heartbeat and respiration at a distance with applications of the technology , 1997 .

[16]  Mika P. Tarvainen,et al.  An advanced detrending method with application to HRV analysis , 2002, IEEE Transactions on Biomedical Engineering.

[17]  W. Verkruysse,et al.  Non-contact heart rate monitoring utilizing camera photoplethysmography in the neonatal intensive care unit - a pilot study. , 2013, Early human development.

[18]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[19]  Daniel McDuff,et al.  Improvements in Remote Cardiopulmonary Measurement Using a Five Band Digital Camera , 2014, IEEE Transactions on Biomedical Engineering.

[20]  Daniel McDuff,et al.  Remote measurement of cognitive stress via heart rate variability , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.