HRVCam: robust camera-based measurement of heart rate variability

Abstract. Significance: Non-contact, camera-based heart rate variability estimation is desirable in numerous applications, including medical, automotive, and entertainment. Unfortunately, camera-based HRV accuracy and reliability suffer due to two challenges: (a) darker skin tones result in lower SNR and (b) relative motion induces measurement artifacts. Aim: We propose an algorithm HRVCam that provides sufficient robustness to low SNR and motion-induced artifacts commonly present in imaging photoplethysmography (iPPG) signals. Approach: HRVCam computes camera-based HRV from the instantaneous frequency of the iPPG signal. HRVCam uses automatic adaptive bandwidth filtering along with discrete energy separation to estimate the instantaneous frequency. The parameters of HRVCam use the observed characteristics of HRV and iPPG signals. Results: We capture a new dataset containing 16 participants with diverse skin tones. We demonstrate that HRVCam reduces the error in camera-based HRV metrics significantly (more than 50% reduction) for videos with dark skin and face motion. Conclusion: HRVCam can be used on top of iPPG estimation algorithms to provide robust HRV measurements making camera-based HRV practical.

[1]  J. Vagedes,et al.  How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram. , 2013, International journal of cardiology.

[2]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[3]  Roy Kalawsky,et al.  Noncontact imaging photoplethysmography to effectively access pulse rate variability , 2012, Journal of biomedical optics.

[4]  Peter Robinson,et al.  OpenFace: An open source facial behavior analysis toolkit , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[5]  Michael L. Jacobson,et al.  Time-frequency analysis of heart rate variability , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[6]  Heart Rate Variability Standards of Measurement , Physiological Interpretation , and Clinical Use Task Force of the European Society of Cardiology the North American Society of Pacing Electrophysiology , 2022 .

[7]  F. Shaffer,et al.  An Overview of Heart Rate Variability Metrics and Norms , 2017, Front. Public Health.

[8]  Daniel McDuff,et al.  Remote measurement of cognitive stress via heart rate variability , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Ping Wang,et al.  Pulse Rate Variability Estimation Method Based on Sliding Window Iterative DFT and Hilbert Transform , 2014 .

[10]  Robert W Shields.  Heart rate variability with deep breathing as a clinical test of cardiovagal function , 2009, Cleveland Clinic Journal of Medicine.

[11]  Amruta Pai,et al.  CameraHRV: robust measurement of heart rate variability using a camera , 2018, BiOS.

[12]  Gerard de Haan,et al.  Robust Pulse Rate From Chrominance-Based rPPG , 2013, IEEE Transactions on Biomedical Engineering.

[13]  U. Rajendra Acharya,et al.  Heart rate variability: a review , 2006, Medical and Biological Engineering and Computing.

[14]  David L. Neuhoff,et al.  Quantization , 2022, IEEE Trans. Inf. Theory.

[15]  D. Nunan,et al.  A Quantitative Systematic Review of Normal Values for Short‐Term Heart Rate Variability in Healthy Adults , 2010, Pacing and clinical electrophysiology : PACE.

[16]  Frédéric Bousefsaf,et al.  Continuous wavelet filtering on webcam photoplethysmographic signals to remotely assess the instantaneous heart rate , 2013, Biomed. Signal Process. Control..

[17]  R. Maestri,et al.  Short-Term Heart Rate Variability Strongly Predicts Sudden Cardiac Death in Chronic Heart Failure Patients , 2003, Circulation.

[18]  E. D. de Geus,et al.  Validity of (Ultra-)Short Recordings for Heart Rate Variability Measurements , 2015, PloS one.

[19]  Po-Lei Lee,et al.  A Method for Respiration Rate Detection in Wrist PPG Signal Using Holo-Hilbert Spectrum , 2018, IEEE Sensors Journal.

[20]  Edwin H. Armstrong.  Frequency Modulation (fm) Tutorial , 2008 .

[21]  J. Taylor,et al.  Continuous assessment of hemodynamic control by complex demodulation of cardiovascular variability. , 1993, The American journal of physiology.

[22]  Petros Maragos,et al.  A comparison of the energy operator and the Hilbert transform approach to signal and speech demodulation , 1994, Signal Process..

[23]  H. Routledge,et al.  Heart rate variability – a therapeutic target? , 2002, Journal of clinical pharmacy and therapeutics.

[24]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[25]  P. Stein,et al.  Heart Rate Variability: Measurement and Clinical Utility , 2005, Annals of noninvasive electrocardiology : the official journal of the International Society for Holter and Noninvasive Electrocardiology, Inc.

[26]  Petros Maragos,et al.  Energy separation in signal modulations with application to speech analysis , 1993, IEEE Trans. Signal Process..

[27]  Allan Kardec Barros,et al.  Assessment of pulse rate variability by the method of pulse frequency demodulation , 2005 .

[28]  Ashok Veeraraghavan,et al.  DistancePPG: Robust non-contact vital signs monitoring using a camera , 2015, Biomedical optics express.

[29]  J. Saul,et al.  Beat-to-Beat Variations of Heart Rate Reflect Modulation of Cardiac Autonomic Outflow , 1990 .