Face-Based Heart Rate Signal Decomposition and Evaluation Using Multiple Linear Regression

Contact measurements of the cardiac pulse using the conventional electrocardiogram equipment requires patients to wear adhesive gel patches or chest straps that can cause skin irritation and discomfort. Commercially available pulse oximetry sensors that attach to the fingertips or earlobes also cause inconvenience for patients and the spring-loaded clips can be painful to use. Therefore, a novel robust non-contact technique is developed for the evaluation of heart rate variation. According to the periodic variation of reflectance strength resulting from changes to hemoglobin absorptivity across the visible light spectrum as heartbeats cause changes to blood volume in the blood vessels in the face, a reflectance signal is decomposed from consecutive frames of the green channel of the facial region. Furthermore, ensemble empirical mode decomposition of the Hilbert-Huang transform (HHT) is used to acquire the primary heart rate signal while reducing the effect of ambient light changes. The effective instantaneous frequencies from intrinsic mode functions decomposed by HHT are implemented by the multiple-linear regression model to evaluate heart rates before the frequencies were rectified by maximum likelihood method assuming Poisson distribution, and the minimum elapse time for heart rate evaluation is also evaluated in the estimate process. Experimental results show that our proposed approach provides a convenient non-contact method to evaluate heart rate and outperforms the current state-of-the-art method with higher accuracy and smaller variance.

[1]  H. A. Reid,et al.  Chinese Herbal Medicine , 1975 .

[2]  C. Takano,et al.  Heart rate measurement based on a time-lapse image. , 2007, Medical engineering & physics.

[3]  Cheng-Deng Kuo,et al.  Characteristics of heart rate variability can predict impending septic shock in emergency department patients with sepsis. , 2007, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[4]  Suh-Yin Lee,et al.  Image Sensor-Based Heart Rate Evaluation From Face Reflectance Using Hilbert–Huang Transform , 2015, IEEE Sensors Journal.

[5]  W. Zijlstra,et al.  Absorption spectra of human fetal and adult oxyhemoglobin, de-oxyhemoglobin, carboxyhemoglobin, and methemoglobin. , 1991, Clinical chemistry.

[6]  Sami Romdhani,et al.  Face identification across different poses and illuminations with a 3D morphable model , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[7]  Paolo Palatini,et al.  The role of cardiac autonomic function in hypertension and cardiovascular disease , 2009, Current hypertension reports.

[8]  David J. Kriegman,et al.  From few to many: generative models for recognition under variable pose and illumination , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  Malcolm Koo,et al.  Association between cardiovascular autonomic functions and time to death in patients with terminal hepatocellular carcinoma. , 2010, Journal of pain and symptom management.

[10]  Ralph Gross,et al.  An Image Preprocessing Algorithm for Illumination Invariant Face Recognition , 2003, AVBPA.

[11]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[12]  Frank Tong,et al.  Foundations of Vision , 2018 .

[13]  David J. Kriegman,et al.  Illumination cones for recognition under variable lighting: faces , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[14]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[15]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[16]  Stéphane Cook,et al.  High heart rate: a cardiovascular risk factor? , 2006, European heart journal.

[17]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[18]  Cheng-Deng Kuo,et al.  Heart rate variability predicts short-term outcome for successfully resuscitated patients with out-of-hospital cardiac arrest. , 2009, Resuscitation.

[19]  T. Komatsu,et al.  Heart rate variability during massive hemorrhage and progressive hemorrhagic shock in dogs , 2000, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[20]  David J. Kriegman,et al.  What Is the Set of Images of an Object Under All Possible Illumination Conditions? , 1998, International Journal of Computer Vision.

[21]  W. Marsden I and J , 2012 .

[22]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[23]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[24]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[25]  L. Tarassenko,et al.  Non-contact video-based vital sign monitoring using ambient light and auto-regressive models , 2014, Physiological measurement.

[26]  Cozza,et al.  Usefulness of heart rate variability as a predictor of sudden cardiac death in muscular dystrophies. , 2008, Acta myologica : myopathies and cardiomyopathies : official journal of the Mediterranean Society of Myology.

[27]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..