Continuous Real-time Heart Rate Monitoring from Face Images

A real-time monitoring method of heart rate (HR) from face images using Real-time Pulse Extraction Method (RPEM) is described and corroborated for the theoretical efficacy by investigating fundamental mechanisms through three kinds of experiments; (i) measurement of light reflection from face covered by copper film, (ii) spectroscopy measurement and (iii) simultaneous measurement of face images and laser speckle images. The investigation indicated the main causes of brightness change are both the green light absorption variation by the blood volume changes and the face surface reflection variation by pulsatory face movements. RPEM removes the motion noise from the green light absorption variation and the effectiveness is ensured by comparing with the pulse wave of the ear photoplethysmography. We also applied RPEM to continuous real-time HR monitoring of seven participants during office work under non-controlled condition, and achieved HR measured rate of 44 % to the number of referential ECG beats while face is detected, with RMSE = 6.7 bpm as an average result of five days.

[1]  H A Lindberg,et al.  Heart rate as a prognostic factor for coronary heart disease and mortality: findings in three Chicago epidemiologic studies. , 1980, American journal of epidemiology.

[2]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[3]  Andrea Mortara,et al.  Heart rate as a prognostic marker and therapeutic target in acute and chronic heart failure. , 2018, International journal of cardiology.

[4]  Kwang Suk Park,et al.  Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Finn Gyntelberg,et al.  Elevated resting heart rate, physical fitness and all-cause mortality: a 16-year follow-up in the Copenhagen Male Study , 2013, Heart.

[6]  Yoshinori Yaginuma,et al.  Hassle-free Sensing Technologies for Monitoring Daily Health Changes , 2014 .

[7]  Nikolaos G. Bourbakis,et al.  A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Matti Pietikäinen,et al.  Remote Heart Rate Measurement from Face Videos under Realistic Situations , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Kevin R. Forrester,et al.  A laser speckle imaging technique for measuring tissue perfusion , 2004, IEEE Transactions on Biomedical Engineering.

[10]  C. Takano,et al.  Heart rate measurement based on a time-lapse image. , 2007, Medical engineering & physics.

[11]  J M Steinke,et al.  Effects of temperature on optical absorbance spectra of oxy-, carboxy-, and deoxyhemoglobin. , 1992, Clinical chemistry.

[12]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.