Video Based Measurement of Heart Rate and Heart Rate Variability Spectrogram from Estimated Hemoglobin Information

In this paper, we propose an accurate remote observation of the heart rate (HR) and heart rate variability (HRV) based on extracted hemoglobin information which is based on detail skin optics model. We perform experiments to measure subjects at rest and under cognitive stress with the proposed method putting a polarized filter in front of camera to evaluate the principal of the framework. From the results of the experiments, the proposed method shows a high correlation with the electrocardiograph (ECG) which is assumed as the ground truth. We also evaluated the robustness against illumination change in simulation. We confirmed that the proposed method could obtain accurate BVP detection compared with other conventional methods since the proposed method eliminates the shading component through the process of the extraction of hemoglobin component.

[1]  Sander Stuijk,et al.  Algorithmic Principles of Remote PPG , 2017, IEEE Transactions on Biomedical Engineering.

[2]  S Cerutti,et al.  Spectral analysis of R-R and arterial pressure variabilities to assess sympatho-vagal interaction during mental stress in humans. , 1989, Journal of hypertension. Supplement : official journal of the International Society of Hypertension.

[3]  Atsushi Mase,et al.  Measurement of vital signal by microwave reflectometry and application to stress evaluation , 2009, 2009 Asia Pacific Microwave Conference.

[4]  Kristina Lauche,et al.  Development of a new product for unrestrained heart rate measurement in swimming: a user centered design approach , 2010 .

[5]  Sander Stuijk,et al.  A Novel Algorithm for Remote Photoplethysmography: Spatial Subspace Rotation , 2016, IEEE Transactions on Biomedical Engineering.

[6]  Norimichi Tsumura,et al.  Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin , 2003, ACM Trans. Graph..

[7]  Gheorghe Zaharia,et al.  Touch-less heartbeat detection and cardiopulmonary modeling , 2009, 2009 2nd International Symposium on Applied Sciences in Biomedical and Communication Technologies.

[8]  Jenshan Lin,et al.  Frequency-tuning technique for remote detection of heartbeat and respiration using low-power double-sideband transmission in the ka-band , 2006, IEEE Transactions on Microwave Theory and Techniques.

[9]  J. Scargle.  Studies in astronomical time series analysis. II - Statistical aspects of spectral analysis of unevenly spaced data , 1982 .

[10]  Daniel McDuff,et al.  Improvements in Remote Cardiopulmonary Measurement Using a Five Band Digital Camera , 2014, IEEE Transactions on Biomedical Engineering.

[11]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[12]  W. Press,et al.  Fast algorithm for spectral analysis of unevenly sampled data , 1989 .

[13]  M. Copet,et al.  A Monte Carlo investigation of optical pathlength in inhomogeneous tissue and its application to near-infrared spectroscopy , 1993 .

[14]  Shoji Yamamoto,et al.  Non-contact video-based estimation of heart rate variability spectrogram from hemoglobin composition , 2017, Artificial Life and Robotics.

[15]  A. Mase,et al.  Microwave Measurement of Heart Beat and Analysis Using Wavelet Transform , 2007, 2007 Asia-Pacific Microwave Conference.

[16]  Masatoshi Okutomi,et al.  Multispectral demosaicking using guided filter , 2012, Electronic Imaging.

[17]  S. Arridge,et al.  A Monte Carlo investigation of optical pathlength in inhomogeneous tissue and its application to near-infrared spectroscopy. , 1993, Physics in medicine and biology.

[18]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[19]  C. Takano,et al.  Heart rate measurement based on a time-lapse image. , 2007, Medical engineering & physics.

[20]  Masatoshi Okutomi,et al.  A Practical One-Shot Multispectral Imaging System Using a Single Image Sensor , 2015, IEEE Transactions on Image Processing.

[21]  Maja Pantic,et al.  Local Evidence Aggregation for Regression-Based Facial Point Detection , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Atsushi Mase,et al.  Measurement of heart rate variability and stress evaluation by using microwave reflectometric vital signal sensing. , 2010, The Review of scientific instruments.

[23]  German Da Costa,et al.  Optical remote sensing of heartbeats , 2001, SPIE Defense + Commercial Sensing.

[24]  Mika P. Tarvainen,et al.  An advanced detrending method with application to HRV analysis , 2002, IEEE Transactions on Biomedical Engineering.

[25]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[26]  D. Haan,et al.  Improved motion robustness of remote-PPG by using the blood volume pulse signature , 2014 .

[27]  Gerard de Haan,et al.  Robust Pulse Rate From Chrominance-Based rPPG , 2013, IEEE Transactions on Biomedical Engineering.

[28]  Changzhi Li,et al.  Random Body Movement Cancellation in Doppler Radar Vital Sign Detection , 2008, IEEE Transactions on Microwave Theory and Techniques.