Bounded Kalman filter method for motion-robust, non-contact heart rate estimation.

The authors of this work present a real-time measurement of heart rate across different lighting conditions and motion categories. This is an advancement over existing remote Photo Plethysmography (rPPG) methods that require a static, controlled environment for heart rate detection, making them impractical for real-world scenarios wherein a patient may be in motion, or remotely connected to a healthcare provider through telehealth technologies. The algorithm aims to minimize motion artifacts such as blurring and noise due to head movements (uniform, random) by employing i) a blur identification and denoising algorithm for each frame and ii) a bounded Kalman filter technique for motion estimation and feature tracking. A case study is presented that demonstrates the feasibility of the algorithm in non-contact estimation of the pulse rate of subjects performing everyday head and body movements. The method in this paper outperforms state of the art rPPG methods in heart rate detection, as revealed by the benchmarked results.

[1]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[2]  Marc Mateu-Mateus,et al.  RR time series comparison obtained by H7 polar sensors or by photoplethysmography using smartphones: breathing and devices influences , 2015 .

[3]  V. C. Roberts,et al.  Photoplethysmography- fundamental aspects of the optical properties of blood in motion , 1982 .

[4]  Suh-Yin Lee,et al.  Image Sensor-Based Heart Rate Evaluation From Face Reflectance Using Hilbert–Huang Transform , 2015, IEEE Sensors Journal.

[5]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[6]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[7]  David A. Clausi,et al.  A spectral-spatial fusion model for robust blood pulse waveform extraction in photoplethysmographic imaging , 2016, Biomedical optics express.

[8]  M J Butler,et al.  Motion limitations of non-contact photoplethysmography due to the optical and topological properties of skin , 2016, Physiological measurement.

[9]  Matti Pietikäinen,et al.  Multiscale Local Phase Quantization for Robust Component-Based Face Recognition Using Kernel Fusion of Multiple Descriptors , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[11]  Daniel McDuff,et al.  Improvements in Remote Cardiopulmonary Measurement Using a Five Band Digital Camera , 2014, IEEE Transactions on Biomedical Engineering.

[12]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[13]  Frédo Durand,et al.  Eulerian video magnification and analysis , 2016, Commun. ACM.

[14]  Conrad S. Tucker,et al.  A quantitative method for evaluating the complexity of implementing and performing game features in physically-interactive gamified applications , 2017, Comput. Hum. Behav..

[15]  Zheng Li,et al.  On the benefits of alternative color spaces for noncontact heart rate measurements using standard red-green-blue cameras , 2015, Journal of biomedical optics.

[16]  J. Goodie,et al.  Validation of the Polar Heart Rate Monitor for Assessing Heart Rate During Physical and Mental Stress , 2000 .

[17]  H F Mahieu,et al.  Photoelectric plethysmography--some fundamental aspects of the reflection and transmission method. , 1981, Clinical physics and physiological measurement : an official journal of the Hospital Physicists' Association, Deutsche Gesellschaft fur Medizinische Physik and the European Federation of Organisations for Medical Physics.

[18]  W. Hopkins,et al.  Effects of Training Load and Leg Dominance on Achilles and Patellar Tendon Structure. , 2017, International journal of sports physiology and performance.

[19]  Sander Stuijk,et al.  A Novel Algorithm for Remote Photoplethysmography: Spatial Subspace Rotation , 2016, IEEE Transactions on Biomedical Engineering.

[20]  J O ELAM,et al.  Influence of oxygen saturation, erythrocyte concentration and optical depth upon the red and near-infrared light transmittance of whole blood. , 1951, The American journal of physiology.

[21]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[22]  Gerard de Haan,et al.  Robust Pulse Rate From Chrominance-Based rPPG , 2013, IEEE Transactions on Biomedical Engineering.

[23]  M. Polanyi,et al.  In vivo studies with an intravascular and intracardiac reflection oximeter. , 1962, Journal of applied physiology.

[24]  Ashok Veeraraghavan,et al.  DistancePPG: Robust non-contact vital signs monitoring using a camera , 2015, Biomedical optics express.

[25]  A. Jeukendrup,et al.  Heart Rate Monitoring , 2003, Sports medicine.

[26]  W G Zijlstra,et al.  Determination of hemoglobin and its derivatives. , 1965, Advances in clinical chemistry.

[27]  David Giles,et al.  Validity of the Polar V800 heart rate monitor to measure RR intervals at rest , 2015, European Journal of Applied Physiology.

[28]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[29]  Arindam Sikdar,et al.  Computer-Vision-Guided Human Pulse Rate Estimation: A Review , 2016, IEEE Reviews in Biomedical Engineering.

[30]  Conrad S. Tucker,et al.  Automatic Facial Feature Extraction for Predicting Designers' Comfort With Engineering Equipment During Prototype Creation , 2017 .

[31]  Matthew L. Dering,et al.  An Unsupervised Machine Learning Approach to Assessing Designer Performance During Physical Prototyping , 2018, J. Comput. Inf. Sci. Eng..

[32]  Sander Stuijk,et al.  Amplitude-selective filtering for remote-PPG. , 2017, Biomedical optics express.

[33]  P. Laursen,et al.  Training Intensity Distribution Over a Four-Year Cycle in Olympic Champion Rowers: Different Roads Lead to Rio. , 2017, International journal of sports physiology and performance.

[34]  Chern-Loon Lim,et al.  Dynamic heart rate estimation using principal component analysis. , 2015, Biomedical optics express.

[35]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[36]  Sander Stuijk,et al.  Exploiting Spatial Redundancy of Image Sensor for Motion Robust rPPG , 2015, IEEE Transactions on Biomedical Engineering.

[37]  Ki Hwan Eom,et al.  Improved Kalman Filter Method for Measurement Noise Reduction in Multi Sensor RFID Systems , 2011, Sensors.

[38]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .