Non-Contact Reflectance Photoplethysmography: Progress, Limitations, and Myths

Photoplethysmography (PPG) is a non-invasive method of measuring changes of blood volume in human tissue. The literature on non-contact reflectance PPG related to cardiovascular activity is extensively reviewed. We identify key factors limiting the performance of the PPG methods and reproducibility of the research as: a lack of publicly available datasets and incomplete description of data used in published experiments (missing details on video compression, lighting setup and subject's skin type), use of unreliable pulse oximeter devices for ground-truth reference and missing standard experimental protocols. Two experiments with 5 participants are presented showing that the quality of the reconstructed signal (1) is adversely affected by a reduction of spatial resolution that also amplifies the effects of H.264 video compression and (2) is improved by precise pixel-to-pixel stabilization.

[1]  John A. Crowe,et al.  The wavelength dependence of the photoplethysmogram and its implication to pulse oximetry , 1992, 1992 14th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Vladimir Blazek,et al.  Photoplethysmography imaging: a new noninvasive and noncontact method for mapping of the dermal perfusion changes , 2000, European Conference on Biomedical Optics.

[3]  Gerard de Haan,et al.  Robust Pulse Rate From Chrominance-Based rPPG , 2013, IEEE Transactions on Biomedical Engineering.

[4]  Renate Huch,et al.  LIMITATIONS OF PULSE OXIMETRY , 1988, The Lancet.

[5]  D. Wax,et al.  A Comparison of Transmittance and Reflectance Pulse Oximetry During Vascular Surgery , 2009, Anesthesia and analgesia.

[6]  M. Nitzan,et al.  The difference in pulse transit time to the toe and finger measured by photoplethysmography. , 2002, Physiological measurement.

[7]  Ashok Veeraraghavan,et al.  DistancePPG: Robust non-contact vital signs monitoring using a camera , 2015, Biomedical optics express.

[8]  Daniel McDuff,et al.  Improvements in Remote Cardiopulmonary Measurement Using a Five Band Digital Camera , 2014, IEEE Transactions on Biomedical Engineering.

[9]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[10]  H. Pälve,et al.  Reflection and transmission pulse oximetry during compromised peripheral perfusion , 2005, Journal of Clinical Monitoring.

[11]  L. Tarassenko,et al.  Continuous non-contact vital sign monitoring in neonatal intensive care unit , 2014, Healthcare technology letters.

[12]  N. Nesseler,et al.  Pulse oximetry and high-dose vasopressors: a comparison between forehead reflectance and finger transmission sensors , 2012, Intensive Care Medicine.

[13]  Oleg V Mamontov,et al.  Influence of a skin status on the light interaction with dermis. , 2015, Biomedical optics express.

[14]  X. Teng,et al.  The effect of contacting force on photoplethysmographic signals , 2004, Physiological measurement.

[15]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[16]  R. Romashko,et al.  A new look at the essence of the imaging photoplethysmography , 2015, Scientific Reports.

[17]  Hagen Malberg,et al.  Improved heart rate detection for camera-based photoplethysmography by means of Kalman filtering , 2015, 2015 IEEE 35th International Conference on Electronics and Nanotechnology (ELNANO).

[18]  Shuchang Xu,et al.  Robust efficient estimation of heart rate pulse from video. , 2014, Biomedical optics express.

[19]  D. Haan,et al.  Improved motion robustness of remote-PPG by using the blood volume pulse signature , 2014 .

[20]  L. Tarassenko,et al.  Non-contact video-based vital sign monitoring using ambient light and auto-regressive models , 2014, Physiological measurement.

[21]  Daniel McDuff,et al.  Remote Detection of Photoplethysmographic Systolic and Diastolic Peaks Using a Digital Camera , 2014, IEEE Transactions on Biomedical Engineering.

[22]  Hirofumi Tanaka,et al.  Influence of skin type and wavelength on light wave reflectance , 2013, Journal of Clinical Monitoring and Computing.

[23]  Ethan B. Blackford,et al.  Recovering pulse rate during motion artifact with a multi-imager array for non-contact imaging photoplethysmography , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[24]  Ki H. Chon,et al.  Physiological Parameter Monitoring from Optical Recordings With a Mobile Phone , 2012, IEEE Transactions on Biomedical Engineering.

[25]  Marija Strojnik,et al.  Optimal wavelength selection for noncontact reflection photoplethysmography , 2011, International Commission for Optics.

[26]  L. Mainardi,et al.  Relationships between heart-rate variability and pulse-rate variability obtained from video-PPG signal using ZCA , 2016, Physiological measurement.

[27]  Daniel McDuff,et al.  The Impact of Video Compression on Remote Cardiac Pulse Measurement Using Imaging Photoplethysmography , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[28]  Lai-Man Po,et al.  Block-based adaptive ROI for remote photoplethysmography , 2018, Multimedia Tools and Applications.

[29]  Andreia Vieira Moco,et al.  Ballistocardiographic Artifacts in PPG Imaging , 2016, IEEE Transactions on Biomedical Engineering.

[30]  W. Cui,et al.  In vivo reflectance of blood and tissue as a function of light wavelength , 1990, IEEE Transactions on Biomedical Engineering.

[31]  Sander Stuijk,et al.  Exploiting Spatial Redundancy of Image Sensor for Motion Robust rPPG , 2015, IEEE Transactions on Biomedical Engineering.

[32]  T. Fitzpatrick The validity and practicality of sun-reactive skin types I through VI. , 1988, Archives of dermatology.

[33]  Rashid Giniatullin,et al.  Accurate measurement of the pulse wave delay with imaging photoplethysmography. , 2016, Biomedical optics express.

[34]  Roy Kalawsky,et al.  Noncontact imaging photoplethysmography to effectively access pulse rate variability , 2012, Journal of biomedical optics.

[35]  Michael Kniazuk,et al.  A NEW BLOODLESS METHOD FOR CONTINUOUS RECORDING OF PERIPHERAL CIRCULATORY CHANGES , 1936 .

[36]  Thomas B. Moeslund,et al.  Estimation of Heartbeat Peak Locations and Heartbeat Rate from Facial Video , 2017, SCIA.

[37]  Westgate Road,et al.  Photoplethysmography and its application in clinical physiological measurement , 2007 .

[38]  C. Takano,et al.  Heart rate measurement based on a time-lapse image. , 2007, Medical engineering & physics.

[39]  Peter J Lesniewski,et al.  Signal recovery in imaging photoplethysmography , 2013, Physiological measurement.

[40]  Shinobu Tanaka,et al.  Comparison between red, green and blue light reflection photoplethysmography for heart rate monitoring during motion , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[41]  Ethan B. Blackford,et al.  Effects of frame rate and image resolution on pulse rate measured using multiple camera imaging photoplethysmography , 2015, Medical Imaging.

[42]  Sander Stuijk,et al.  Motion robust PPG-imaging through color channel mapping , 2016, Biomedical optics express.

[43]  W. Verkruysse,et al.  Non-contact heart rate monitoring utilizing camera photoplethysmography in the neonatal intensive care unit - a pilot study. , 2013, Early human development.

[44]  Horst-Michael Groß,et al.  Non-contact video-based pulse rate measurement on a mobile service robot , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[45]  A. Buchs,et al.  Right-left correlation of the sympathetically induced fluctuations of photoplethysmographic signal in diabetic and non-diabetic subjects , 2006, Medical and Biological Engineering and Computing.

[46]  Yuejin Zhao,et al.  Non-contact detection of cardiac rate based on visible light imaging device , 2012, Optical Engineering + Applications.

[47]  David Fofi,et al.  Heart rate estimation using facial video: A review , 2017, Biomed. Signal Process. Control..

[48]  J. Movellan,et al.  Facial Video-Based Photoplethysmography to Detect HRV at Rest , 2015, International Journal of Sports Medicine.

[49]  Winston H. Hsu,et al.  Learning-based heart rate detection from remote photoplethysmography features , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[50]  L. Tarassenko,et al.  Photoplethysmographic derivation of respiratory rate: a review of relevant physiology , 2012, Journal of medical engineering & technology.

[51]  Dan H. Nicolson,et al.  Composition of Scientific Words , 2000 .

[52]  Sander Stuijk,et al.  Robust heart rate from fitness videos , 2017, Physiological measurement.

[53]  S. Barker,et al.  Effects of motion, ambient light, and hypoperfusion on pulse oximeter function , 1997 .

[54]  J. Vagedes,et al.  How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram. , 2013, International journal of cardiology.

[55]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Bruce D. Johnson,et al.  The Impact of Averaging Window Length on the"Desaturation Indexes during Overnight Pulse Oximetry at High-Altitude". , 2015, Sleep.

[57]  Janis Spigulis,et al.  Real-Time Photoplethysmography Imaging System , 2011 .

[58]  Yadong Wang,et al.  A review of non-contact, low-cost physiological information measurement based on photoplethysmographic imaging , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[59]  Chern-Loon Lim,et al.  Dynamic heart rate measurements from video sequences. , 2015, Biomedical optics express.

[60]  Yu Sun,et al.  Photoplethysmography Revisited: From Contact to Noncontact, From Point to Imaging , 2016, IEEE Transactions on Biomedical Engineering.

[61]  Sander Stuijk,et al.  Motion Robust Remote-PPG in Infrared , 2015, IEEE Transactions on Biomedical Engineering.