A survey of remote optical photoplethysmographic imaging methods

In recent years researchers have presented a number of new methods for recovering physiological parameters using just low-cost digital cameras and image processing. The ubiquity of digital cameras presents the possibility for many new, low-cost applications of vital sign monitoring. In this paper we present a review of the work on remote photoplethysmographic (PPG) imaging using digital cameras. This review specifically focuses on the state-of-the-art in PPG imaging where: 1) measures beyond pulse rate are evaluated, 2) non-ideal conditions (e.g., the presence of motion artifacts) are explored, and 3) use cases in relevant environments are demonstrated. We discuss gaps within the literature and future challenges for the research community. To aid in the continuing advancement of PPG imaging research, we are making available a website with the references collected for this review as well as information on available code and datasets of interest. It is our hope that this website will become a valuable resource for the PPG imaging community. The site can be found at: http://web.mit.edu/~djmcduff/www/ remote-physiology.html.

[1]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[2]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  W. Verkruysse,et al.  Non-contact heart rate monitoring utilizing camera photoplethysmography in the neonatal intensive care unit - a pilot study. , 2013, Early human development.

[4]  Yu Sun,et al.  Motion-compensated noncontact imaging photoplethysmography to monitor cardiorespiratory status during exercise. , 2011, Journal of biomedical optics.

[5]  Steffen Leonhardt,et al.  Frequency-selective quantification of skin perfusion behavior during allergic testing using photoplethysmography imaging , 2014, Medical Imaging.

[6]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[7]  Gerard de Haan,et al.  Robust Pulse Rate From Chrominance-Based rPPG , 2013, IEEE Transactions on Biomedical Engineering.

[8]  Daniel McDuff,et al.  Improvements in Remote Cardiopulmonary Measurement Using a Five Band Digital Camera , 2014, IEEE Transactions on Biomedical Engineering.

[9]  Vladimir Blazek,et al.  Photoplethysmography imaging: a new noninvasive and noncontact method for mapping of the dermal perfusion changes , 2000, European Conference on Biomedical Optics.

[10]  T. Ward,et al.  Noncontact simultaneous dual wavelength photoplethysmography: a further step toward noncontact pulse oximetry. , 2007, The Review of scientific instruments.

[11]  Yuejin Zhao,et al.  Non-contact detection of cardiac rate based on visible light imaging device , 2012, Optical Engineering + Applications.

[12]  David A. Clausi,et al.  High-resolution motion-compensated imaging photoplethysmography for remote heart rate monitoring , 2015, Photonics West - Biomedical Optics.

[13]  Yisheng Zhu,et al.  A Preliminary Attempt to Understand Compatibility of Photoplethysmographic Pulse Rate Variability with Electrocardiogramic Heart Rate Variability , 2008 .

[14]  David A. Clausi,et al.  Illumination-compensated non-contact imaging photoplethysmography via dual-mode temporally coded illumination , 2015, Photonics West - Biomedical Optics.

[15]  Matti Pietikäinen,et al.  Remote Heart Rate Measurement from Face Videos under Realistic Situations , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Yuting Yang,et al.  Noncontact Monitoring Breathing Pattern, Exhalation Flow Rate and Pulse Transit Time , 2014, IEEE Transactions on Biomedical Engineering.

[17]  Hagen Malberg,et al.  ROI Selection for Remote Photoplethysmography , 2013, Bildverarbeitung für die Medizin.

[18]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[19]  Daniel McDuff,et al.  Remote Detection of Photoplethysmographic Systolic and Diastolic Peaks Using a Digital Camera , 2014, IEEE Transactions on Biomedical Engineering.

[20]  Albert van der Veen,et al.  Development of a baby friendly non-contact method for measuring vital signs: First results of clinical measurements in an open incubator at a neonatal intensive care unit , 2014, Photonics West - Biomedical Optics.

[21]  Ethan B. Blackford,et al.  Recovering pulse rate during motion artifact with a multi-imager array for non-contact imaging photoplethysmography , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[22]  Janko Drnovsek,et al.  Non-contact heart rate and heart rate variability measurements: A review , 2014, Biomed. Signal Process. Control..

[23]  Alexei A. Kamshilin,et al.  Photoplethysmographic imaging of high spatial resolution , 2011, Biomedical optics express.

[24]  Marc Garbey,et al.  Contact-Free Measurement of Cardiac Pulse Based on the Analysis of Thermal Imagery , 2007, IEEE Transactions on Biomedical Engineering.

[25]  Yadong Wang,et al.  A review of non-contact, low-cost physiological information measurement based on photoplethysmographic imaging , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Verónica Pérez-Rosas,et al.  Towards sensing the influence of visual narratives on human affect , 2012, ICMI '12.

[27]  Giovanni Cennini,et al.  Heart rate monitoring via remote photoplethysmography with motion artifacts reduction. , 2010, Optics express.

[28]  Sander Stuijk,et al.  Motion Robust Remote-PPG in Infrared , 2015, IEEE Transactions on Biomedical Engineering.

[29]  Kwang Suk Park,et al.  Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Sander Stuijk,et al.  Exploiting Spatial Redundancy of Image Sensor for Motion Robust rPPG , 2015, IEEE Transactions on Biomedical Engineering.

[31]  Roy Kalawsky,et al.  Noncontact imaging photoplethysmography to effectively access pulse rate variability , 2012, Journal of biomedical optics.

[32]  Daniel McDuff,et al.  Remote measurement of cognitive stress via heart rate variability , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  F. Mastik,et al.  Contactless Multiple Wavelength Photoplethysmographic Imaging: A First Step Toward “SpO2 Camera” Technology , 2005, Annals of Biomedical Engineering.

[34]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[35]  C. Takano,et al.  Heart rate measurement based on a time-lapse image. , 2007, Medical engineering & physics.

[36]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[37]  D. Haan,et al.  Improved motion robustness of remote-PPG by using the blood volume pulse signature , 2014 .

[38]  L. Tarassenko,et al.  Non-contact video-based vital sign monitoring using ambient light and auto-regressive models , 2014, Physiological measurement.

[39]  Sijung Hu,et al.  Development of effective photoplethysmographic measurement techniques: From contact to non-contact and from point to imaging , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Westgate Road,et al.  Photoplethysmography and its application in clinical physiological measurement , 2007 .

[41]  Ki H. Chon,et al.  Physiological Parameter Monitoring from Optical Recordings With a Mobile Phone , 2012, IEEE Transactions on Biomedical Engineering.

[42]  Marija Strojnik,et al.  Optimal wavelength selection for noncontact reflection photoplethysmography , 2011, International Commission for Optics.

[43]  H. Emrah Tasli,et al.  Remote PPG based vital sign measurement using adaptive facial regions , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[44]  Ethan B. Blackford,et al.  Effects of frame rate and image resolution on pulse rate measured using multiple camera imaging photoplethysmography , 2015, Medical Imaging.

[45]  Yu Sun,et al.  Use of ambient light in remote photoplethysmographic systems: comparison between a high-performance camera and a low-cost webcam. , 2012, Journal of biomedical optics.

[46]  U. Rubins,et al.  The analysis of blood flow changes under local anesthetic input using non-contact technique , 2010, 2010 3rd International Conference on Biomedical Engineering and Informatics.

[47]  W. Zijlstra,et al.  Absorption spectra of human fetal and adult oxyhemoglobin, de-oxyhemoglobin, carboxyhemoglobin, and methemoglobin. , 1991, Clinical chemistry.

[48]  Daniel Teichmann,et al.  Non-contact monitoring techniques - Principles and applications , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.