A multispectral testbed for cardiovascular sensing using imaging photoplethysmography

Imaging photoplethysmography uses image sensors to measure changes in light absorption resulting from skin microvascular blood volume pulsations throughout the cardiac cycle. Imaging photoplethysmography has been demonstrated as an effective, non-contact means of assessing pulse rate, pulse rate variability, and respiration rate. Other potential uses include measuring spatial blood perfusion, oxygenation, and flow dynamics. Herein we demonstrate the development of a multispectral testbed for imaging photoplethysmography consisting of 12 monochromatic, 120fps imagers with 50nm, bandpass filters distributed from 400-750nm and contained in a 3D-printed, 4x3 grid housing mounted on a tripod positioned orthogonal to the subject. A co-located dual-CCD RGB/near-infrared imager records conventional RGB and NIR images expanding the spectral window recorded. After image registration, a multispectral image cube of the 13, partially overlapping bands is created. A spectrometer records high (spectral) resolution data from the participant’s right cheek using a collimating lens attached to the measurement fiber. In addition, a spatial array of 5 RGB imagers placed at 0°, ±20° and ±40° positions with respect to the subject is employed for motion and spatial robustness. All imagers are synchronized by a hardware trigger source synchronized with a reference, physiological measurement device recording the subject’s electrocardiography, bilateral fingertip and/or ear lobe photoplethysmography, bilateral galvanic skin response, and respiration signals. The development of the testbed and pilot data is presented. A full-scale evaluation of the spectral components of the imaging photoplethysmographic signal, optimization of iPPG SNR, and spatial perfusion and blood flow dynamics is currently underway.

[1]  B. Li,et al.  Non-contact detection of oxygen saturation based on visible light imaging device using ambient light. , 2013, Optics express.

[2]  Ethan B. Blackford,et al.  Recovering pulse rate during motion artifact with a multi-imager array for non-contact imaging photoplethysmography , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[3]  T. Fitzpatrick The validity and practicality of sun-reactive skin types I through VI. , 1988, Archives of dermatology.

[4]  Daniel McDuff,et al.  Real-Time Physiological Measurement and Visualization Using a Synchronized Multi-camera System , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Albert van der Veen,et al.  Development of a baby friendly non-contact method for measuring vital signs: First results of clinical measurements in an open incubator at a neonatal intensive care unit , 2014, Photonics West - Biomedical Optics.

[6]  Janko Drnovsek,et al.  Non-contact heart rate and heart rate variability measurements: A review , 2014, Biomed. Signal Process. Control..

[7]  Daniel McDuff,et al.  A survey of remote optical photoplethysmographic imaging methods , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  L. Tarassenko,et al.  Continuous non-contact vital sign monitoring in neonatal intensive care unit , 2014, Healthcare technology letters.

[9]  Steffen Leonhardt,et al.  Hybrid optical imaging technology for long-term remote monitoring of skin perfusion and temperature behavior , 2014, Journal of biomedical optics.

[10]  Sander Stuijk,et al.  Algorithmic Principles of Remote PPG , 2017, IEEE Transactions on Biomedical Engineering.

[11]  D. Haan,et al.  Improved motion robustness of remote-PPG by using the blood volume pulse signature , 2014 .

[12]  Sijung Hu,et al.  Development of effective photoplethysmographic measurement techniques: From contact to non-contact and from point to imaging , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Daniel McDuff,et al.  Improvements in Remote Cardiopulmonary Measurement Using a Five Band Digital Camera , 2014, IEEE Transactions on Biomedical Engineering.

[14]  W. Verkruysse,et al.  Non-contact heart rate monitoring utilizing camera photoplethysmography in the neonatal intensive care unit - a pilot study. , 2013, Early human development.

[15]  Daniel Teichmann,et al.  Non-contact monitoring techniques - Principles and applications , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Sander Stuijk,et al.  Robust respiration detection from remote photoplethysmography. , 2016, Biomedical optics express.

[17]  Sijung Hu,et al.  Opto-physiological modeling applied to photoplethysmographic cardiovascular assessment. , 2013, Journal of healthcare engineering.

[18]  Ethan B. Blackford,et al.  Effects of frame rate and image resolution on pulse rate measured using multiple camera imaging photoplethysmography , 2015, Medical Imaging.

[19]  M. Strojnik,et al.  A photoplethysmographic imaging system with supplementary capabilities , 2014 .

[20]  Rachit Mohan,et al.  The importance of illumination in a non-contact photoplethysmography imaging system for burn wound assessment , 2015, Photonics West - Biomedical Optics.

[21]  Yadong Wang,et al.  A review of non-contact, low-cost physiological information measurement based on photoplethysmographic imaging , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Yu Sun,et al.  Photoplethysmography Revisited: From Contact to Noncontact, From Point to Imaging , 2016, IEEE Transactions on Biomedical Engineering.

[23]  Sander Stuijk,et al.  Motion Robust Remote-PPG in Infrared , 2015, IEEE Transactions on Biomedical Engineering.

[24]  Daniel McDuff,et al.  Remote measurement of cognitive stress via heart rate variability , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  J. Vagedes,et al.  How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram. , 2013, International journal of cardiology.

[26]  Sander Stuijk,et al.  New principle for measuring arterial blood oxygenation, enabling motion-robust remote monitoring , 2016, Scientific Reports.

[27]  Sijung Hu,et al.  A study of opto-physiological modeling to quantify tissue absorbance in imaging photoplethysmography , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[28]  Marija Strojnik,et al.  Optimal wavelength selection for noncontact reflection photoplethysmography , 2011, International Commission for Optics.

[29]  Yuting Yang,et al.  Noncontact Monitoring Breathing Pattern, Exhalation Flow Rate and Pulse Transit Time , 2014, IEEE Transactions on Biomedical Engineering.

[30]  Daniel McDuff,et al.  COGCAM: Contact-free Measurement of Cognitive Stress During Computer Tasks with a Digital Camera , 2016, CHI.

[31]  Westgate Road,et al.  Photoplethysmography and its application in clinical physiological measurement , 2007 .