Remote PhotoPlethysmoGraphy Using SPAD Camera for Automotive Health Monitoring Application

Remote PhotoPlethysmoGraphy (rPPG) applications allow to extract cardiac information just analyzing a video stream of a person face. In this work we propose the use of a Single-Photon Avalanche Diode (SPAD) camera in order to perform rPPG with higher accuracy, especially in low illumination conditions, exploiting the higher sensitivity of the SPAD sensors. In particular, we suggest the adoption of a rPPG application in an automotive environment in order to monitor, in a non invasive fashion, the driver's health state and potentially avoid accidents caused by acute illness states. Some quantitative results are shown obtained in realistic situations in which the SPAD camera was mounted inside a vehicle cockpit and compared with rPPG heart rate estimations data collected with a portable wearable ECG device.

[1]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[2]  H. Emrah Tasli,et al.  Remote PPG based vital sign measurement using adaptive facial regions , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[3]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[4]  W. Brockherde,et al.  100 000 Frames/s 64 × 32 Single-Photon Detector Array for 2-D Imaging and 3-D Ranging , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[5]  Reza Saatchi,et al.  Facial tracking method for noncontact respiration rate monitoring , 2010, 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010).

[6]  J. Movellan,et al.  Facial Video-Based Photoplethysmography to Detect HRV at Rest , 2015, International Journal of Sports Medicine.

[7]  Alberto Tosi,et al.  Automotive Three-Dimensional Vision Through a Single-Photon Counting SPAD Camera , 2016, IEEE Transactions on Intelligent Transportation Systems.

[8]  Raymond Chiong,et al.  Remote heart rate measurement using low-cost RGB face video: a technical literature review , 2018, Frontiers of Computer Science.

[9]  J. Crain,et al.  Fluorescence lifetime biosensing with DNA microarrays and a CMOS-SPAD imager , 2010, Biomedical optics express.

[10]  A. Lacaita,et al.  Avalanche photodiodes and quenching circuits for single-photon detection. , 1996, Applied optics.

[11]  Noa García Docampo,et al.  Heart rate estimation using facial video information , 2012 .

[12]  Shoji Yamamoto,et al.  Video Based Measurement of Heart Rate and Heart Rate Variability Spectrogram from Estimated Hemoglobin Information , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Alberto Tosi,et al.  Modeling of afterpulsing in single-photon avalanche diodes , 2011, OPTO.

[14]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Verena Dorner,et al.  Remote Photoplethysmography : Evaluation of Contactless Heart Rate Measurement in an Information Systems Setting , 2016 .

[17]  L. Mainardi,et al.  Relationships between heart-rate variability and pulse-rate variability obtained from video-PPG signal using ZCA , 2016, Physiological measurement.

[18]  Parth H. Pathak,et al.  Vital Sign and Sleep Monitoring Using Millimeter Wave , 2017, ACM Trans. Sens. Networks.

[19]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[20]  Gerard de Haan,et al.  Robust Pulse Rate From Chrominance-Based rPPG , 2013, IEEE Transactions on Biomedical Engineering.

[21]  Yu Sun,et al.  Use of ambient light in remote photoplethysmographic systems: comparison between a high-performance camera and a low-cost webcam. , 2012, Journal of biomedical optics.

[22]  A. Tosi,et al.  SPAD Figures of Merit for Photon-Counting, Photon-Timing, and Imaging Applications: A Review , 2016, IEEE Sensors Journal.

[23]  A. B. Hertzman Photoelectric Plethysmography of the Fingers and Toes in Man , 1937 .

[24]  Davide Contini,et al.  Enhanced single-photon time-of-flight 3D ranging. , 2015, Optics express.

[25]  S. Weiss,et al.  Silicon Photon-Counting Avalanche Diodes for Single-Molecule Fluorescence Spectroscopy , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[26]  Nicu Sebe,et al.  Self-Adaptive Matrix Completion for Heart Rate Estimation from Face Videos under Realistic Conditions , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Shreyas Sen,et al.  EM-Wave Biosensors: A Review of RF, Microwave, mm-Wave and Optical Sensing , 2019, Sensors.