An Evaluation of Non-Contact Photoplethysmography-Based Methods for Remote Respiratory Rate Estimation

The respiration rate (RR) is one of the physiological signals deserving monitoring for assessing human health and emotional states. However, traditional devices, such as the respiration belt to be worn around the chest, are not always a feasible solution (e.g., telemedicine, device discomfort). Recently, novel approaches have been proposed aiming at estimating RR in a less invasive yet reliable way, requiring the acquisition and processing of contact or remote Photoplethysmography (contact reference and remote-PPG, respectively). The aim of this paper is to address the lack of systematic evaluation of proposed methods on publicly available datasets, which currently impedes a fair comparison among them. In particular, we evaluate two prominent families of PPG processing methods estimating Respiratory Induced Variations (RIVs): the first encompasses methods based on the direct extraction of morphological features concerning the RR; and the second group includes methods modeling respiratory artifacts adopting, in the most promising cases, single-channel blind source separation. Extensive experiments have been carried out on the public BP4D+ dataset, showing that the morphological estimation of RIVs is more reliable than those produced by a single-channel blind source separation method (both in contact and remote testing phases), as well as in comparison with a representative state-of-the-art Deep Learning-based approach for remote respiratory information estimation.

[1]  Daniel McDuff,et al.  Camera Measurement of Physiological Vital Signs , 2021, ACM Comput. Surv..

[2]  Donatello Conte,et al.  pyVHR: a Python framework for remote photoplethysmography , 2022, PeerJ Comput. Sci..

[3]  Richard H. Y. So,et al.  Deep Learning Methods for Remote Heart Rate Measurement: A Review and Future Research Agenda , 2021, Sensors.

[4]  M. Sawan,et al.  Contact and Remote Breathing Rate Monitoring Techniques: A Review , 2021, IEEE Sensors Journal.

[5]  Nasser Kehtarnavaz,et al.  A Review of Deep Learning-Based Contactless Heart Rate Measurement Methods , 2021, Sensors.

[6]  Eui Chul Lee,et al.  Non-Contact Respiration Measurement Method Based on RGB Camera Using 1D Convolutional Neural Networks , 2021, Sensors.

[7]  Mark W. Woolrich,et al.  EMD: Empirical Mode Decomposition and Hilbert-Huang Spectral Analyses in Python , 2021, J. Open Source Softw..

[8]  Massimo Materassi,et al.  New insights and best practices for the successful use of Empirical Mode Decomposition, Iterative Filtering and derived algorithms , 2020, Scientific Reports.

[9]  Xin Liu,et al.  Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement , 2020, NeurIPS.

[10]  Mohammad Fraiwan,et al.  Smartphone-based respiratory rate estimation using photoplethysmographic imaging and discrete wavelet transform , 2020, J. Ambient Intell. Humaniz. Comput..

[11]  Giuliano Grossi,et al.  An Open Framework for Remote-PPG Methods and Their Assessment , 2020, IEEE Access.

[12]  Ayoub Al-Hamadi,et al.  Fusion-Based Approach for Respiratory Rate Recognition From Facial Video Images , 2020, IEEE Access.

[13]  G. Dumont,et al.  Extracting Instantaneous Respiratory Rate From Multiple Photoplethysmogram Respiratory-Induced Variations , 2018, Front. Physiol..

[14]  Rahim Mahmoudvand,et al.  Singular Spectrum Analysis , 2018 .

[15]  Jesús Lázaro,et al.  Finger and forehead PPG signal comparison for respiratory rate estimation , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[16]  David A. Clifton,et al.  Towards a Robust Estimation of Respiratory Rate from Pulse Oximeters , 2016 .

[17]  Xiao-pei Wu,et al.  Non-contact, synchronous dynamic measurement of respiratory rate and heart rate based on dual sensitive regions , 2017, Biomedical engineering online.

[18]  Gianluigi Ferrari,et al.  Monitoring infants by automatic video processing: A unified approach to motion analysis , 2017, Comput. Biol. Medicine.

[19]  Jesús Lázaro,et al.  Inclusion of Respiratory Frequency Information in Heart Rate Variability Analysis for Stress Assessment , 2016, IEEE Journal of Biomedical and Health Informatics.

[20]  P. Laguna,et al.  Respiratory rate derived from smartphone-camera-acquired pulse photoplethysmographic signals , 2015, Physiological measurement.

[21]  Guy A. Dumont,et al.  Estimation of Respiratory Rate From Photoplethysmographic Imaging Videos Compared to Pulse Oximetry , 2015, IEEE Journal of Biomedical and Health Informatics.

[22]  K. Chon,et al.  Respiratory Rate Estimation from the Built-in Cameras of Smartphones and Tablets , 2014, Annals of Biomedical Engineering.

[23]  Danilo P. Mandic,et al.  Empirical Mode Decomposition-Based Time-Frequency Analysis of Multivariate Signals: The Power of Adaptive Data Analysis , 2013, IEEE Signal Processing Magazine.

[24]  Gerard de Haan,et al.  Robust Pulse Rate From Chrominance-Based rPPG , 2013, IEEE Transactions on Biomedical Engineering.

[25]  L. Tarassenko,et al.  Photoplethysmographic derivation of respiratory rate: a review of relevant physiology , 2012, Journal of medical engineering & technology.

[26]  Ki H. Chon,et al.  Physiological Parameter Monitoring from Optical Recordings With a Mobile Phone , 2012, IEEE Transactions on Biomedical Engineering.

[27]  Theodore Alexandrov,et al.  A METHOD OF TREND EXTRACTION USING SINGULAR SPECTRUM ANALYSIS , 2008, 0804.3367.

[28]  John Allen Photoplethysmography and its application in clinical physiological measurement , 2007, Physiological measurement.

[29]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[30]  Geovany de Araújo Borges,et al.  Line Extraction in 2D Range Images for Mobile Robotics , 2004, J. Intell. Robotic Syst..

[31]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[32]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[33]  A. Buda,et al.  Effect of intrathoracic pressure on left ventricular performance. , 1979, The New England journal of medicine.

[34]  A. B. Hertzman Photoelectric Plethysmography of the Fingers and Toes in Man , 1937 .