Non-Contact Monitoring of Breathing Pattern and Respiratory Rate via RGB Signal Measurement

Among all the vital signs, respiratory rate remains the least measured in several scenarios, mainly due to the intrusiveness of the sensors usually adopted. For this reason, all contactless monitoring systems are gaining increasing attention in this field. In this paper, we present a measuring system for contactless measurement of the respiratory pattern and the extraction of breath-by-breath respiratory rate. The system consists of a laptop’s built-in RGB camera and an algorithm for post-processing of acquired video data. From the recording of the chest movements of a subject, the analysis of the pixel intensity changes yields a waveform indicating respiratory pattern. The proposed system has been tested on 12 volunteers, both males and females seated in front of the webcam, wearing both slim-fit and loose-fit t-shirts. The pressure-drop signal recorded at the level of nostrils with a head-mounted wearable device was used as reference respiratory pattern. The two methods have been compared in terms of mean of absolute error, standard error, and percentage error. Additionally, a Bland–Altman plot was used to investigate the bias between methods. Results show the ability of the system to record accurate values of respiratory rate, with both slim-fit and loose-fit clothing. The measuring system shows better performance on females. Bland–Altman analysis showed a bias of −0.01 breaths·min−1, with respiratory rate values between 10 and 43 breaths·min−1. Promising performance has been found in the preliminary tests simulating tachypnea.

[1]  Douglas G. Altman,et al.  Measurement in Medicine: The Analysis of Method Comparison Studies , 1983 .

[2]  Sergio Silvestri,et al.  Contact-Based Methods for Measuring Respiratory Rate , 2019, Sensors.

[3]  Lorenzo Scalise,et al.  Non-contact Measurement of the Heart Rate by a Image Sensor , 2015 .

[4]  Javaan Chahl,et al.  Simultaneous Tracking of Cardiorespiratory Signals for Multiple Persons Using a Machine Vision System With Noise Artifact Removal , 2017, IEEE Journal of Translational Engineering in Health and Medicine.

[5]  Emiliano Schena,et al.  Smart textile for respiratory monitoring and thoraco‐abdominal motion pattern evaluation , 2018, Journal of biophotonics.

[6]  Timo Tigges,et al.  Camera-based system for contactless monitoring of respiration , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Sergio Silvestri,et al.  Measurement system based on RBG camera signal for contactless breathing pattern and respiratory rate monitoring , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[8]  M. Younes,et al.  Role of respiratory control mechanisms in the pathogenesis of obstructive sleep disorders. , 2008, Journal of applied physiology.

[9]  Ki H. Chon,et al.  Tidal Volume and Instantaneous Respiration Rate Estimation using a Volumetric Surrogate Signal Acquired via a Smartphone Camera , 2017, IEEE Journal of Biomedical and Health Informatics.

[10]  Lorenzo Scalise,et al.  Measurement of respiration rate in preterm infants by laser Doppler vibrometry , 2011, 2011 IEEE International Symposium on Medical Measurements and Applications.

[11]  I. Smith,et al.  Respiratory rate measurement: a comparison of methods , 2011 .

[12]  Yuting Yang,et al.  Noncontact spirometry with a webcam , 2017, Journal of biomedical optics.

[13]  F. Taffoni,et al.  Validation of a Wearable Device and an Algorithm for Respiratory Monitoring During Exercise , 2019, IEEE Sensors Journal.

[14]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[15]  Emiliano Schena,et al.  Flow measurement in mechanical ventilation: a review. , 2015, Medical engineering & physics.

[16]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[17]  Ola Stenqvist,et al.  Clinical review: Respiratory monitoring in the ICU - a consensus of 16 , 2012, Critical Care.

[18]  J. Rohrbaugh,et al.  Cardiorespiratory interactions: Noncontact assessment using laser Doppler vibrometry. , 2016, Psychophysiology.

[19]  Mauro Serpelloni,et al.  Autonomous Wearable System for Vital Signs Measurement With Energy-Harvesting Module , 2016, IEEE Transactions on Instrumentation and Measurement.

[20]  Cheong Boon Soh,et al.  Wireless Sensing of Human Respiratory Parameters by Low-Power Ultrawideband Impulse Radio Radar , 2011, IEEE Transactions on Instrumentation and Measurement.

[21]  Gerard de Haan,et al.  Video-based respiration monitoring with automatic region of interest detection , 2016, Physiological measurement.

[22]  Xiangyu Wang,et al.  Design and Implementation of a Noncontact Sleep Monitoring System Using Infrared Cameras and Motion Sensor , 2018, IEEE Transactions on Instrumentation and Measurement.

[23]  D. Southall,et al.  Increased amplitude modulation of continuous respiration precedes sudden infant death syndrome -detection by spectral estimation of respirogram. , 1998, Early human development.

[24]  Ying-Wen Bai,et al.  Design and implementation of an embedded monitor system for detection of a patient's breath by double Webcams in the dark , 2010, The 12th IEEE International Conference on e-Health Networking, Applications and Services.

[25]  Emiliano Schena,et al.  Remote Respiratory Monitoring in the Time of COVID-19 , 2020, Frontiers in Physiology.

[26]  Sabine Van Huffel,et al.  Automated Respiration Detection from Neonatal Video Data , 2015, ICPRAM.

[27]  K. Hillman,et al.  Respiratory rate: the neglected vital sign , 2008, The Medical journal of Australia.

[28]  Sergio Silvestri,et al.  Contactless Monitoring of Breathing Patterns and Respiratory Rate at the Pit of the Neck: A Single Camera Approach , 2018, J. Sensors.

[29]  William A. Sethares,et al.  Design of Carryable Intravenous Drip Frame with Automatic Balancing , 2020, Sensors.

[30]  Javaan Chahl,et al.  Monitoring of Cardiorespiratory Signal: Principles of Remote Measurements and Review of Methods , 2017, IEEE Access.

[31]  E. P. Tomasini,et al.  An optical measurement method for the simultaneous assessment of respiration and heart rates in preterm infants. , 2013, The Review of scientific instruments.

[32]  Louis Passfield,et al.  Respiratory Frequency during Exercise: The Neglected Physiological Measure , 2017, Front. Physiol..

[33]  Fabrizio Taffoni,et al.  A Wearable System for Real-Time Continuous Monitoring of Physical Activity , 2018, Journal of healthcare engineering.

[34]  Emiliano Schena,et al.  Smart Textile Based on Piezoresistive Sensing Elements for Respiratory Monitoring , 2019, IEEE Sensors Journal.

[35]  Marek Malik,et al.  Respiratory rate predicts outcome after acute myocardial infarction: a prospective cohort study. , 2013, European heart journal.

[36]  J H Auchincloss,et al.  Changes in tidal volume, frequency, and ventilation induced by their measurement. , 1972, Journal of applied physiology.

[37]  Lorenzo Scalise,et al.  Assessment of cardio-respiratory rates by non-invasive measurement methods in hospitalized preterm neonates , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[38]  Wen-Jiin Tsai,et al.  Image-Based Motion-Tolerant Remote Respiratory Rate Evaluation , 2016, IEEE Sensors Journal.