Contactless Monitoring of Breathing Patterns and Respiratory Rate at the Pit of the Neck: A Single Camera Approach

Vital signs monitoring is pivotal not only in clinical settings but also in home environments. Remote monitoring devices, systems, and services are emerging as tracking vital signs must be performed on a daily basis. Different types of sensors can be used to monitor breathing patterns and respiratory rate. However, the latter remains the least measured vital sign in several scenarios due to the intrusiveness of most adopted sensors. In this paper, we propose an inexpensive, off-the-shelf, and contactless measuring system for respiration signals taking as region of interest the pit of the neck. The system analyses video recorded by a single RGB camera and extracts the respiratory pattern from intensity variations of reflected light at the level of the collar bones and above the sternum. Breath-by-breath respiratory rate is then estimated from the processed breathing pattern. In addition, the effect of image resolution on monitoring breathing patterns and respiratory rate has been investigated. The proposed system was tested on twelve healthy volunteers (males and females) during quiet breathing at different sensor resolution (i.e., HD 720, PAL, WVGA, VGA, SVGA, and NTSC). Signals collected with the proposed system have been compared against a reference signal in both the frequency domain and time domain. By using the HD 720 resolution, frequency domain analysis showed perfect agreement between average breathing frequency values gathered by the proposed measuring system and reference instrument. An average mean absolute error (MAE) of 0.55 breaths/min was assessed in breath-by-breath monitoring in the time domain, while Bland-Altman showed a bias of −0.03 ± 1.78 breaths/min. Even in the case of lower camera resolution setting (i.e., NTSC), the system demonstrated good performances (MAE of 1.53 breaths/min, bias of −0.06 ± 2.08 breaths/min) for contactless monitoring of both breathing pattern and breath-by-breath respiratory rate over time.

[1]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[2]  J H Auchincloss,et al.  Changes in tidal volume, frequency, and ventilation induced by their measurement. , 1972, Journal of applied physiology.

[3]  Douglas G. Altman,et al.  Measurement in Medicine: The Analysis of Method Comparison Studies , 1983 .

[4]  W. M. Carey,et al.  Digital spectral analysis: with applications , 1986 .

[5]  A. Pedotti,et al.  Mechanics of Breathing , 2002 .

[6]  Beena Ahmed,et al.  A novel method to measure respiratory airflow rate based on nasal pressure , 2003 .

[7]  Frank H Wilhelm,et al.  Reliability of respiratory tidal volume estimation by means of ambulatory inductive plethysmography. , 2006, Biomedical sciences instrumentation.

[8]  B. Hök,et al.  Critical review of non-invasive respiratory monitoring in medical care , 2003, Medical and Biological Engineering and Computing.

[9]  Z. Yaniv,et al.  Monitoring Patient Respiration using a Single Optical Camera , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  K. Hillman,et al.  Respiratory rate: the neglected vital sign , 2008, The Medical journal of Australia.

[11]  Reza Saatchi,et al.  Real-time vision based respiration monitoring system , 2010, 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010).

[12]  Ying-Wen Bai,et al.  Design and implementation of an embedded monitor system for detection of a patient's breath by double Webcams , 2010, 2010 IEEE International Workshop on Medical Measurements and Applications.

[13]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[14]  Rigoberto Pérez de Alejo,et al.  Monitoring breathing rate at home allows early identification of COPD exacerbations. , 2012, Chest.

[15]  Lei Yang,et al.  Real-time detection of respiration rate with non-contact mode based on low-end imaging equipment , 2013, Optics & Photonics - Optical Engineering + Applications.

[16]  L. Tarassenko,et al.  Continuous non-contact vital sign monitoring in neonatal intensive care unit , 2014, Healthcare technology letters.

[17]  L. Tarassenko,et al.  Non-contact video-based vital sign monitoring using ambient light and auto-regressive models , 2014, Physiological measurement.

[18]  Yuting Yang,et al.  Noncontact Monitoring Breathing Pattern, Exhalation Flow Rate and Pulse Transit Time , 2014, IEEE Transactions on Biomedical Engineering.

[19]  Robin J. Evans,et al.  Noncontact Detection and Analysis of Respiratory Function Using Microwave Doppler Radar , 2015, J. Sensors.

[20]  Gerard de Haan,et al.  Video-based respiration monitoring with automatic region of interest detection , 2016, Physiological measurement.

[21]  Hilmi R. Dajani,et al.  Human Breathing Rate Estimation from Radar Returns Using Harmonically Related Filters , 2016, J. Sensors.

[22]  Wen-Jiin Tsai,et al.  Image-Based Motion-Tolerant Remote Respiratory Rate Evaluation , 2016, IEEE Sensors Journal.

[23]  K. Chon,et al.  Monitoring of Heart and Breathing Rates Using Dual Cameras on a Smartphone , 2016, PloS one.

[24]  Ki H. Chon,et al.  Tidal Volume and Instantaneous Respiration Rate Estimation using a Volumetric Surrogate Signal Acquired via a Smartphone Camera , 2017, IEEE Journal of Biomedical and Health Informatics.

[25]  Javaan Chahl,et al.  Simultaneous Tracking of Cardiorespiratory Signals for Multiple Persons Using a Machine Vision System With Noise Artifact Removal , 2017, IEEE Journal of Translational Engineering in Health and Medicine.

[26]  Emiliano Schena,et al.  Smart Textile Based on 12 Fiber Bragg Gratings Array for Vital Signs Monitoring , 2017, IEEE Sensors Journal.

[27]  Louis Passfield,et al.  Respiratory Frequency during Exercise: The Neglected Physiological Measure , 2017, Front. Physiol..

[28]  Emiliano Schena,et al.  Smart textile for respiratory monitoring and thoraco‐abdominal motion pattern evaluation , 2018, Journal of biophotonics.

[29]  Fabrizio Taffoni,et al.  A Wearable System for Real-Time Continuous Monitoring of Physical Activity , 2018, Journal of healthcare engineering.