Non-Contact Respiration Measurement Method Based on RGB Camera Using 1D Convolutional Neural Networks

Conventional respiration measurement requires a separate device and/or can cause discomfort, so it is difficult to perform routinely, even for patients with respiratory diseases. The development of contactless respiration measurement technology would reduce discomfort and help detect and prevent fatal diseases. Therefore, we propose a respiration measurement method using a learning-based region-of-interest detector and a clustering-based respiration pixel estimation technique. The proposed method consists of a model for classifying whether a pixel conveys respiration information based on its variance and a method for classifying pixels with clear breathing components using the symmetry of the respiration signals. The proposed method was evaluated with the data of 14 men and women acquired in an actual environment, and it was confirmed that the average error was within approximately 0.1 bpm. In addition, a Bland–Altman analysis confirmed that the measurement result had no error bias, and regression analysis confirmed that the correlation of the results with the reference is high. The proposed method, designed to be inexpensive, fast, and robust to noise, is potentially suitable for practical use in clinical scenarios.

[1]  John Allen,et al.  Recent development of respiratory rate measurement technologies , 2019, Physiological measurement.

[2]  Ki H. Chon,et al.  Tidal Volume and Instantaneous Respiration Rate Estimation using a Volumetric Surrogate Signal Acquired via a Smartphone Camera , 2017, IEEE Journal of Biomedical and Health Informatics.

[3]  Sander Stuijk,et al.  Robust respiration detection from remote photoplethysmography. , 2016, Biomedical optics express.

[4]  Reza Saatchi,et al.  Real-time vision based respiration monitoring system , 2010, 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010).

[5]  J. Hogan Why don't nurses monitor the respiratory rates of patients? , 2006, British journal of nursing.

[6]  A. Capucci,et al.  Muscle Ergoreceptor Overactivity Reflects Deterioration in Clinical Status and Cardiorespiratory Reflex Control in Chronic Heart Failure , 2001, Circulation.

[7]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[8]  B. Genton,et al.  Clinical features for diagnosis of pneumonia in children younger than 5 years: a systematic review and meta-analysis. , 2015, The Lancet. Infectious diseases.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Julia Richter,et al.  Remote Respiration Rate Determination in Video Data - Vital Parameter Extraction based on Optical Flow and Principal Component Analysis , 2017, VISIGRAPP.

[11]  Gerard de Haan,et al.  Video-based respiration monitoring with automatic region of interest detection , 2016, Physiological measurement.

[12]  Duo Li,et al.  Synergetic use of thermal and visible imaging techniques for contactless and unobtrusive breathing measurement , 2017, Journal of biomedical optics.

[13]  Ki H. Chon,et al.  Respiratory Rate Estimation from the Built-in Cameras of Smartphones and Tablets , 2013, Annals of Biomedical Engineering.

[14]  Guangtao Zhai,et al.  Influence of image resolution on the performance of remote breathing rate measurement using thermal imaging technique , 2018, Infrared Physics & Technology.

[15]  S. C. Johnson Hierarchical clustering schemes , 1967, Psychometrika.

[16]  Timo Tigges,et al.  Camera-based system for contactless monitoring of respiration , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Nicolai Marquardt,et al.  Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging. , 2017, Biomedical optics express.

[18]  J. Wendon,et al.  Rapid response systems: a systematic review and meta-analysis , 2015, Critical Care.

[19]  J. Tsien,et al.  Remote Measurements of Heart and Respiration Rates for Telemedicine , 2013, PloS one.

[20]  Babak Taati,et al.  A non-contact vision-based system for respiratory rate estimation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Gaddisa Olani Ganfure Using video stream for continuous monitoring of breathing rate for general setting , 2019, Signal Image Video Process..

[22]  Sergio Silvestri,et al.  Non-Contact Monitoring of Breathing Pattern and Respiratory Rate via RGB Signal Measurement , 2019, Sensors.