Video-based respiration monitoring with automatic region of interest detection

Vital signs monitoring is ubiquitous in clinical environments and emerging in home-based healthcare applications. Still, since current monitoring methods require uncomfortable sensors, respiration rate remains the least measured vital sign. In this paper, we propose a video-based respiration monitoring method that automatically detects a respiratory region of interest (RoI) and signal using a camera. Based on the observation that respiration induced chest/abdomen motion is an independent motion system in a video, our basic idea is to exploit the intrinsic properties of respiration to find the respiratory RoI and extract the respiratory signal via motion factorization. We created a benchmark dataset containing 148 video sequences obtained on adults under challenging conditions and also neonates in the neonatal intensive care unit (NICU). The measurements obtained by the proposed video respiration monitoring (VRM) method are not significantly different from the reference methods (guided breathing or contact-based ECG; p-value  =  0.6), and explain more than 99% of the variance of the reference values with low limits of agreement (-2.67 to 2.81 bpm). VRM seems to provide a valid solution to ECG in confined motion scenarios, though precision may be reduced for neonates. More studies are needed to validate VRM under challenging recording conditions, including upper-body motion types.

[1]  Yap-Peng Tan,et al.  Respiratory rate estimation via simultaneously tracking and segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[2]  Z. Yaniv,et al.  Monitoring Patient Respiration using a Single Optical Camera , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[4]  Jozef Pucik,et al.  Contactless recognition of respiration phases using web camera , 2014, 2014 24th International Conference Radioelektronika.

[5]  Reza Saatchi,et al.  Real-time vision based respiration monitoring system , 2010, 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010).

[6]  J. Tsien,et al.  Remote Measurements of Heart and Respiration Rates for Telemedicine , 2013, PloS one.

[7]  D. Wakefield,et al.  Respiratory rate predicts cardiopulmonary arrest for internal medicine inpatients , 1993, Journal of General Internal Medicine.

[8]  Babak Taati,et al.  A non-contact vision-based system for respiratory rate estimation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  R. Saatchi,et al.  Eyes' corners detection in infrared images for real-time noncontact respiration rate monitoring , 2014, 2014 World Congress on Computer Applications and Information Systems (WCCAIS).

[10]  Timo Tigges,et al.  Camera-based system for contactless monitoring of respiration , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  L. Tarassenko,et al.  Non-contact video-based vital sign monitoring using ambient light and auto-regressive models , 2014, Physiological measurement.

[12]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[13]  A. Steinschneider,et al.  Prolonged apnea and the sudden infant death syndrome: clinical and laboratory observations. , 1972, Pediatrics.

[14]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[15]  Mario Cleves,et al.  Robust tests for the equality of variances update to Stata 6 , 2000 .

[16]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  U. Koehler,et al.  [Respiratory Rate - a Neglected Vital Sign]. , 2017, Deutsche medizinische Wochenschrift.

[18]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[19]  R. Saatchi,et al.  Respiration rate monitoring methods: A review , 2011, Pediatric pulmonology.

[20]  H. Levene Robust tests for equality of variances , 1961 .