Real-Time Visual Respiration Rate Estimation with Dynamic Scene Adaptation

In this paper, we present a vision based method for respiration rate estimation which can automatically adapt to the scene changes. We capture a video of the subjects thoraco-abdominal region and compute optical flow field at each video frame. The optical flow field changes periodically with the periodic chest wall motion. The pattern of the chest wall motion is captured through the estimation of a principal flow field. The principal flow field is automatically updated with time to cope with the scene changes. Thus, our method can adapt itself to the changes of the posture of a subject. Besides, in our method we do not need to select any region of interest unlike other methods. Yet our method is computationally very inexpensive and simple to implement. We test our method on many human volunteers with a wide variety of their clothing. We compare our method against the gold standard method of impedance pneumography and have found a very high accuracy.

[1]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[2]  Louis-Gilles Durand,et al.  Phonospirometry for noninvasive measurement of ventilation: methodology and preliminary results. , 2002, Journal of applied physiology.

[3]  Olga Boric-Lubecke,et al.  Vital signs. , 2017, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[4]  Kazuki Nakajima,et al.  A method for measuring respiration and physical activity in bed by optical flow analysis , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[5]  Timo Tigges,et al.  Camera-based system for contactless monitoring of respiration , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[6]  Wen-Jiin Tsai,et al.  Image-Based Motion-Tolerant Remote Respiratory Rate Evaluation , 2016, IEEE Sensors Journal.

[7]  P. Sly,et al.  Laser monitoring of chest wall displacement. , 1997, The European respiratory journal.

[8]  Sander Stuijk,et al.  Exploiting Spatial Redundancy of Image Sensor for Motion Robust rPPG , 2015, IEEE Transactions on Biomedical Engineering.

[9]  Ki H. Chon,et al.  Estimation of Respiratory Rate From Photoplethysmogram Data Using Time–Frequency Spectral Estimation , 2009, IEEE Transactions on Biomedical Engineering.

[10]  Se Dong Min,et al.  Noncontact Respiration Rate Measurement System Using an Ultrasonic Proximity Sensor , 2010, IEEE Sensors Journal.

[11]  J. Hankinson,et al.  Standardisation of spirometry , 2005, European Respiratory Journal.

[12]  W. Shoemaker,et al.  Autonomic activity in trauma patients based on variability of heart rate and respiratory rate* , 2004, Critical care medicine.

[13]  Yuting Yang,et al.  Noncontact Monitoring Breathing Pattern, Exhalation Flow Rate and Pulse Transit Time , 2014, IEEE Transactions on Biomedical Engineering.

[14]  F. Yasuma,et al.  Respiratory sinus arrhythmia: why does the heartbeat synchronize with respiratory rhythm? , 2004, Chest.

[15]  Reza Saatchi,et al.  Real-time vision based respiration monitoring system , 2010, 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010).

[16]  L. Nilsson Respiration Signals from Photoplethysmography , 2013, Anesthesia and analgesia.

[17]  Олег Костянтинович Боділовський Non-contact respiration monitoring using optical sensors , 2014 .

[18]  Shyamnath Gollakota,et al.  Contactless Sleep Apnea Detection on Smartphones , 2015, GetMobile Mob. Comput. Commun..

[19]  I. Pavlidis,et al.  Noncontact measurement of breathing function , 2006, IEEE Engineering in Medicine and Biology Magazine.

[20]  Avishek Chatterjee,et al.  Real-time respiration rate measurement from thoracoabdominal movement with a consumer grade camera , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Ashok Veeraraghavan,et al.  DistancePPG: Robust non-contact vital signs monitoring using a camera , 2015, Biomedical optics express.

[22]  H E HOFF,et al.  The impedance pneumography. , 1962, Aerospace medicine.

[23]  Wen-Jiin Tsai,et al.  Image-based Motion-Tolerant Remote Respiratory Rate Monitoring , 2016 .

[24]  Z. Yaniv,et al.  Monitoring Patient Respiration using a Single Optical Camera , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[26]  S. Longhi,et al.  Respiratory rate detection algorithm based on RGB-D camera: theoretical background and experimental results. , 2014, Healthcare technology letters.

[27]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[28]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.