Automatic real time derivation of breathing rate from thermal video sequences

The breathing rate (BR) is one of most important physiological parameter used for cardiopulmonary arrest prevention and for evaluating respiratory problems as (sleep) apnea, congestive heart, hypo / hyper –ventilation, asthma etc. In this paper, we propose an efficient method for non-contact estimation of BR using thermal imaging. The system is based on computer vision algorithms and sequentially performs: face detection, interest points extraction and tracking, geometric transformation between successive frames and nostril position estimation. The performance of the proposed framework is evaluated against the BR measured using a wired thermistor. The thermistor is placed near the subject nostril and is connected to an acquisition system designed for medical applications. The experimental evaluation validates the proposed methodology, returning high accuracy scores. In terms of the computational complexity, the system performs the BR estimation in real time.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  K. Hillman,et al.  Respiratory rate : the neglected vital sign. Commentary , 2008 .

[3]  T. Rea,et al.  Prediction of critical illness during out-of-hospital emergency care. , 2010, JAMA.

[4]  Gye-Young Kim,et al.  Robust Estimation of Camera Homography Using Fuzzy RANSAC , 2007, ICCSA.

[5]  Aly A. Farag,et al.  Face recognition in low resolution thermal images , 2013, Comput. Vis. Image Underst..

[6]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[7]  Rui Pedro Paiva,et al.  Detection of motion artifact patterns in photoplethysmographic signals based on time and period domain analysis , 2014, Physiological measurement.

[8]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[9]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[10]  K. Hillman,et al.  The objective medical emergency team activation criteria: a case-control study. , 2007, Resuscitation.

[11]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[12]  Eiji Kajii,et al.  Importance of vital signs to the early diagnosis and severity of sepsis: association between vital signs and sequential organ failure assessment score in patients with sepsis. , 2012, Internal medicine.

[13]  J. Leite,et al.  SOS score: an optimized score to screen acute stroke patients for obstructive sleep apnea. , 2014, Sleep medicine.

[14]  D. Wakefield,et al.  Respiratory rate predicts cardiopulmonary arrest for internal medicine inpatients , 1993, Journal of General Internal Medicine.

[15]  K. Hillman,et al.  Respiratory rate: the neglected vital sign , 2008, The Medical journal of Australia.

[16]  Aurobinda Routray,et al.  Infrared imaging based hyperventilation monitoring through respiration rate estimation , 2016 .

[17]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[18]  Qiang Ji,et al.  Eye localization from thermal infrared images , 2013, Pattern Recognit..