Human respiration monitoring using infrared thermography and artificial intelligence

The respiration rate (RR) is the most vital parameter used for the determination of human health. The most widely adopted techniques, used to monitor the RR are contact in nature and face many drawbacks. This paper reports the use of Infrared Thermography, in reliably monitoring the RR in a contact-less and non-invasive way. A thermal camera is used to monitor the variation in nasal temperature during respiration continuously. Further, the nostrils (region of interest) are tracked during head motion and object occlusion, by implementing a computer vision algorithm that makes use of 'Histogram of oriented gradients' and 'Support vector machine' (SVM). The signal to noise ratio (SNR) of the acquired breathing signals is very low; hence they are subjected to appropriate filtering methods. The filters are compared depending on the performance metrics such as SNR and Mean square error. The breaths per minute are obtained without any manual intervention by implementing the 'Breath detection algorithm' (BDA). This algorithm is implemented on 150 breathing signals and its performance is determined by computing the parameters such as Precision, Sensitivity, Spurious cycle rate, and Missed cycle rate values, obtained as 98.6%, 97.2%, 1.4%, and 2.8% respectively. The parameters obtained from the BDA are fed to the k-Nearest Neighbour (k-NN) and SVM classifiers, that determine whether the human volunteers have abnormal or normal respiration, or have Bradypnea (slow breathing), or Tachypnea (fast breathing). The Validation accuracies obtained are 96.25% and 99.5% with Training accuracies 97.75% and 99.4% for SVM and k-NN classifiers respectively. The Testing accuracies of the completely built SVM and k-NN classifiers are 96% and 99%, respectively. The various performance metrics like Sensitivity, Specificity, Precision, G-mean and F-measure are calculated as well, for every class, for both the classifiers. Finally, the Standard deviation values of the SVM and k-NN classifiers are computed and are obtained as 0.022 and 0.007, respectively. It is observed that the k-NN classifier shows a better performance compared to the SVM classifier. The pattern between the data points fed to the classifiers is viewed by making use of the t-Stochastic Neighbor Embedding algorithm. It is noticed from these plots that the separation between the data points belonging to different classes, improves and shows minimal overlap by increasing the perplexity value and number of iterations.

[1]  Gregory F. Lewis,et al.  A novel method for extracting respiration rate and relative tidal volume from infrared thermography. , 2011, Psychophysiology.

[2]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  J D Haberman,et al.  Abdominal thermography in infantile and childhood liver disease. , 1976, Southern medical journal.

[4]  Steffen Leonhardt,et al.  Estimating Respiratory Rate in Post-Anesthesia Care Unit Patients Using Infrared Thermography: An Observational Study , 2018, Sensors.

[5]  K. Hillman,et al.  Respiratory rate: the neglected vital sign , 2008, The Medical journal of Australia.

[6]  Ronald W. Schafer,et al.  What Is a Savitzky-Golay Filter? [Lecture Notes] , 2011, IEEE Signal Processing Magazine.

[7]  Ioannis T. Pavlidis,et al.  Analysis of Breathing Air Flow Patterns in Thermal Imaging , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Abbas K. Abbas,et al.  Neonatal non-contact respiratory monitoring based on real-time infrared thermography , 2011, Biomedical engineering online.

[9]  Yong Gyu Lim,et al.  REM Sleep Classification with Respiration Rates , 2007, 2007 6th International Special Topic Conference on Information Technology Applications in Biomedicine.

[10]  Steffen Leonhardt,et al.  Estimation of respiratory rate from thermal videos of preterm infants , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Asnida Abdul Wahab,et al.  Assessment of inspiration and expiration time using infrared thermal imaging modality , 2019, Infrared Physics & Technology.

[12]  J. Kuller,et al.  Skin breakdown: Risk factors, prevention, and treatment , 2001 .

[13]  Ioannis T. Pavlidis,et al.  Tracking human breath in infrared imaging , 2005, Fifth IEEE Symposium on Bioinformatics and Bioengineering (BIBE'05).

[14]  Paruthi Pradhapan,et al.  Identification of apnea during respiratory monitoring using support vector machine classifier: a pilot study , 2012, Journal of Clinical Monitoring and Computing.

[15]  Reza Saatchi,et al.  Tracking human face features in thermal images for respiration monitoring , 2010, ACS/IEEE International Conference on Computer Systems and Applications - AICCSA 2010.

[16]  Nicolai Marquardt,et al.  Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging. , 2017, Biomedical optics express.

[17]  Keinosuke Fukunaga,et al.  The optimal distance measure for nearest neighbor classification , 1981, IEEE Trans. Inf. Theory.

[18]  O. Boric-Lubecke,et al.  Non-contact respiratory rate measurement validation for hospitalized patients , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  M. Baharestani,et al.  An overview of neonatal and pediatric wound care knowledge and considerations. , 2007, Ostomy/wound management.

[20]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[21]  M. Elliott,et al.  Critical care: the eight vital signs of patient monitoring. , 2012, British journal of nursing.

[22]  Lalat Indu Giri,et al.  Non-contact monitoring of human respiration using infrared thermography and machine learning , 2020 .

[23]  Steffen Leonhardt,et al.  Noncontact Monitoring of Respiratory Rate in Newborn Infants Using Thermal Imaging , 2019, IEEE Transactions on Biomedical Engineering.

[24]  Ricardo Vardasca,et al.  Classification and Decision Making of Medical Infrared Thermal Images , 2018 .

[25]  Ioannis T. Pavlidis,et al.  Thermistor at a Distance: Unobtrusive Measurement of Breathing , 2010, IEEE Transactions on Biomedical Engineering.

[26]  Steffen Leonhardt,et al.  Remote monitoring of breathing dynamics using infrared thermography. , 2015, Biomedical optics express.