Analysis of the parameters of respiration patterns extracted from thermal image sequences

Abstract Remote estimation of vital signs is an important and active area of research. The goal of this work was to analyze the feasibility of estimating respiration parameters from video sequences of faces recorded using a mobile thermal camera. Different estimators were analyzed and experimentally verified. It was demonstrated that the respiration rate, periodicity of respiration, and presence and length of apnea periods could be reliably estimated from signals recorded using a portable thermal camera. The size of the camera and efficiency of the methods allow the implementation of this method in smart glasses.

[1]  Carole L Marcus.  Concerns regarding the pediatric component of the AASM clinical guidelines for the manual titration of positive airway pressure in patients with obstructive sleep apnea. , 2008, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[2]  I. Pavlidis,et al.  Noncontact measurement of breathing function , 2006, IEEE Engineering in Medicine and Biology Magazine.

[3]  C. Hunt,et al.  Comparison of respiratory inductive plethysmography and thoracic impedance for apnea monitoring. , 1987, The Journal of pediatrics.

[4]  Pablo Laguna,et al.  Bioelectrical Signal Processing in Cardiac and Neurological Applications , 2005 .

[5]  Suzanne Kieffer,et al.  Feature extraction and selection for objective gait analysis and fall risk assessment by accelerometry , 2011, Biomedical engineering online.

[6]  Jacek Ruminski,et al.  A multisensor detector of a sleep apnea for using at home , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[7]  Krzysztof Czuszynski,et al.  Interaction with medical data using QR-codes , 2014, 2014 7th International Conference on Human System Interactions (HSI).

[8]  Yan Zhou,et al.  Spatiotemporal Smoothing as a Basis for Facial Tissue Tracking in Thermal Imaging , 2013, IEEE Transactions on Biomedical Engineering.

[9]  G. Smith,et al.  Basic Epidemiology , 1994 .

[10]  R. Daroff,et al.  The International Classification of Sleep Disorders , 1991, Neurology.

[11]  François Michaud,et al.  Contact-Free Respiration Rate Monitoring Using a Pan–Tilt Thermal Camera for Stationary Bike Telerehabilitation Sessions , 2016, IEEE Systems Journal.

[12]  Jacek Ruminski,et al.  Interactions with recognized patients using smart glasses , 2015, 2015 8th International Conference on Human System Interaction (HSI).

[13]  Mark I Neuman,et al.  Prediction of Pneumonia in a Pediatric Emergency Department , 2011, Pediatrics.

[14]  Antoni Nowakowski,et al.  Thermal Parametric Imaging in the Evaluation of Skin Burn Depth , 2007, IEEE Transactions on Biomedical Engineering.

[15]  Daniel McDuff,et al.  Biowatch: Estimation of heart and breathing rates from wrist motions , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[16]  Mariusz Marzec,et al.  Detection of selected face areas on thermograms with elimination of typical problems , 2010 .

[17]  R Perera,et al.  Derivation and validation of age and temperature specific reference values and centile charts to predict lower respiratory tract infection in children with fever: prospective observational study , 2012, BMJ : British Medical Journal.

[18]  M. Littner,et al.  Practice parameters for the indications for polysomnography and related procedures: an update for 2005. , 2005, Sleep.

[19]  Jacek Ruminski,et al.  Interactions with recognized objects , 2014, 2014 7th International Conference on Human System Interactions (HSI).

[20]  J. Rumiński.  Evaluation of respiration rate and pattern using a portable thermal camera , 2016 .

[21]  Abbas K. Abbas,et al.  Neonatal non-contact respiratory monitoring based on real-time infrared thermography , 2011, Biomedical engineering online.

[22]  Edgar A. Bernal,et al.  Non contact monitoring of respiratory function via depth sensing , 2014, IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[23]  Ioannis Pavlidis,et al.  Thermal infrared imaging: a novel method to monitor airflow during polysomnography. , 2009, Sleep.

[24]  Lei Fang,et al.  B I O M E D I C a L E N G I N E E R I N G , 2022 .

[25]  Jin Fei,et al.  Imaging Breathing Rate in the CO2Absorption Band , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[26]  Atul Malhotra,et al.  Central sleep apnea: Pathophysiology and treatment. , 2007, Chest.

[27]  Reza Saatchi,et al.  Tracking human face features in thermal images for respiration monitoring , 2010, ACS/IEEE International Conference on Computer Systems and Applications - AICCSA 2010.

[28]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[29]  R. Rogers,et al.  Obstructive sleep apnea. , 1996, The New England journal of medicine.

[30]  U. Koehler,et al.  [Respiratory Rate - a Neglected Vital Sign]. , 2017, Deutsche medizinische Wochenschrift.

[31]  Dvijesh Shastri,et al.  Spatiotemporal Reconstruction of the Breathing Function , 2012, MICCAI.

[32]  Mitzi Waltz,et al.  Webster's New World Medical Dictionary , 2000 .

[33]  Ioannis T. Pavlidis,et al.  Thermistor at a Distance: Unobtrusive Measurement of Breathing , 2010, IEEE Transactions on Biomedical Engineering.

[34]  I. Smith,et al.  Respiratory rate measurement: a comparison of methods , 2011 .