Toward Respiratory Assessment Using Depth Measurements from a Time-of-Flight Sensor

Introduction: There is increasing interest in technologies that may enable remote monitoring of respiratory disease. Traditional methods for assessing respiratory function such as spirometry can be expensive and require specialist training to perform and interpret. Remote, non-contact tracking of chest wall movement has been explored in the past using structured light, accelerometers and impedance pneumography, but these have often been costly and clinical utility remains to be defined. We present data from a 3-Dimensional time-of-flight camera (found in gaming consoles) used to estimate chest volume during routine spirometry maneuvres. Methods: Patients were recruited from a general respiratory physiology laboratory. Spirometry was performed according to international standards using an unmodified spirometer. A Microsoft Kinect V2 time-of-flight depth sensor was used to reconstruct 3-dimensional models of the subject's thorax to estimate volume-time and flow-time curves following the introduction of a scaling factor to transform measurements to volume estimates. The Bland-Altman method was used to assess agreement of model estimation with simultaneous recordings from the spirometer. Patient characteristics were used to assess predictors of error using regression analysis and to further explore the scaling factors. Results: The chest volume change estimated by the Kinect camera during spirometry tracked respiratory rate accurately and estimated forced vital capacity (FVC) and vital capacity to within ± <1%. Forced expiratory volume estimation did not demonstrate acceptable limits of agreement, with 61.9% of readings showing >150 ml difference. Linear regression including age, gender, height, weight, and pack years of smoking explained 37.0% of the variance in the scaling factor for volume estimation. This technique had a positive predictive value of 0.833 to detect obstructive spirometry. Conclusion: These data illustrate the potential of 3D time-of-flight cameras to remotely monitor respiratory rate. This is not a replacement for conventional spirometry and needs further refinement. Further algorithms are being developed to allow its independence from spirometry. Benefits include simplicity of set-up, no specialist training, and cost. This technique warrants further refinement and validation in larger cohorts.

[1]  D. Damen,et al.  Remote, Depth-Based Lung Function Assessment , 2017, IEEE Transactions on Biomedical Engineering.

[2]  Maysam Ghovanloo,et al.  A Vision-Based Respiration Monitoring System for Passive Airway Resistance Estimation , 2016, IEEE Transactions on Biomedical Engineering.

[3]  Majid Mirmehdi,et al.  Remote pulmonary function testing using a depth sensor , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[4]  Livio Pinto,et al.  Calibration of Kinect for Xbox One and Comparison between the Two Generations of Microsoft Sensors , 2015, Sensors.

[5]  Elise Lachat,et al.  Assessment and Calibration of a RGB-D Camera (Kinect v2 Sensor) Towards a Potential Use for Close-Range 3D Modeling , 2015, Remote. Sens..

[6]  Niall Twomey,et al.  Bridging e-Health and the Internet of Things: The SPHERE Project , 2015, IEEE Intelligent Systems.

[7]  Marvin A. Sackner,et al.  Non-invasive Measurement of Ventilation During Exercise Using A Respiratory Inductive Plethysmograph. I.1–3 , 2015 .

[8]  A. Simonds,et al.  Randomised crossover trial of telemonitoring in chronic respiratory patients (TeleCRAFT trial) , 2014, Thorax.

[9]  G. Lewin,et al.  Telehealth remote monitoring for community-dwelling older adults with chronic obstructive pulmonary disease. , 2013, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[10]  H. Aoki,et al.  Non-contact respiration measurement using structured light 3-D sensor , 2012, 2012 Proceedings of SICE Annual Conference (SICE).

[11]  Joan Lasenby,et al.  FORCED EXPIRATORY FLOW AND VOLUME MEASURED WITH STRUCTURED LIGHT PLETHYSMOGRAPHY (SLP) AND SPIROMETRY , 2010, Asian Test Symposium.

[12]  Joan Lasenby,et al.  Comparison of forced expiratory volumes measured with structured light plethysmography (SLP) and spirometry , 2009 .

[13]  Joachim Hornegger,et al.  Robust real-time 3D respiratory motion detection using time-of-flight cameras , 2008, International Journal of Computer Assisted Radiology and Surgery.

[14]  M. Kenzelmann,et al.  Argonaute—a database for gene regulation by mammalian microRNAs , 2005, BMC Bioinformatics.

[15]  J. Hankinson,et al.  Standardisation of spirometry , 2005, European Respiratory Journal.

[16]  Dietmar Stöckl,et al.  Application of the Bland-Altman plot for interpretation of method-comparison studies: a critical investigation of its practice. , 2002, Clinical chemistry.

[17]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[18]  S. J. Cala,et al.  Chest wall and lung volume estimation by optical reflectance motion analysis. , 1996, Journal of applied physiology.

[19]  A. Reich,et al.  Estimating respiratory volumes from rib cage and abdominal displacements during ventilatory and speech activities. , 1990, Journal of speech and hearing research.

[20]  A. Gourlay,et al.  An optical method of studying the shape and movement of the chest wall in recumbent patients. , 1984, Thorax.

[21]  A. Pedotti,et al.  Compartmental Analysis of Breathing in the Supine and Prone Positions by Optoelectronic Plethysmography , 2004, Annals of Biomedical Engineering.

[22]  Mark de Berg,et al.  Computational geometry: algorithms and applications, 3rd Edition , 1997 .

[23]  Mark de Berg,et al.  Computational geometry: algorithms and applications , 1997 .

[24]  M A Sackner,et al.  Non-invasive measurement of ventilation during exercise using a respiratory inductive plethysmograph. I. , 1980, The American review of respiratory disease.