Remote, Depth-Based Lung Function Assessment

<italic>Objective:</italic> We propose a remote, noninvasive approach to develop pulmonary function testing (PFT) using a depth sensor. <italic>Method:</italic> After generating a point cloud from scene depth values, we construct a three-dimensional model of the subject's chest. Then, by estimating the chest volume variation throughout a sequence, we generate volume–time and flow–time data for two prevalent spirometry tests: forced vital capacity (FVC) and slow vital capacity (SVC). <italic>Tidal volume</italic> and <italic>main effort</italic> sections of volume–time data are analyzed and calibrated separately to remove the effects of a subject's torso motion. After automatic extraction of keypoints from the volume–time and flow–time curves, seven FVC ( <italic>FVC, FEV1, PEF, FEF</italic><inline-formula><tex-math notation="LaTeX">$_{25\%}$</tex-math></inline-formula>, <italic>FEF</italic><inline-formula><tex-math notation="LaTeX">$_{50\%}$</tex-math></inline-formula>, <italic>FEF </italic><inline-formula><tex-math notation="LaTeX">$_{75\%}$</tex-math></inline-formula>, and <italic>FEF</italic> <inline-formula><tex-math notation="LaTeX">$_{25\text{--}75\%}$</tex-math></inline-formula>) and four SVC measures ( <italic>VC, IC, TV</italic>, and <italic>ERV</italic>) are computed and then validated against measures from a spirometer. A dataset of 85 patients (529 sequences in total), attending respiratory outpatient service for spirometry, was collected and used to evaluate the proposed method. <italic>Results:</italic> High correlation for FVC and SVC measures on intra-test and intra-subject measures between the proposed method and the spirometer. <italic> Conclusion</italic>: Our proposed depth-based approach is able to remotely compute eleven clinical PFT measures, which gives highly accurate results when evaluated against a spirometer on a dataset comprising 85 patients. <italic> Significance:</italic> Experimental results computed over an unprecedented number of clinical patients confirm that chest surface motion is linearly related to the changes in volume of lungs, which establishes the potential toward an accurate, low-cost, and remote alternative to traditional cumbersome methods, such as spirometry.

[1]  Lorenzo Scalise,et al.  Non contact measurement of heart and respiration rates based on Kinect™ , 2014, 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[2]  Maysam Ghovanloo,et al.  A Vision-Based Respiration Monitoring System for Passive Airway Resistance Estimation , 2016, IEEE Transactions on Biomedical Engineering.

[3]  J. Amat,et al.  VISION BASED RESPIRATORY MONITORING SYSTEM , 2022 .

[4]  Fatemeh Tahavori,et al.  Marker-less respiratory motion modeling using the Microsoft Kinect for Windows , 2014, Medical Imaging.

[5]  Junyi Xia,et al.  A real-time respiratory motion monitoring system using KINECT: proof of concept. , 2012, Medical physics.

[6]  R. Stiefelhagen,et al.  Breath rate monitoring during sleep using near-ir imagery and PCA , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[7]  S. J. Cala,et al.  Chest wall and lung volume estimation by optical reflectance motion analysis. , 1996, Journal of applied physiology.

[8]  G Ferrigno,et al.  Three-dimensional optical analysis of chest wall motion. , 1994, Journal of applied physiology.

[9]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[10]  Tapio Seppänen,et al.  Accurate measurement of respiratory airflow waveforms using depth data , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Maysam Ghovanloo,et al.  A passive quantitative measurement of airway resistance using depth data , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Majid Mirmehdi,et al.  Remote pulmonary function testing using a depth sensor , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[13]  Boreom Lee,et al.  Real-time estimation of respiratory rate from a photoplethysmogram using an adaptive lattice notch filter , 2014, Biomedical engineering online.

[14]  Reza Saatchi,et al.  Real-time vision based respiration monitoring system , 2010, 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010).

[15]  日向 俊二 Kinect for Windowsアプリを作ろう , 2012 .

[16]  Lorenzo Scalise,et al.  Optical method for measurement of respiration rate , 2010, 2010 IEEE International Workshop on Medical Measurements and Applications.

[17]  A Pedotti,et al.  Estimation of end-expiratory lung volume variations by optoelectronic plethysmography , 2001, Critical care medicine.

[18]  Anna Gina Perri,et al.  A New System for Continuous Monitoring of Breathing and Kinetic Activity , 2010, J. Sensors.

[19]  H. Aoki,et al.  Non-contact respiration measurement using structured light 3-D sensor , 2012, 2012 Proceedings of SICE Annual Conference (SICE).

[20]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[21]  I. Sato,et al.  Non-contact Breath Motion Monitor ing System in Full Automation , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[22]  U. Koehler,et al.  [Respiratory Rate - a Neglected Vital Sign]. , 2017, Deutsche medizinische Wochenschrift.

[23]  Mark de Berg,et al.  Computational geometry: algorithms and applications, 3rd Edition , 1997 .

[24]  R Merget,et al.  Body plethysmography--its principles and clinical use. , 2011, Respiratory medicine.

[25]  S. Longhi,et al.  Respiratory rate detection algorithm based on RGB-D camera: theoretical background and experimental results. , 2014, Healthcare technology letters.

[26]  Steven B. Smith,et al.  Digital Signal Processing: A Practical Guide for Engineers and Scientists , 2002 .

[27]  Michael Arens,et al.  Low-cost commodity depth sensor comparison and accuracy analysis , 2014, Security and Defence.

[28]  Ming-Sui Lee,et al.  Noncontact respiratory measurement of volume change using depth camera , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[30]  A Pedotti,et al.  Opto-electronic plethysmography. , 2003, Monaldi archives for chest disease = Archivio Monaldi per le malattie del torace.

[31]  Joan Lasenby,et al.  SLP: A Zero-Contact Non-Invasive Method for Pulmonary Function Testing , 2010, BMVC.

[32]  R. Pierce,et al.  Spirometry: an essential clinical measurement. , 2005, Australian family physician.

[33]  Joachim Hornegger,et al.  Robust real-time 3D respiratory motion detection using time-of-flight cameras , 2008, International Journal of Computer Assisted Radiology and Surgery.

[34]  Ioannis T. Pavlidis,et al.  Analysis of Breathing Air Flow Patterns in Thermal Imaging , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[35]  R. Briggs,et al.  Raised respiratory rate in elderly patients: a valuable physical sign. , 1982, British medical journal.

[36]  Luis Salgado,et al.  Depth-Color Fusion Strategy for 3-D Scene Modeling With Kinect , 2013, IEEE Transactions on Cybernetics.

[37]  Mark T. Bolas,et al.  Unobtrusive measurement of subtle nonverbal behaviors with the Microsoft Kinect , 2012, VR.

[38]  Edgar A. Bernal,et al.  Non contact monitoring of respiratory function via depth sensing , 2014, IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[39]  J. Hankinson,et al.  Standardisation of spirometry , 2005, European Respiratory Journal.

[40]  Jon Howard,et al.  Accurate markerless respiratory tracking for gated whole body PET using the Microsoft Kinect , 2012, 2012 IEEE Nuclear Science Symposium and Medical Imaging Conference Record (NSS/MIC).