Remote, Depth-Based Lung Function Assessment

<italic>Objective:</italic> We propose a remote, noninvasive approach to develop pulmonary function testing (PFT) using a depth sensor. <italic>Method:</italic> After generating a point cloud from scene depth values, we construct a three-dimensional model of the subject's chest. Then, by estimating the chest volume variation throughout a sequence, we generate volume–time and flow–time data for two prevalent spirometry tests: forced vital capacity (FVC) and slow vital capacity (SVC). <italic>Tidal volume</italic> and <italic>main effort</italic> sections of volume–time data are analyzed and calibrated separately to remove the effects of a subject's torso motion. After automatic extraction of keypoints from the volume–time and flow–time curves, seven FVC ( <italic>FVC, FEV1, PEF, FEF</italic><inline-formula><tex-math notation="LaTeX">$_{25\%}$</tex-math></inline-formula>, <italic>FEF</italic><inline-formula><tex-math notation="LaTeX">$_{50\%}$</tex-math></inline-formula>, <italic>FEF </italic><inline-formula><tex-math notation="LaTeX">$_{75\%}$</tex-math></inline-formula>, and <italic>FEF</italic> <inline-formula><tex-math notation="LaTeX">$_{25\text{--}75\%}$</tex-math></inline-formula>) and four SVC measures ( <italic>VC, IC, TV</italic>, and <italic>ERV</italic>) are computed and then validated against measures from a spirometer. A dataset of 85 patients (529 sequences in total), attending respiratory outpatient service for spirometry, was collected and used to evaluate the proposed method. <italic>Results:</italic> High correlation for FVC and SVC measures on intra-test and intra-subject measures between the proposed method and the spirometer. <italic> Conclusion</italic>: Our proposed depth-based approach is able to remotely compute eleven clinical PFT measures, which gives highly accurate results when evaluated against a spirometer on a dataset comprising 85 patients. <italic> Significance:</italic> Experimental results computed over an unprecedented number of clinical patients confirm that chest surface motion is linearly related to the changes in volume of lungs, which establishes the potential toward an accurate, low-cost, and remote alternative to traditional cumbersome methods, such as spirometry.

[1]  U. Koehler,et al.  [Respiratory Rate - a Neglected Vital Sign]. , 2017, Deutsche medizinische Wochenschrift.

[2]  Maysam Ghovanloo,et al.  A Vision-Based Respiration Monitoring System for Passive Airway Resistance Estimation , 2016, IEEE Transactions on Biomedical Engineering.

[3]  Majid Mirmehdi,et al.  Remote pulmonary function testing using a depth sensor , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[4]  Tapio Seppänen,et al.  Accurate measurement of respiratory airflow waveforms using depth data , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Boreom Lee,et al.  Real-time estimation of respiratory rate from a photoplethysmogram using an adaptive lattice notch filter , 2014, Biomedical engineering online.

[6]  Michael Arens,et al.  Low-cost commodity depth sensor comparison and accuracy analysis , 2014, Security and Defence.

[7]  S. Longhi,et al.  Respiratory rate detection algorithm based on RGB-D camera: theoretical background and experimental results. , 2014, Healthcare technology letters.

[8]  D. Ku,et al.  A passive quantitative measurement of airway resistance using depth data , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Lorenzo Scalise,et al.  Non contact measurement of heart and respiration rates based on Kinect™ , 2014, 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[10]  Edgar A. Bernal,et al.  Non contact monitoring of respiratory function via depth sensing , 2014, IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[11]  Fatemeh Tahavori,et al.  Marker-less respiratory motion modeling using the Microsoft Kinect for Windows , 2014, Medical Imaging.

[12]  Luis Salgado,et al.  Depth-Color Fusion Strategy for 3-D Scene Modeling With Kinect , 2013, IEEE Transactions on Cybernetics.

[13]  R. Stiefelhagen,et al.  Breath rate monitoring during sleep using near-ir imagery and PCA , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[14]  H. Aoki,et al.  Non-contact respiration measurement using structured light 3-D sensor , 2012, 2012 Proceedings of SICE Annual Conference (SICE).

[15]  Jon Howard,et al.  Accurate markerless respiratory tracking for gated whole body PET using the Microsoft Kinect , 2012, 2012 IEEE Nuclear Science Symposium and Medical Imaging Conference Record (NSS/MIC).

[16]  Junyi Xia,et al.  A real-time respiratory motion monitoring system using KINECT: proof of concept. , 2012, Medical physics.

[17]  Mark T. Bolas,et al.  Unobtrusive measurement of subtle nonverbal behaviors with the Microsoft Kinect , 2012, VR.

[18]  R Merget,et al.  Body plethysmography--its principles and clinical use. , 2011, Respiratory medicine.

[19]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[20]  Anna Gina Perri,et al.  A New System for Continuous Monitoring of Breathing and Kinetic Activity , 2010, J. Sensors.

[21]  Reza Saatchi,et al.  Real-time vision based respiration monitoring system , 2010, 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010).

[22]  Lorenzo Scalise,et al.  Optical method for measurement of respiration rate , 2010, 2010 IEEE International Workshop on Medical Measurements and Applications.

[23]  Joachim Hornegger,et al.  Robust real-time 3D respiratory motion detection using time-of-flight cameras , 2008, International Journal of Computer Assisted Radiology and Surgery.

[24]  J. Hankinson,et al.  Standardisation of spirometry , 2005, European Respiratory Journal.

[25]  R. Pierce Spirometry: an essential clinical measurement. , 2005, Australian family physician.

[26]  Steven B. Smith,et al.  Digital Signal Processing: A Practical Guide for Engineers and Scientists , 2002 .

[27]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[28]  A Pedotti,et al.  Estimation of end-expiratory lung volume variations by optoelectronic plethysmography , 2001, Critical care medicine.

[29]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[30]  S. J. Cala,et al.  Chest wall and lung volume estimation by optical reflectance motion analysis. , 1996, Journal of applied physiology.

[31]  G Ferrigno,et al.  Three-dimensional optical analysis of chest wall motion. , 1994, Journal of applied physiology.

[32]  R. Briggs,et al.  Raised respiratory rate in elderly patients: a valuable physical sign. , 1982, British medical journal.

[33]  日向 俊二 Kinect for Windowsアプリを作ろう , 2012 .

[34]  Joan Lasenby,et al.  SLP: A Zero-Contact Non-Invasive Method for Pulmonary Function Testing , 2010, BMVC.

[35]  Ioannis T. Pavlidis,et al.  Analysis of Breathing Air Flow Patterns in Thermal Imaging , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  I. Sato,et al.  Non-contact Breath Motion Monitor ing System in Full Automation , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[37]  A Pedotti,et al.  Opto-electronic plethysmography. , 2003, Monaldi archives for chest disease = Archivio Monaldi per le malattie del torace.

[38]  Mark de Berg,et al.  Computational geometry: algorithms and applications, 3rd Edition , 1997 .

[39]  J. Amat,et al.  VISION BASED RESPIRATORY MONITORING SYSTEM , 2022 .