Markerless Active Trunk Shape Modelling for Motion Tolerant Remote Respiratory Assessment

We present a vision-based trunk-motion tolerant approach which estimates lung volume–time data remotely in forced vital capacity (FVC) and slow vital capacity (SVC) spirometry tests. After temporal modelling of trunk shape, generated using two opposing Kinects in a sequence, the chest-surface respiratory pattern is computed by performing principal component analysis on temporal geometrical features extracted from the chest and posterior shapes. We evaluate our method on a publicly available dataset of 35 subjects (300 sequences) and compare against the state-of-the-art. By filtering complex trunk motions, our proposed method calibrates the entire volume–time data using only the tidal volume scaling factor which reduces the state-of-the-art average normalised L2 error from 0.136 to 0.05.

[1]  Majid Mirmehdi,et al.  Depth-Based Whole Body Photoplethysmography in Remote Pulmonary Function Testing , 2018, IEEE Transactions on Biomedical Engineering.

[2]  Babak Taati,et al.  Noncontact Vision-Based Cardiopulmonary Monitoring in Different Sleeping Positions , 2017, IEEE Journal of Biomedical and Health Informatics.

[3]  Majid Mirmehdi,et al.  Remote, Depth-Based Lung Function Assessment , 2017, IEEE Transactions on Biomedical Engineering.

[4]  Ki H. Chon,et al.  Tidal Volume and Instantaneous Respiration Rate Estimation using a Volumetric Surrogate Signal Acquired via a Smartphone Camera , 2017, IEEE Journal of Biomedical and Health Informatics.

[5]  Majid Mirmehdi,et al.  Toward Respiratory Assessment Using Depth Measurements from a Time-of-Flight Sensor , 2017, Front. Physiol..

[6]  U. Koehler,et al.  [Respiratory Rate - a Neglected Vital Sign]. , 2017, Deutsche medizinische Wochenschrift.

[7]  Majid Mirmehdi,et al.  3D Data Acquisition and Registration Using Two Opposing Kinects , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[8]  Maysam Ghovanloo,et al.  A Vision-Based Respiration Monitoring System for Passive Airway Resistance Estimation , 2016, IEEE Transactions on Biomedical Engineering.

[9]  Wen-Jiin Tsai,et al.  Image-Based Motion-Tolerant Remote Respiratory Rate Evaluation , 2016, IEEE Sensors Journal.

[10]  Majid Mirmehdi,et al.  Remote pulmonary function testing using a depth sensor , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[11]  Majid Mirmehdi,et al.  P83 Remote pulmonary function testing – computer gaming in the respiratory world , 2015 .

[12]  S. Longhi,et al.  Respiratory rate detection algorithm based on RGB-D camera: theoretical background and experimental results. , 2014, Healthcare technology letters.

[13]  Maysam Ghovanloo,et al.  A passive quantitative measurement of airway resistance using depth data , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Yuting Yang,et al.  Noncontact Monitoring Breathing Pattern, Exhalation Flow Rate and Pulse Transit Time , 2014, IEEE Transactions on Biomedical Engineering.

[15]  O. Steichen,et al.  Respiratory rate: the neglected vital sign , 2008, The Medical journal of Australia.

[16]  Boris Aronov,et al.  Fréchet Distance for Curves, Revisited , 2006, ESA.

[17]  J. Hankinson,et al.  Standardisation of spirometry , 2005, European Respiratory Journal.

[18]  Isaac Amidror,et al.  Scattered data interpolation methods for electronic imaging systems: a survey , 2002, J. Electronic Imaging.

[19]  J. Jonas,et al.  Global, regional, and national deaths, prevalence, disability-adjusted life years, and years lived with disability for chronic obstructive pulmonary disease and asthma, 1990–2015 , 2017 .

[20]  Gerard de Haan,et al.  Video-based respiration monitoring with automatic region of interest detection , 2016, Physiological measurement.