3D Camera and Pulse Oximeter for Respiratory Events Detection

Objective: The purpose of this study was to derive a respiratory movement signal from a 3D time-of-flight camera and to investigate if it can be used in combination with SpO2 to detect respiratory events comparable to polysomnography (PSG) based detection. Methods: We derived a respiratory signal from a 3D camera and developed a new algorithm that detects reduced respiratory movement and SpO2 desaturation to score respiratory events. The method was tested on 61 patients’ synchronized 3D video and PSG recordings. The predicted apnea-hypopnea index (AHI), calculated based on total sleep time, and predicted severity were compared to manual PSG annotations (manualPSG). Predicted AHI evaluation, measured by intraclass correlation (ICC), and severity classification were performed. Furthermore, the results were evaluated by 30-second epoch analysis, labelled either as respiratory event or normal breathing, wherein the accuracy, sensitivity, specificity and Cohen's kappa were calculated. Results: The predicted AHI scored an ICC r = 0.94 (0.90 – 0.96 at 95% confidence interval, p < 0.001) compared to manualPSG. Severity classification scored 80% accuracy, with no misclassification by more than one severity level. Based on 30-second epoch analysis, the method scored a Cohen's kappa = 0.72, accuracy = 0.88, sensitivity = 0.80, and specificity = 0.91. Conclusion: Our detection method using SpO2 and 3D camera had excellent reliability and substantial agreement with PSG-based scoring. Significance: This method showed the potential to reliably detect respiratory events without airflow and respiratory belt sensors, sensors that can be uncomfortable to patients and susceptible to movement artefacts.

[1]  Heinrich Garn,et al.  Measurement of respiratory effort in sleep by 3D camera and respiratory inductance plethysmography , 2019, Somnologie.

[2]  M. Düzlü,et al.  The efficacy of Watch PAT in obstructive sleep apnea syndrome diagnosis , 2014, European Archives of Oto-Rhino-Laryngology.

[3]  Robert Riener,et al.  A Novel Approach to Assess Sleep-Related Rhythmic Movement Disorder in Children Using Automatic 3D Analysis , 2019, Front. Psychiatry.

[4]  Georges Kaddoum,et al.  Unobtrusive Sleep Monitoring Using Cardiac, Breathing and Movements Activities: An Exhaustive Review , 2018, IEEE Access.

[5]  Elise Lachat,et al.  Assessment and Calibration of a RGB-D Camera (Kinect v2 Sensor) Towards a Potential Use for Close-Range 3D Modeling , 2015, Remote. Sens..

[6]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[7]  Eugenijus Kaniusas Biomedical Signals and Sensors I , 2012 .

[8]  V. Kapur,et al.  Obstructive sleep apnea devices for out-of-center (OOC) testing: technology evaluation. , 2011, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[9]  J. Wheatley,et al.  Validation of the Sonomat: a contactless monitoring system used for the diagnosis of sleep disordered breathing. , 2014, Sleep.

[10]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[11]  Daniel Sánchez Morillo,et al.  Probabilistic neural network approach for the detection of SAHS from overnight pulse oximetry , 2012, Medical & Biological Engineering & Computing.

[12]  A. Chesson,et al.  The American Academy of Sleep Medicine (AASM) Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications , 2007 .

[13]  D. Falie,et al.  Sleep monitoring and sleep apnea event detection using a 3D camera , 2010, 2010 8th International Conference on Communications.

[14]  Vladimir Stankovic,et al.  Sleep Apnea Detection via Depth Video and Audio Feature Learning , 2017, IEEE Transactions on Multimedia.

[15]  Zahra Moussavi,et al.  Sleep apnea monitoring and diagnosis based on pulse oximetery and tracheal sound signals , 2010, Medical & Biological Engineering & Computing.

[16]  Thomas Penzel,et al.  Tracheal sound analysis for detection of sleep disordered breathing , 2019, Somnologie.

[17]  Martin Schätz,et al.  Extraction of breathing features using MS Kinect for sleep stage detection , 2016, Signal Image Video Process..

[18]  Ales Procházka,et al.  Microsoft Kinect Visual and Depth Sensors for Breathing and Heart Rate Analysis , 2016, Sensors.

[19]  W. Flemons,et al.  Access to diagnosis and treatment of patients with suspected sleep apnea. , 2004, American journal of respiratory and critical care medicine.

[20]  Y. Kemaloğlu,et al.  Reliability of SleepStrip as a screening test in obstructive sleep apnea patients , 2014, European Archives of Oto-Rhino-Laryngology.

[21]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[22]  Kwang Suk Park,et al.  Real-Time Automatic Apneic Event Detection Using Nocturnal Pulse Oximetry , 2018, IEEE Transactions on Biomedical Engineering.

[23]  Daniel J Buysse,et al.  Sleep–Related Breathing Disorders in Adults: Recommendations for Syndrome Definition and Measurement Techniques in Clinical Research , 2000 .

[24]  N J Douglas,et al.  The sleep hypopnea syndrome. , 1988, The American review of respiratory disease.

[25]  Sang-Heon Lee,et al.  Real Time Apnoea Monitoring of Children Using the Microsoft Kinect Sensor: A Pilot Study , 2017, Sensors.

[26]  Sanjay R. Patel,et al.  Estimation of the global prevalence and burden of obstructive sleep apnoea: a literature-based analysis. , 2019, The Lancet. Respiratory medicine.

[27]  Susan M. Astley,et al.  Evaluation of Kinect 3D Sensor for Healthcare Imaging , 2016, Journal of medical and biological engineering.

[28]  Takemi Matsui,et al.  Non-contact diagnostic system for sleep apnea–hypopnea syndrome based on amplitude and phase analysis of thoracic and abdominal Doppler radars , 2015, Medical & Biological Engineering & Computing.

[29]  Carlos Villalpando,et al.  0492 COMPARING THREE HOME SLEEP APNEA TESTING DEVICES TO POLYSOMNOGRAPHY: SIMULTANEOUS AND MULTI-NIGHT ASSESSMENTS , 2017 .

[30]  Heinrich Garn,et al.  0678 Contactless 3D Detection Of Leg Movements In Sleep , 2018 .

[31]  Wenhan Zhu,et al.  Combination of near-infrared and thermal imaging techniques for the remote and simultaneous measurements of breathing and heart rates under sleep situation , 2018, PloS one.

[32]  Thomas Penzel,et al.  Contactless recording of sleep apnea and periodic leg movements by nocturnal 3-D-video and subsequent visual perceptive computing , 2019, Scientific Reports.

[33]  Thomas Penzel,et al.  The use of tracheal sounds for the diagnosis of sleep apnoea , 2017, Breathe.