Ensemble-learning regression to estimate sleep apnea severity using at-home oximetry in adults

Abstract Overnight pulse oximetry has shown usefulness to simplify obstructive sleep apnea (OSA) diagnosis when combined with machine-learning approaches. However, the development and evaluation of a single model with ability to reach high diagnostic performance in both community-based non-referral and clinical referral cohorts are still pending. Since ensemble-learning algorithms are known for their generalization ability, we propose a least-squares boosting (LSBoost) model aimed at estimating the apnea–hypopneaindex (AHI), as the correlate clinical measure of disease severity. A thorough characterization of 8,762 nocturnal blood-oxygen saturation signals (SpO 2) obtained at home was conducted to extract the oximetric information subsequently used in the training, validation, and test stages. The estimated AHI derived from our model achieved high diagnostic ability in both referral and non-referral cohorts reaching intra-class correlation coefficients within 0.889–0.924, and Cohen’s κ within 0.478–0.663 when considering the four OSA severity categories. These resulted in accuracies ranging 87.2%–96.6%, 81.1%–87.6%, and 91.6%–94.6% when assessing the three typical AHI severity thresholds, 5 events/hour (e/h), 15 e/h, and 30 e/h, respectively. Our model also revealed the importance of the SpO 2 predictors, thereby minimizing the ‘black box’ perception traditionally attributed to the machine-learning approaches. Furthermore, a decision curve analysis emphasized the clinical usefulness of our proposal. Therefore, we conclude that the LSBoost-based model can foster development of clinically applicable and cost saving protocols for detection of patients attending primary care services, or to avoid full polysomnography in specialized sleep facilities, thus demonstrating the diagnostic usefulness of SpO 2 signals obtained at home.

[1]  B. Grant,et al.  Prediction of the apnea-hypopnea index from overnight pulse oximetry. , 2003, Chest.

[2]  Daniel Álvarez,et al.  Evaluation of Machine-Learning Approaches to Estimate Sleep Apnea Severity From At-Home Oximetry Recordings , 2019, IEEE Journal of Biomedical and Health Informatics.

[3]  A. Malhotra,et al.  Clinical guideline for the evaluation, management and long-term care of obstructive sleep apnea in adults. , 2009, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[4]  R. Enciso,et al.  Effects of CPAP and mandibular advancement device treatment in obstructive sleep apnea patients: a systematic review and meta-analysis , 2018, Sleep and Breathing.

[5]  G. C. Gutiérrez-Tobal,et al.  A machine learning-based test for adult sleep apnoea screening at home using oximetry and airflow , 2020, Scientific Reports.

[6]  S. Redline,et al.  Longitudinal evaluation of sleep-disordered breathing and sleep symptoms with change in quality of life: the Sleep Heart Health Study (SHHS). , 2009, Sleep.

[7]  Cristian Munteanu,et al.  Detection of severe obstructive sleep apnea through voice analysis , 2014, Appl. Soft Comput..

[8]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[9]  T. Penzel,et al.  Revise Respiratory Event Criteria or Revise Severity Thresholds for Sleep Apnea Definition? , 2015, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[10]  G. C. Gutiérrez-Tobal,et al.  Oximetry use in obstructive sleep apnea , 2018, Expert review of respiratory medicine.

[11]  C. Shapiro,et al.  Oxygen Desaturation Index from Nocturnal Oximetry: A Sensitive and Specific Tool to Detect Sleep-Disordered Breathing in Surgical Patients , 2012, Anesthesia and analgesia.

[12]  Sabine Van Huffel,et al.  Automatic Screening of Sleep Apnea Patients Based on the SpO2 Signal , 2019, IEEE Journal of Biomedical and Health Informatics.

[13]  Guo-Qiang Zhang,et al.  The National Sleep Research Resource: towards a sleep data commons , 2018, BCB.

[14]  L. Lux,et al.  Screening for Obstructive Sleep Apnea in Adults: Evidence Report and Systematic Review for the US Preventive Services Task Force , 2017, JAMA.

[15]  M. Gillespie,et al.  Laboratory versus Portable Sleep Studies: A Meta‐Analysis , 2006, The Laryngoscope.

[16]  M. Aliani,et al.  Prevalence of comorbidities in patients with obstructive sleep apnea syndrome, overlap syndrome and obesity hypoventilation syndrome , 2018, The clinical respiratory journal.

[17]  G. Marks,et al.  Comparison between a single-channel nasal airflow device and oximetry for the diagnosis of obstructive sleep apnea. , 2010, Sleep.

[18]  L. Olson,et al.  Prediction of sleep‐disordered breathing by unattended overnight oximetry , 1999, Journal of sleep research.

[19]  W. Wootters Statistical distance and Hilbert space , 1981 .

[20]  Yaochu Jin,et al.  Stacking-based ensemble learning of decision trees for interpretable prostate cancer detection , 2019, Appl. Soft Comput..

[21]  J Elith,et al.  A working guide to boosted regression trees. , 2008, The Journal of animal ecology.

[22]  E. Mignot,et al.  Robust, ECG-based detection of Sleep-disordered breathing in large population-based cohorts , 2020 .

[23]  Madalena Costa,et al.  Multiscale entropy analysis of complex physiologic time series. , 2002, Physical review letters.

[24]  Diego H. Milone,et al.  Screening of obstructive sleep apnea with empirical mode decomposition of pulse oximetry. , 2014, Medical engineering & physics.

[25]  S. Quan,et al.  Rules for scoring respiratory events in sleep: update of the 2007 AASM Manual for the Scoring of Sleep and Associated Events. Deliberations of the Sleep Apnea Definitions Task Force of the American Academy of Sleep Medicine. , 2012, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[26]  Lauren E Cipriano,et al.  An integrated health-economic analysis of diagnostic and therapeutic strategies in the treatment of moderate-to-severe obstructive sleep apnea. , 2011, Sleep.

[27]  Hugo Leonardo Rufiner,et al.  Discriminative methods based on sparse representations of pulse oximetry signals for sleep apnea-hypopnea detection , 2017, Biomed. Signal Process. Control..

[28]  T. Penzel,et al.  Clinical Phenotypes and Comorbidity in European Sleep Apnoea Patients , 2016, PloS one.

[29]  Francisco Lopez-Jimenez,et al.  Obstructive sleep apnea: implications for cardiac and vascular disease. , 2008, Chest.

[30]  B M Psaty,et al.  The medical cost of undiagnosed sleep apnea. , 1999, Sleep.

[31]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[32]  Nuno M. Garcia,et al.  Towards an accurate sleep apnea detection based on ECG signal: The quintessential of a wise feature selection , 2019, Appl. Soft Comput..

[33]  D. Abásolo,et al.  Nonlinear characteristics of blood oxygen saturation from nocturnal oximetry for obstructive sleep apnoea detection , 2006, Physiological measurement.

[34]  D. S. Morillo,et al.  Automated frequency domain analysis of oxygen saturation as a screening tool for SAHS. , 2012, Medical engineering & physics.

[35]  Roberto Hornero,et al.  Automated Prediction of the Apnea-Hypopnea Index from Nocturnal Oximetry Recordings , 2012, IEEE Transactions on Biomedical Engineering.

[36]  Ewout W Steyerberg,et al.  Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests , 2016, British Medical Journal.

[37]  Osvaldo A. Rosso,et al.  Statistical complexity and disequilibrium , 2003 .

[38]  Sanjay R. Patel,et al.  Estimation of the global prevalence and burden of obstructive sleep apnoea: a literature-based analysis. , 2019, The Lancet. Respiratory medicine.

[39]  Najib T. Ayas,et al.  Nasal pressure recordings to detect obstructive sleep apnea , 2006, Sleep and Breathing.

[40]  W. Kinnear,et al.  Sleep on the cheap: the role of overnight oximetry in the diagnosis of sleep apnoea hypopnoea syndrome , 1999, Thorax.

[41]  E. Elkin,et al.  Decision Curve Analysis: A Novel Method for Evaluating Prediction Models , 2006, Medical decision making : an international journal of the Society for Medical Decision Making.

[42]  Bonnie K. Lind,et al.  Methods for obtaining and analyzing unattended polysomnography data for a multicenter study. Sleep Heart Health Research Group. , 1998, Sleep.

[43]  Jinhua Zheng,et al.  A surrogate-assisted particle swarm optimization using ensemble learning for expensive problems with small sample datasets , 2020, Appl. Soft Comput..

[44]  S. Su,et al.  A novel algorithm for automatic diagnosis of sleep apnea from airflow and oximetry signals , 2020, Physiological measurement.

[45]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[46]  Huiman X. Barnhart,et al.  Comparison of ICC and CCC for assessing agreement for data without and with replications , 2008, Comput. Stat. Data Anal..

[47]  Jennifer N Miller,et al.  Screening and assessment for obstructive sleep apnea in primary care. , 2016, Sleep medicine reviews.

[48]  E. Bixler,et al.  Effects of age on sleep apnea in men: I. Prevalence and severity. , 1998, American journal of respiratory and critical care medicine.

[49]  J. Samet,et al.  The Sleep Heart Health Study: design, rationale, and methods. , 1997, Sleep.

[50]  L. Epstein,et al.  Cost-effectiveness analysis of nocturnal oximetry as a method of screening for sleep apnea-hypopnea syndrome. , 1998, Chest.

[51]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[52]  Jerome H Friedman,et al.  Multiple additive regression trees with application in epidemiology , 2003, Statistics in medicine.

[53]  Hugo Leonardo Rufiner,et al.  Automatic scoring of apnea and hypopnea events using blood oxygen saturation signals , 2020, Biomed. Signal Process. Control..

[54]  Roberto Hornero,et al.  Multivariate Analysis of Blood Oxygen Saturation Recordings in Obstructive Sleep Apnea Diagnosis , 2010, IEEE Transactions on Biomedical Engineering.

[55]  Roberto Hornero,et al.  Utility of AdaBoost to Detect Sleep Apnea-Hypopnea Syndrome From Single-Channel Airflow , 2016, IEEE Transactions on Biomedical Engineering.

[56]  D. L. Hudson,et al.  New chaotic methods for biomedical signal analysis , 2000, Proceedings 2000 IEEE EMBS International Conference on Information Technology Applications in Biomedicine. ITAB-ITIS 2000. Joint Meeting Third IEEE EMBS International Conference on Information Technol.

[57]  G. C. Gutiérrez-Tobal,et al.  Cloud algorithm-driven oximetry-based diagnosis of obstructive sleep apnoea in symptomatic habitually snoring children , 2018, European Respiratory Journal.

[58]  Peter Buhlmann,et al.  BOOSTING ALGORITHMS: REGULARIZATION, PREDICTION AND MODEL FITTING , 2007, 0804.2752.

[59]  Roberto Hornero,et al.  Improving diagnostic ability of blood oxygen saturation from overnight pulse oximetry in obstructive sleep apnea detection by means of central tendency measure , 2007, Artif. Intell. Medicine.

[60]  Indu Ayappa,et al.  Comparison of two home sleep testing devices with different strategies for diagnosis of OSA , 2018, Sleep and Breathing.

[61]  Yves Grillet,et al.  Obstructive Sleep Apnea: A Cluster Analysis at Time of Diagnosis , 2016, PloS one.

[62]  W. Karlen,et al.  Development of a Screening Tool for Sleep Disordered Breathing in Children Using the Phone Oximeter™ , 2014, PloS one.

[63]  Tom Dhaene,et al.  Automated Sleep Apnea Detection in Raw Respiratory Signals Using Long Short-Term Memory Neural Networks , 2019, IEEE Journal of Biomedical and Health Informatics.

[64]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[65]  Andrew J. Vickers,et al.  A simple, step-by-step guide to interpreting decision curve analysis , 2019, Diagnostic and Prognostic Research.

[66]  P. Bühlmann,et al.  Boosting With the L2 Loss , 2003 .

[67]  S. Quan,et al.  AASM Scoring Manual Updates for 2017 (Version 2.4). , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[68]  Elena B. Elkin,et al.  Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers , 2008, BMC Medical Informatics Decis. Mak..

[69]  F. Gudé,et al.  Oximetry spectral analysis in the diagnosis of obstructive sleep apnoea. , 1999, Clinical science.

[70]  G. C. Gutiérrez-Tobal,et al.  Nocturnal Oximetry‐based Evaluation of Habitually Snoring Children , 2017, American journal of respiratory and critical care medicine.

[71]  T. Inouye,et al.  Quantification of EEG irregularity by use of the entropy of the power spectrum. , 1991, Electroencephalography and clinical neurophysiology.

[72]  R. Hornero,et al.  Analysis of spontaneous MEG activity in mild cognitive impairment and Alzheimer's disease using spectral entropies and statistical complexity measures , 2012, Journal of neural engineering.

[73]  H. Korkalainen,et al.  Mortality‐risk‐based apnea–hypopnea index thresholds for diagnostics of obstructive sleep apnea , 2019, Journal of sleep research.

[74]  Roberto Hornero,et al.  Multiscale Entropy Analysis of Unattended Oximetric Recordings to Assist in the Screening of Paediatric Sleep Apnoea at Home , 2017, Entropy.