Clinical Prediction Models for Sleep Apnea: The Importance of Medical History over Symptoms.

STUDY OBJECTIVE Obstructive sleep apnea (OSA) is a treatable contributor to morbidity and mortality. However, most patients with OSA remain undiagnosed. We used a new machine learning method known as SLIM (Supersparse Linear Integer Models) to test the hypothesis that a diagnostic screening tool based on routinely available medical information would be superior to one based solely on patient-reported sleep-related symptoms. METHODS We analyzed polysomnography (PSG) and self-reported clinical information from 1,922 patients tested in our clinical sleep laboratory. We used SLIM and 7 state-of-the-art classification methods to produce predictive models for OSA screening using features from: (i) self-reported symptoms; (ii) self-reported medical information that could, in principle, be extracted from electronic health records (demographics, comorbidities), or (iii) both. RESULTS For diagnosing OSA, we found that model performance using only medical history features was superior to model performance using symptoms alone, and similar to model performance using all features. Performance was similar to that reported for other widely used tools: sensitivity 64.2% and specificity 77%. SLIM accuracy was similar to state-of-the-art classification models applied to this dataset, but with the benefit of full transparency, allowing for hands-on prediction using yes/no answers to a small number of clinical queries. CONCLUSION To predict OSA, variables such as age, sex, BMI, and medical history are superior to the symptom variables we examined for predicting OSA. SLIM produces an actionable clinical tool that can be applied to data that is routinely available in modern electronic health records, which may facilitate automated, rather than manual, OSA screening. COMMENTARY A commentary on this article appears in this issue on page 159.

[1]  Cynthia Rudin,et al.  Supersparse linear integer models for optimized medical scoring systems , 2015, Machine Learning.

[2]  G. Kalamaras,et al.  Evaluation of five different questionnaires for assessing sleep apnea syndrome in a sleep clinic. , 2014, Sleep medicine.

[3]  R. Chervin,et al.  Validation of the STOP-BANG Questionnaire among Patients Referred for Suspected Obstructive Sleep Apnea. , 2013, Journal of sleep disorders-- treatment & care.

[4]  M Brandon Westover,et al.  The impact of body posture and sleep stages on sleep apnea severity in adults. , 2012, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[5]  G. Naccarelli,et al.  CHADS2 and CHA2DS2-VASc risk factors to predict first cardiovascular hospitalization among atrial fibrillation/atrial flutter patients. , 2012, The American journal of cardiology.

[6]  M Brandon Westover,et al.  Classification algorithms for predicting sleepiness and sleep apnea severity , 2012, Journal of sleep research.

[7]  V. Kapur,et al.  Obstructive sleep apnea devices for out-of-center (OOC) testing: technology evaluation. , 2011, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[8]  Pooja Budhiraja,et al.  Sleep-disordered breathing and cardiovascular disorders. , 2010, Respiratory care.

[9]  V. Kapur,et al.  Obstructive sleep apnea: diagnosis, epidemiology, and economics. , 2010, Respiratory care.

[10]  A. Newman,et al.  Prospective Study of Obstructive Sleep Apnea and Incident Coronary Heart Disease and Heart Failure: The Sleep Heart Health Study , 2010, Circulation.

[11]  F. Chung,et al.  A systematic review of screening questionnaires for obstructive sleep apnea , 2010, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[12]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[13]  Matt T. Bianchi,et al.  Screening for Obstructive Sleep Apnea: Bayes Weighs in , 2009 .

[14]  B. Caffo,et al.  Sleep-Disordered Breathing and Mortality: A Prospective Cohort Study , 2009, PLoS medicine.

[15]  P. Jennum,et al.  Epidemiology of sleep apnoea/hypopnoea syndrome and sleep-disordered breathing , 2009, European Respiratory Journal.

[16]  Adelaide M. Arruda-Olson,et al.  Sleep apnea and cardiovascular disease: an American Heart Association/American College of Cardiology Foundation Scientific Statement from the American Heart Association Council for High Blood Pressure Research Professional Education Committee, Council on Clinical Cardiology, Stroke Council, and Coun , 2008, Journal of the American College of Cardiology.

[17]  C. Shapiro,et al.  STOP Questionnaire: A Tool to Screen Patients for Obstructive Sleep Apnea , 2008, Anesthesiology.

[18]  N. Punjabi The epidemiology of adult obstructive sleep apnea. , 2008, Proceedings of the American Thoracic Society.

[19]  W. M. Anderson,et al.  Clinical guidelines for the use of unattended portable monitors in the diagnosis of obstructive sleep apnea in adult patients. Portable Monitoring Task Force of the American Academy of Sleep Medicine. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[20]  A. Agustí,et al.  Long-term cardiovascular outcomes in men with obstructive sleep apnoea-hypopnoea with or without treatment with continuous positive airway pressure: an observational study , 2005, The Lancet.

[21]  T. Young,et al.  Risk factors for obstructive sleep apnea in adults. , 2004, JAMA.

[22]  T. Douglas Bradley,et al.  High prevalence of unrecognized sleep apnoea in drug-resistant hypertension , 2001, Journal of hypertension.

[23]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001, Statistical Science.

[24]  Erry,et al.  Prospective study of the association between sleep-disordered breathing and hypertension. , 2000, The New England journal of medicine.

[25]  M. Kryger,et al.  Clinical presentations of obstructive sleep apnea syndrome. , 1999, Progress in cardiovascular diseases.

[26]  R. Chervin,et al.  The Epworth Sleepiness Scale may not reflect objective measures of sleepiness or sleep apnea , 1999, Neurology.

[27]  S. Quan,et al.  Lack of Impact of Mild Obstructive Sleep Apnea on Sleepiness, Mood and Quality of Life. , 2014, Southwest journal of pulmonary & critical care.

[28]  Cathy Goldstein,et al.  Obstructive sleep apnea-hypopnea and incident stroke: the sleep heart health study. , 2010, American journal of respiratory and critical care medicine.

[29]  J. Fleetham,et al.  The Economic Impact of Obstructive Sleep Apnea , 2007, Lung.

[30]  C. Berka,et al.  Assessment of Obstructive Sleep Apnea Risk and Severity in Truck Drivers: Validation of a Screening Questionnaire , 2007 .

[31]  F. J. Nieto,et al.  Relation of sleepiness to respiratory disturbance index: the Sleep Heart Health Study. , 1999, American journal of respiratory and critical care medicine.

[32]  Support Vector Machines: The Interface to libsvm in package e1071 , 2022 .