Exploration of machine learning techniques in predicting multiple sclerosis disease course

Objective To explore the value of machine learning methods for predicting multiple sclerosis disease course. Methods 1693 CLIMB study patients were classified as increased EDSS≥1.5 (worsening) or not (non-worsening) at up to five years after baseline visit. Support vector machines (SVM) were used to build the classifier, and compared to logistic regression (LR) using demographic, clinical and MRI data obtained at years one and two to predict EDSS at five years follow-up. Results Baseline data alone provided little predictive value. Clinical observation for one year improved overall SVM sensitivity to 62% and specificity to 65% in predicting worsening cases. The addition of one year MRI data improved sensitivity to 71% and specificity to 68%. Use of non-uniform misclassification costs in the SVM model, weighting towards increased sensitivity, improved predictions (up to 86%). Sensitivity, specificity, and overall accuracy improved minimally with additional follow-up data. Predictions improved within specific groups defined by baseline EDSS. LR performed more poorly than SVM in most cases. Race, family history of MS, and brain parenchymal fraction, ranked highly as predictors of the non-worsening group. Brain T2 lesion volume ranked highly as predictive of the worsening group. Interpretation SVM incorporating short-term clinical and brain MRI data, class imbalance corrective measures, and classification costs may be a promising means to predict MS disease course, and for selection of patients suitable for more aggressive treatment regimens.

[1]  C. Wolfson,et al.  A Markov model of the natural history of multiple sclerosis. , 1985, Neuroepidemiology.

[2]  C Confavreux,et al.  Improvements to a simple Markov model of the natural history of multiple sclerosis. I. Short-term prognosis. , 1987, Neuroepidemiology.

[3]  B Bass,et al.  The natural history of multiple sclerosis: a geographically based study. 2. Predictive value of the early clinical course. , 1989, Brain : a journal of neurology.

[4]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[5]  B Bass,et al.  The natural history of multiple sclerosis: a geographically based study. I. Clinical course and disability. , 1989, Brain : a journal of neurology.

[6]  O. Andersen,et al.  Prognostic factors in a multiple sclerosis incidence cohort with twenty-five years of follow-up. , 1993, Brain : a journal of neurology.

[7]  San Cristóbal Mateo,et al.  The Lack of A Priori Distinctions Between Learning Algorithms , 1996 .

[8]  M. Amato,et al.  A prospective study on the prognosis of multiple sclerosis , 2000, Neurological Sciences.

[9]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[10]  Hompson,et al.  A LONGITUDINAL STUDY OF ABNORMALITIES ON MRI AND DISABILITY FROM MULTIPLE SCLEROSIS , 2002 .

[11]  K. Zou,et al.  Quantitative analysis of MRI signal abnormalities of brain white matter with high reproducibility and accuracy , 2002, Journal of magnetic resonance imaging : JMRI.

[12]  J H Simon,et al.  Eight-year follow-up study of brain atrophy in patients with MS , 2002, Neurology.

[13]  P. Adeleine,et al.  Early clinical predictors and progression of irreversible disability in multiple sclerosis: an amnesic process. , 2003, Brain : a journal of neurology.

[14]  Susan A Gauthier,et al.  A model for the comprehensive investigation of a chronic autoimmune disease: the multiple sclerosis CLIMB study. , 2006, Autoimmunity reviews.

[15]  S. Vukusic,et al.  Age at disability milestones in multiple sclerosis. , 2006, Brain : a journal of neurology.

[16]  Silvana Quaglini,et al.  Early prediction of the long term evolution of multiple sclerosis: the Bayesian Risk Estimate for Multiple Sclerosis (BREMS) score , 2006, Journal of Neurology, Neurosurgery & Psychiatry.

[17]  R A Betensky,et al.  Predicting short-term disability in multiple sclerosis , 2007, Neurology.

[18]  F. Barkhof,et al.  Predicting short-term disability progression in early multiple sclerosis: added value of MRI parameters , 2007, Journal of Neurology, Neurosurgery, and Psychiatry.

[19]  P. Vermersch,et al.  Natural history of multiple sclerosis with childhood onset. , 2007, The New England journal of medicine.

[20]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[21]  Rohit Bakshi,et al.  Rate of brain atrophy in benign vs early multiple sclerosis. , 2009, Archives of neurology.

[22]  Ashutosh Kumar Singh,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2010 .

[23]  Maria Pia Sormani,et al.  Magnetic resonance active lesions as individual-level surrogate for relapses in multiple sclerosis , 2011, Multiple sclerosis.

[24]  E. Mowry Natural history of multiple sclerosis: early prognostic factors. , 2011, Neurologic clinics.

[25]  Pablo Villoslada,et al.  Computational classifiers for predicting the short-term course of Multiple sclerosis , 2011, BMC neurology.

[26]  C. Polman,et al.  Clinical scales in progressive MS: predicting long-term disability , 2012, Multiple sclerosis.

[27]  B. Healy,et al.  Assessment of Definitions of Sustained Disease Progression in Relapsing-Remitting Multiple Sclerosis , 2013, Multiple sclerosis international.

[28]  W. Gaissmaier,et al.  Prognostic Risk Estimates of Patients with Multiple Sclerosis and Their Physicians: Comparison to an Online Analytical Risk Counseling Tool , 2013, PloS one.

[29]  A Winkelmann,et al.  A Web-based tool for personalized prediction of long-term disease course in patients with multiple sclerosis , 2012, European journal of neurology.

[30]  Can we predict the evolution of an unpredictable disease like multiple sclerosis? , 2013, European journal of neurology.

[31]  Olivier Gout,et al.  Treatment effect on brain atrophy correlates with treatment effect on disability in multiple sclerosis , 2014, Annals of neurology.

[32]  Marram P. Olson,et al.  Precision medicine in chronic disease management: The multiple sclerosis BioScreen , 2014, Annals of neurology.

[33]  D. Arnold,et al.  Treatment effect on brain atrophy correlates with treatment effect on disability in multiple sclerosis , 2014, Annals of neurology.