Predicting progression of mild cognitive impairment to dementia using neuropsychological data: a supervised learning approach using time windows

BackgroundPredicting progression from a stage of Mild Cognitive Impairment to dementia is a major pursuit in current research. It is broadly accepted that cognition declines with a continuum between MCI and dementia. As such, cohorts of MCI patients are usually heterogeneous, containing patients at different stages of the neurodegenerative process. This hampers the prognostic task. Nevertheless, when learning prognostic models, most studies use the entire cohort of MCI patients regardless of their disease stages. In this paper, we propose a Time Windows approach to predict conversion to dementia, learning with patients stratified using time windows, thus fine-tuning the prognosis regarding the time to conversion.MethodsIn the proposed Time Windows approach, we grouped patients based on the clinical information of whether they converted (converter MCI) or remained MCI (stable MCI) within a specific time window. We tested time windows of 2, 3, 4 and 5 years. We developed a prognostic model for each time window using clinical and neuropsychological data and compared this approach with the commonly used in the literature, where all patients are used to learn the models, named as First Last approach. This enables to move from the traditional question “Will a MCI patient convert to dementia somewhere in the future” to the question “Will a MCI patient convert to dementia in a specific time window”.ResultsThe proposed Time Windows approach outperformed the First Last approach. The results showed that we can predict conversion to dementia as early as 5 years before the event with an AUC of 0.88 in the cross-validation set and 0.76 in an independent validation set.ConclusionsPrognostic models using time windows have higher performance when predicting progression from MCI to dementia, when compared to the prognostic approach commonly used in the literature. Furthermore, the proposed Time Windows approach is more relevant from a clinical point of view, predicting conversion within a temporal interval rather than sometime in the future and allowing clinicians to timely adjust treatments and clinical appointments.

[1]  M. Gilardi,et al.  Magnetic resonance imaging biomarkers for the early diagnosis of Alzheimer's disease: a machine learning approach , 2015, Front. Neurosci..

[2]  Sara C. Madeira,et al.  Class Imbalance in the Prediction of Dementia from Neuropsychological Data , 2013, EPIA.

[3]  D. Powers Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness & Correlation , 2008 .

[4]  C. Jack,et al.  Hypothetical model of dynamic biomarkers of the Alzheimer's pathological cascade , 2010, The Lancet Neurology.

[5]  Heikki Huttunen,et al.  Machine learning framework for early MRI-based Alzheimer's conversion prediction in MCI subjects , 2015, NeuroImage.

[6]  João Maroco,et al.  Prediction of Dementia Patients: A Comparative Approach Using Parametric Versus Nonparametric Classifiers , 2013 .

[7]  P. Scheltens,et al.  Mild cognitive impairment (MCI) in medical practice: a critical review of the concept and new diagnostic procedure. Report of the MCI Working Group of the European Consortium on Alzheimer’s Disease , 2006, Journal of Neurology, Neurosurgery & Psychiatry.

[8]  Andrew J. Saykin,et al.  Longitudinal measurement and hierarchical classification framework for the prediction of Alzheimer’s disease , 2017, Scientific Reports.

[9]  Karin Wårdell,et al.  A physical action potential generator: design, implementation and evaluation , 2015, Front. Neurosci..

[10]  Sara Rosenblum,et al.  Neuropsychological prediction of conversion to Alzheimer disease in patients with mild cognitive impairment. , 2006, Archives of general psychiatry.

[11]  D. Salmon,et al.  Neuropsychological criteria for mild cognitive impairment improves diagnostic precision, biomarker associations, and progression rates. , 2014, Journal of Alzheimer's disease : JAD.

[12]  Christopher M. Overall,et al.  Deciphering complex mechanisms in neurodegenerative diseases: the advent of systems biology , 2009, Trends in Neurosciences.

[13]  M. Prince,et al.  World Alzheimer Report 2015 - The Global Impact of Dementia: An analysis of prevalence, incidence, cost and trends , 2015 .

[14]  J. Price,et al.  Mild cognitive impairment represents early-stage Alzheimer disease. , 2001, Archives of neurology.

[15]  Deborah Blacker,et al.  Clinical prediction of Alzheimer disease dementia across the spectrum of mild cognitive impairment. , 2007, Archives of general psychiatry.

[16]  C. Jack,et al.  Prediction of conversion from mild cognitive impairment to Alzheimer's disease dementia based upon biomarkers and neuropsychological test performance , 2012, Neurobiology of Aging.

[17]  Ana Espinosaa,et al.  A longitudinal follow-up of 550 mild cognitive impairment patients: evidence for large conversion to dementia rates and detection of major risk factors involved. , 2015, Journal of Alzheimer's disease : JAD.

[18]  Christian Salvatore,et al.  Optimizing Neuropsychological Assessments for Cognitive, Behavioral, and Functional Impairment Classification: A Machine Learning Study , 2017, Behavioural neurology.

[19]  Keith A. Johnson,et al.  Ferritin levels in the cerebrospinal fluid predict Alzheimer’s disease outcomes and are regulated by APOE , 2015, Nature Communications.

[20]  Mei Sian Chong,et al.  New DSM-V neurocognitive disorders criteria and their impact on diagnostic classifications of mild cognitive impairment and dementia in a memory clinic setting. , 2015, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[21]  Antonio Cerasa,et al.  Combining multiple approaches for the early diagnosis of Alzheimer's Disease , 2016, Pattern Recognit. Lett..

[22]  Simon Duchesne,et al.  Detecting early preclinical Alzheimer's disease via cognition, neuropsychiatry, and neuroimaging: qualitative review and recommendations for testing. , 2014, Journal of Alzheimer's disease : JAD.

[23]  Henrik Zetterberg,et al.  Comparison of Brief Cognitive Tests and CSF Biomarkers in Predicting Alzheimer’s Disease in Mild Cognitive Impairment: Six-Year Follow-Up Study , 2012, PloS one.

[24]  Kristine Yaffe,et al.  A Clinical Index to Predict Progression from Mild Cognitive Impairment to Dementia Due to Alzheimer's Disease , 2014, PloS one.

[25]  Victor R. Preedy,et al.  DSM-IV-TR , 2000 .

[26]  Ian H. Witten,et al.  Data mining in bioinformatics using Weka , 2004, Bioinform..

[27]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[28]  Jan Komorowski,et al.  Monte Carlo feature selection and rule-based models to predict Alzheimer’s disease in mild cognitive impairment , 2012, Journal of Neural Transmission.

[29]  Vladimir Fonov,et al.  Prediction of Alzheimer's disease in subjects with mild cognitive impairment from the ADNI cohort using patterns of cortical thinning , 2013, NeuroImage.

[30]  Margarida Silveira,et al.  Predicting conversion from MCI to AD with FDG-PET brain images at different prodromal stages , 2015, Comput. Biol. Medicine.

[31]  Alzheimer's Disease Neuroimaging Initiative,et al.  A point-based tool to predict conversion from mild cognitive impairment to probable Alzheimer's disease , 2014, Alzheimer's & Dementia.

[32]  Sara C Madeira,et al.  Integrative biomarker discovery in neurodegenerative diseases , 2015, Wiley interdisciplinary reviews. Systems biology and medicine.

[33]  Richard S. J. Frackowiak,et al.  How early can we predict Alzheimer's disease using computational anatomy? , 2013, Neurobiology of Aging.

[34]  A. Simmons,et al.  Predicting Progression of Alzheimer’s Disease Using Ordinal Regression , 2014, PloS one.

[35]  Satoshi Teramukai,et al.  Risk classification in mild cognitive impairment patients for developing Alzheimer's disease. , 2012, Journal of Alzheimer's disease : JAD.

[36]  R. Chapman,et al.  Please Scroll down for Article Journal of Clinical and Experimental Neuropsychology Predicting Conversion from Mild Cognitive Impairment to Alzheimer's Disease Using Neuropsychological Tests and Multivariate Methods , 2022 .

[37]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[38]  João Maroco,et al.  Data mining methods in the prediction of Dementia: A real-data comparison of the accuracy, sensitivity and specificity of linear discriminant analysis, logistic regression, neural networks, support vector machines, classification trees and random forests , 2011, BMC Research Notes.

[39]  K. Langa,et al.  The diagnosis and management of mild cognitive impairment: a clinical review. , 2014, JAMA.

[40]  Jesse S. Jin,et al.  Identification of Conversion from Mild Cognitive Impairment to Alzheimer's Disease Using Multivariate Predictors , 2011, PloS one.

[41]  Alzheimer’s Disease Neuroimaging Initiative,et al.  Ferritin levels in the cerebrospinal fluid predict Alzheimer's disease outcomes and are regulated by APOE , 2015 .

[42]  Nick C Fox,et al.  The Diagnosis of Mild Cognitive Impairment due to Alzheimer’s Disease: Recommendations from the National Institute on Aging-Alzheimer’s Association Workgroups on Diagnostic Guidelines for Alzheimer’s Disease , 2011 .

[43]  Alexandre de Mendonça,et al.  Rethinking Alzheimer’s Disease , 2012, Front. Neur..

[44]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[45]  João Maroco,et al.  Prediction of long-term (5 years) conversion to dementia using neuropsychological tests in a memory clinic setting. , 2013, Journal of Alzheimer's disease : JAD.

[46]  V. Narayan,et al.  Disease progression model for Clinical Dementia Rating–Sum of Boxes in mild cognitive impairment and Alzheimer’s subjects from the Alzheimer’s Disease Neuroimaging Initiative , 2014, Neuropsychiatric disease and treatment.

[47]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[48]  Vikas Singh,et al.  Predictive markers for AD in a multi-modality framework: An analysis of MCI progression in the ADNI population , 2011, NeuroImage.