A highly predictive signature of cognition and brain atrophy for progression to Alzheimer's dementia

Abstract Background Clinical trials in Alzheimer's disease need to enroll patients whose cognition will decline over time, if left untreated, in order to demonstrate the efficacy of an intervention. Machine learning models used to screen for patients at risk of progression to dementia should therefore favor specificity (detecting only progressors) over sensitivity (detecting all progressors), especially when the prevalence of progressors is low. Here, we explore whether such high-risk patients can be identified using cognitive assessments and structural neuroimaging by training machine learning tools in a high-specificity regime. Results A multimodal signature of Alzheimer's dementia was first extracted from the ADNI1 dataset. We then validated the predictive value of this signature on ADNI1 patients with mild cognitive impairment (N = 235). The signature was optimized to predict progression to dementia over 3 years with low sensitivity (55.1%) but high specificity (95.6%), resulting in only moderate accuracy (69.3%) but high positive predictive value (80.4%, adjusted for a “typical” 33% prevalence rate of true progressors). These results were replicated in ADNI2 (N = 235), with 87.8% adjusted positive predictive value (96.7% specificity, 47.3% sensitivity, 85.1% accuracy). Conclusions We found that cognitive measures alone could identify high-risk individuals, with structural measurements providing a slight improvement. The signature had comparable receiver operating characteristics to standard machine learning tools, yet a marked improvement in positive predictive value was achieved over the literature by selecting a high-specificity operating point. The multimodal signature can be readily applied for the enrichment of clinical trials.

[1]  Andrea C. Bozoki,et al.  Predicting Progression from Mild Cognitive Impairment to Alzheimer's Dementia Using Clinical, MRI, and Plasma Biomarkers via Probabilistic Pattern Classification , 2016, PloS one.

[2]  Sara Rosenblum,et al.  Neuropsychological prediction of conversion to Alzheimer disease in patients with mild cognitive impairment. , 2006, Archives of general psychiatry.

[3]  Pietro Liò,et al.  A parameter-efficient deep learning approach to predict conversion from mild cognitive impairment to Alzheimer's disease , 2018, NeuroImage.

[4]  S. Belleville,et al.  Neuropsychological Measures that Predict Progression from Mild Cognitive Impairment to Alzheimer's type dementia in Older Adults: a Systematic Review and Meta-Analysis , 2017, Neuropsychology Review.

[5]  Massimo Filippi,et al.  Automated classification of Alzheimer's disease and mild cognitive impairment using a single MRI and deep neural networks , 2018, NeuroImage: Clinical.

[6]  Stefan Klöppel,et al.  BrainAGE in Mild Cognitive Impaired Patients: Predicting the Conversion to Alzheimer’s Disease , 2013, PloS one.

[7]  Di Guo,et al.  Convolutional Neural Networks-Based MRI Image Analysis for the Alzheimer’s Disease Prediction From Mild Cognitive Impairment , 2018, Front. Neurosci..

[8]  S. Gauthier,et al.  Predicting decline in mild cognitive impairment: a prospective cognitive study. , 2014, Neuropsychology.

[9]  Kyong Hwan Jin,et al.  Predicting cognitive decline with deep learning of brain metabolism and amyloid imaging , 2017, Behavioural Brain Research.

[10]  Pierre Bellec,et al.  A brain signature highly predictive of future progression to Alzheimer's dementia , 2017, 1712.08058.

[11]  H. Braak,et al.  Neuropathological stageing of Alzheimer-related changes , 2004, Acta Neuropathologica.

[12]  Michel Goedert,et al.  Tau pathology and neurodegeneration , 2013, The Lancet Neurology.

[13]  Skipper Seabold,et al.  Statsmodels: Econometric and Statistical Modeling with Python , 2010, SciPy.

[14]  Vladimir Fonov,et al.  Prediction of Alzheimer's disease in subjects with mild cognitive impairment from the ADNI cohort using patterns of cortical thinning , 2013, NeuroImage.

[15]  Ataollah Ebrahimzadeh,et al.  Predicting conversion from MCI to AD by integrating rs-fMRI and structural MRI , 2018, Comput. Biol. Medicine.

[16]  Heikki Huttunen,et al.  Machine learning framework for early MRI-based Alzheimer's conversion prediction in MCI subjects , 2015, NeuroImage.

[17]  Pedro Rosa-Neto,et al.  Identifying incipient dementia individuals using machine learning and amyloid imaging , 2017, Neurobiology of Aging.

[18]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[19]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[20]  A. Dagher,et al.  Subtypes of functional brain connectivity as early markers of neurodegeneration in Alzheimer’s disease , 2017, bioRxiv.

[21]  D. Shen,et al.  Prediction of Alzheimer's Disease and Mild Cognitive Impairment Using Cortical Morphological Patterns Chong-yaw Wee, Pew-thian Yap, and Dinggang Shen; for the Alzheimer's Disease Neuroimaging Initiative , 2022 .

[22]  Alan C. Evans,et al.  The pipeline system for Octave and Matlab (PSOM): a lightweight scripting framework and execution engine for scientific workflows , 2012, Front. Neuroinform..

[23]  A. Mitchell,et al.  Rate of progression of mild cognitive impairment to dementia – meta‐analysis of 41 robust inception cohort studies , 2009, Acta psychiatrica Scandinavica.

[24]  Juha Koikkalainen,et al.  Multi-template tensor-based morphometry: Application to analysis of Alzheimer's disease , 2011, NeuroImage.

[25]  J. Trojanowski,et al.  Heterogeneity of neuroanatomical patterns in prodromal Alzheimer’s disease: links to cognition, progression and biomarkers , 2016, Brain : a journal of neurology.

[26]  Sang Won Seo,et al.  Anatomical heterogeneity of Alzheimer disease , 2014, Neurology.

[27]  R. Petersen,et al.  Neuropathologically defined subtypes of Alzheimer's disease with distinct clinical characteristics: a retrospective study , 2011, The Lancet Neurology.

[28]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[29]  R. Petersen,et al.  Cerebrospinal fluid biomarker signature in Alzheimer's disease neuroimaging initiative subjects , 2009, Annals of neurology.

[30]  Chan Mi Kim,et al.  Prediction of Alzheimer's disease pathophysiology based on cortical thickness patterns , 2015, Alzheimer's & dementia.

[31]  Christos Davatzikos,et al.  HYDRA: Revealing heterogeneity of imaging and genetic patterns through a multiple max-margin discriminative analysis framework , 2017, NeuroImage.

[32]  Sterling C. Johnson,et al.  Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer's Disease using structural MR and FDG-PET images , 2017, ArXiv.

[33]  D. Louis Collins,et al.  Unbiased average age-appropriate atlases for pediatric studies , 2011, NeuroImage.

[34]  J. Trojanowski,et al.  Prediction of MCI to AD conversion, via MRI, CSF biomarkers, and pattern classification , 2011, Neurobiology of Aging.

[35]  Frederik Barkhof,et al.  The identification of cognitive subtypes in Alzheimer's disease dementia using latent class analysis , 2015, Journal of Neurology, Neurosurgery & Psychiatry.

[36]  P. Visser,et al.  Do MCI criteria in drug trials accurately identify subjects with predementia Alzheimer’s disease? , 2005, Journal of Neurology, Neurosurgery & Psychiatry.

[37]  for the Alzheimer’s Disease Neuroimaging Initiative Predicting Alzheimer’s disease progression using multi-modal deep learning approach , 2019 .

[38]  J. Hodges,et al.  Outcome in subgroups of mild cognitive impairment (MCI) is highly predictable using a simple algorithm , 2009, Journal of Neurology.

[39]  G. Smyth,et al.  Statistical Applications in Genetics and Molecular Biology Permutation P -values Should Never Be Zero: Calculating Exact P -values When Permutations Are Randomly Drawn , 2011 .

[40]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[41]  Philip S. Insel,et al.  Development and assessment of a composite score for memory in the Alzheimer’s Disease Neuroimaging Initiative (ADNI) , 2012, Brain Imaging and Behavior.

[42]  R. Sperling,et al.  Bayesian model reveals latent atrophy factors with dissociable cognitive trajectories in Alzheimer’s disease , 2016, Proceedings of the National Academy of Sciences.

[43]  Christos Davatzikos,et al.  Baseline and longitudinal patterns of brain atrophy in MCI patients, and their use in prediction of short-term conversion to AD: Results from ADNI , 2009, NeuroImage.

[44]  Norbert Schuff,et al.  Robust Identification of Alzheimer’s Disease subtypes based on cortical atrophy patterns , 2017 .

[45]  Deborah Blacker,et al.  Clinical prediction of Alzheimer disease dementia across the spectrum of mild cognitive impairment. , 2007, Archives of general psychiatry.

[46]  Philip S. Insel,et al.  A composite score for executive functioning, validated in Alzheimer’s Disease Neuroimaging Initiative (ADNI) participants with baseline mild cognitive impairment , 2012, Brain Imaging and Behavior.