Automatic classi fi cation of patients with Alzheimer ' s disease from structural MRI : A comparison of ten methods using the ADNI database

Recently, several high dimensional classification methods have been proposed to automatically discriminate between patients with Alzheimer's disease (AD) or mild cognitive impairment (MCI) and elderly controls (CN) based on T1-weighted MRI. However, these methods were assessed on different populations, making it difficult to compare their performance. In this paper, we evaluated the performance of ten approaches (five voxel-based methods, three methods based on cortical thickness and two methods based on the hippocampus) using 509 subjects from the ADNI database. Three classification experiments were performed: CN vs AD, CN vs MCIc (MCI who had converted to AD within 18 months, MCI converters - MCIc) and MCIc vs MCInc (MCI who had not converted to AD within 18 months, MCI non-converters - MCInc). Data from 81 CN, 67 MCInc, 39 MCIc and 69 AD were used for training and hyperparameters optimization. The remaining independent samples of 81 CN, 67 MCInc, 37 MCIc and 68 AD were used to obtain an unbiased estimate of the performance of the methods. For AD vs CN, whole-brain methods (voxel-based or cortical thickness-based) achieved high accuracies (up to 81% sensitivity and 95% specificity). For the detection of prodromal AD (CN vs MCIc), the sensitivity was substantially lower. For the prediction of conversion, no classifier obtained significantly better results than chance. We also compared the results obtained using the DARTEL registration to that using SPM5 unified segmentation. DARTEL significantly improved six out of 20 classification experiments and led to lower results in only two cases. Overall, the use of feature selection did not improve the performance but substantially increased the computation times.

[1]  Kiralee M. Hayashi,et al.  Dynamics of Gray Matter Loss in Alzheimer's Disease , 2003, The Journal of Neuroscience.

[2]  H. Benali,et al.  Discrimination between Alzheimer disease, mild cognitive impairment, and normal aging by using automated segmentation of the hippocampus. , 2008, Radiology.

[3]  Dinggang Shen,et al.  Classification of Structural Images via High-Dimensional Image Warping, Robust Feature Extraction, and SVM , 2005, MICCAI.

[4]  Nick C Fox,et al.  Automatic classification of MR scans in Alzheimer's disease. , 2008, Brain : a journal of neurology.

[5]  P. Jaccard,et al.  Etude comparative de la distribution florale dans une portion des Alpes et des Jura , 1901 .

[6]  R. Woods,et al.  Cortical change in Alzheimer's disease detected with a disease-specific population-based brain atlas. , 2001, Cerebral cortex.

[7]  A. Dale,et al.  Regional rates of neocortical atrophy from normal aging to early Alzheimer disease , 2009, Neurology.

[8]  Kiralee M. Hayashi,et al.  Mapping cortical change in Alzheimer's disease, brain development, and schizophrenia , 2004, NeuroImage.

[9]  P. Scheltens,et al.  Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS–ADRDA criteria , 2007, The Lancet Neurology.

[10]  Norbert Schuff,et al.  Optimizing power to track brain degeneration in Alzheimer's disease and mild cognitive impairment with tensor-based morphometry: An ADNI study of 515 subjects , 2009, NeuroImage.

[11]  Nick C Fox,et al.  Imaging cerebral atrophy: normal ageing to Alzheimer's disease , 2004, The Lancet.

[12]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[13]  Anders M. Dale,et al.  Reliability in multi-site structural MRI studies: Effects of gradient non-linearity correction on phantom and human data , 2006, NeuroImage.

[14]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[15]  Alan C. Evans,et al.  Automated cortical thickness measurements from MRI can accurately separate Alzheimer's patients from normal elderly controls , 2008, Neurobiology of Aging.

[16]  C. Jack,et al.  Usefulness of MRI measures of entorhinal cortex versus hippocampus in AD , 2000, Neurology.

[17]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[18]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[19]  Gabriel Gold,et al.  Mixed Dementia: Epidemiology, Diagnosis, and Treatment , 2002, Journal of the American Geriatrics Society.

[20]  William Jagust,et al.  Positron emission tomography and magnetic resonance imaging in the diagnosis and prediction of dementia , 2006, Alzheimer's & Dementia.

[21]  G. Frisoni,et al.  Hippocampus and entorhinal cortex in frontotemporal dementia and Alzheimer’s disease: a morphometric MRI study , 2000, Biological Psychiatry.

[22]  Karl J. Friston,et al.  A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains , 2001, NeuroImage.

[23]  Dominique Hasboun,et al.  Anatomically constrained region deformation for the automated segmentation of the hippocampus and the amygdala: Method and validation on controls and patients with Alzheimer’s disease , 2007, NeuroImage.

[24]  M. Folstein,et al.  Clinical diagnosis of Alzheimer's disease , 1984, Neurology.

[25]  Alexander Hammers,et al.  Automatic segmentation of the hippocampus and the amygdala driven by hybrid constraints: Method and validation , 2009, NeuroImage.

[26]  E. Tangalos,et al.  Mild Cognitive Impairment Clinical Characterization and Outcome , 1999 .

[27]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[28]  C. Jack,et al.  MRI patterns of atrophy associated with progression to AD in amnestic mild cognitive impairment , 2008, Neurology.

[29]  Dinggang Shen,et al.  Morphological classification of brains via high-dimensional shape transformations and machine learning methods , 2004, NeuroImage.

[30]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[31]  Karl J. Friston,et al.  Automatic Differentiation of Anatomical Patterns in the Human Brain: Validation with Studies of Degenerative Dementias , 2002, NeuroImage.

[32]  A. McKinney,et al.  Automated MRI measures identify individuals with mild cognitive impairment and Alzheimer's disease , 2010 .

[33]  Marie Chupin,et al.  Multidimensional classification of hippocampal shape features discriminates Alzheimer's disease and mild cognitive impairment from normal aging , 2009, NeuroImage.

[34]  Griselda J. Garrido,et al.  A voxel-based morphometry study of temporal lobe gray matter reductions in Alzheimer’s disease , 2003, Neurobiology of Aging.

[35]  J. Morris,et al.  The Cortical Signature of Alzheimer's Disease: Regionally Specific Cortical Thinning Relates to Symptom Severity in Very Mild to Mild AD Dementia and is Detectable in Asymptomatic Amyloid-Positive Individuals , 2008, Cerebral cortex.

[36]  S. Resnick,et al.  Detection of prodromal Alzheimer's disease via pattern classification of magnetic resonance imaging , 2008, Neurobiology of Aging.

[37]  R. Leahy,et al.  Magnetic Resonance Image Tissue Classification Using a Partial Volume Model , 2001, NeuroImage.

[38]  Brigitte Landeau,et al.  Using voxel-based morphometry to map the structural changes associated with rapid conversion in MCI: A longitudinal MRI study , 2005, NeuroImage.

[39]  Christos Davatzikos,et al.  Baseline and longitudinal patterns of brain atrophy in MCI patients, and their use in prediction of short-term conversion to AD: Results from ADNI , 2009, NeuroImage.

[40]  Henrik Zetterberg,et al.  Alzheimer's disease , 2006, The Lancet.

[41]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[42]  Jean-Claude Baron,et al.  Early diagnosis of alzheimer’s disease: contribution of structural neuroimaging , 2003, NeuroImage.

[43]  H. Benali,et al.  Support vector machine-based classification of Alzheimer’s disease from whole-brain anatomical MRI , 2009, Neuroradiology.

[44]  Nick C. Fox,et al.  Global and local gray matter loss in mild cognitive impairment and Alzheimer's disease , 2004, NeuroImage.

[45]  H. Benali,et al.  Fully automatic hippocampus segmentation and classification in Alzheimer's disease and mild cognitive impairment applied on data from ADNI , 2009, Hippocampus.

[46]  Marie Chupin,et al.  Can voxel based morphometry, manual segmentation and automated segmentation equally detect hippocampal volume differences in acute depression? , 2009, NeuroImage.

[47]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[48]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[49]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[50]  Gunnar Rätsch,et al.  Large Scale Multiple Kernel Learning , 2006, J. Mach. Learn. Res..

[51]  Dinggang Shen,et al.  COMPARE: Classification of Morphological Patterns Using Adaptive Regional Elements , 2007, IEEE Transactions on Medical Imaging.

[52]  M. Albert,et al.  Amnestic MCI or prodromal Alzheimer's disease? , 2004, The Lancet Neurology.

[53]  D Bld,et al.  Atrophy rate in medial temporal lobe during progression of Alzheimer disease. , 2005 .

[54]  Sandra E. Black,et al.  Misclassified Tissue Volumes in Alzheimer Disease Patients With White Matter Hyperintensities: Importance of Lesion Segmentation Procedures for Volumetric Analysis , 2008, Stroke.

[55]  A. Dale,et al.  Thinning of the cerebral cortex in aging. , 2004, Cerebral cortex.

[56]  C. Jack,et al.  3D maps from multiple MRI illustrate changing atrophy patterns as subjects progress from mild cognitive impairment to Alzheimer's disease. , 2007, Brain : a journal of neurology.

[57]  J. Winn,et al.  Brain , 1878, The Lancet.

[58]  Michael I. Jordan,et al.  Multiple kernel learning, conic duality, and the SMO algorithm , 2004, ICML.

[59]  Xiaoying Wu,et al.  Structural and functional biomarkers of prodromal Alzheimer's disease: A high-dimensional pattern classification study , 2008, NeuroImage.

[60]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[61]  Nello Cristianini,et al.  A statistical framework for genomic data fusion , 2004, Bioinform..

[62]  P. Narayana,et al.  Compensation for surface coil sensitivity variation in magnetic resonance imaging. , 1988, Magnetic resonance imaging.

[63]  J. Morris The Clinical Dementia Rating (CDR) , 1993, Neurology.

[64]  Clifford R. Jack,et al.  Alzheimer's disease diagnosis in individual subjects using structural MR images: Validation studies , 2008, NeuroImage.

[65]  et al.,et al.  Spatial patterns of brain atrophy in MCI patients, identified via high-dimensional pattern classification, predict subsequent cognitive decline , 2008, NeuroImage.

[66]  J. Pariente,et al.  Early diagnosis of Alzheimer's disease using cortical thickness: impact of cognitive reserve , 2009, Brain : a journal of neurology.

[67]  Janaina Mourão Miranda,et al.  Classifying brain states and determining the discriminating activation patterns: Support Vector Machine on functional MRI data , 2005, NeuroImage.

[68]  C. Jack,et al.  Medial temporal atrophy on MRI in normal aging and very mild Alzheimer's disease , 1997, Neurology.

[69]  Jing Li,et al.  Heterogeneous data fusion for alzheimer's disease study , 2008, KDD.

[70]  A. Convit,et al.  Atrophy of the medial occipitotemporal, inferior, and middle temporal gyri in non-demented elderly predict decline to Alzheimer’s disease☆ , 2000, Neurobiology of Aging.

[71]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[72]  C. Jack,et al.  Rate of medial temporal lobe atrophy in typical aging and Alzheimer's disease , 1998, Neurology.

[73]  André J. W. van der Kouwe,et al.  Age-associated alterations in cortical gray and white matter signal intensity and gray to white matter contrast , 2009, NeuroImage.

[74]  Manjit,et al.  Neurology , 1912, NeuroImage.

[75]  Michael A Yassa,et al.  A quantitative evaluation of cross-participant registration techniques for MRI studies of the medial temporal lobe , 2009, NeuroImage.

[76]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[77]  H. Soininen,et al.  Volumes of the Entorhinal and Perirhinal Cortices in Alzheimer’s Disease , 1998, Neurobiology of Aging.

[78]  Emma J. Burton,et al.  A comprehensive study of gray matter loss in patients with Alzheimer’s disease using optimized voxel-based morphometry , 2003, NeuroImage.

[79]  A. Convit,et al.  Specific Hippocampal Volume Reductions in Individuals at Risk for Alzheimer’s Disease , 1997, Neurobiology of Aging.

[80]  X. Wu,et al.  Individual patient diagnosis of AD and FTD via high-dimensional pattern classification of MRI , 2008, NeuroImage.

[81]  Moo K. Chung,et al.  Spatially augmented LPboosting for AD classification with evaluations on the ADNI dataset , 2009, NeuroImage.

[82]  Alan C. Evans,et al.  Focal decline of cortical thickness in Alzheimer's disease identified by computational neuroanatomy. , 2004, Cerebral cortex.

[83]  G. Frisoni,et al.  MRI of hippocampus and entorhinal cortex in mild cognitive impairment: A follow-up study , 2008, Neurobiology of Aging.

[84]  S. Resnick,et al.  An image-processing system for qualitative and quantitative volumetric analysis of brain images. , 1998, Journal of computer assisted tomography.

[85]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[86]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[87]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[88]  Akram Bakkour,et al.  The cortical signature of prodromal AD , 2009, Neurology.

[89]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[90]  H. Soininen,et al.  MRI of the Hippocampus in Alzheimer’s Disease: Sensitivity, Specificity, and Analysis of the Incorrectly Classified Subjects , 1998, Neurobiology of Aging.

[91]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[92]  John G. Csernansky,et al.  Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults , 2007, Journal of Cognitive Neuroscience.