Early Detection of Alzheimer’s Disease Using Magnetic Resonance Imaging: A Novel Approach Combining Convolutional Neural Networks and Ensemble Learning

Early detection is critical for effective management of Alzheimer’s disease (AD) and screening for mild cognitive impairment (MCI) is common practice. Among several deep-learning techniques that have been applied to assessing structural brain changes on magnetic resonance imaging (MRI), convolutional neural network (CNN) has gained popularity due to its superb efficiency in automated feature learning with the use of a variety of multilayer perceptrons. Meanwhile, ensemble learning (EL) has shown to be beneficial in the robustness of learning-system performance via integrating multiple models. Here, we proposed a classifier ensemble developed by combining CNN and EL, i.e., the CNN-EL approach, to identify subjects with MCI or AD using MRI: i.e., classification between (1) AD and healthy cognition (HC), (2) MCIc (MCI patients who will convert to AD) and HC, and (3) MCIc and MCInc (MCI patients who will not convert to AD). For each binary classification task, a large number of CNN models were trained applying a set of sagittal, coronal, or transverse MRI slices; these CNN models were then integrated into a single ensemble. Performance of the ensemble was evaluated using stratified fivefold cross-validation method for 10 times. The number of the intersection points determined by the most discriminable slices separating two classes in a binary classification task among the sagittal, coronal, and transverse slice sets, transformed into the standard Montreal Neurological Institute (MNI) space, acted as an indicator to assess the ability of a brain region in which the points were located to classify AD. Thus, the brain regions with most intersection points were considered as those mostly contributing to the early diagnosis of AD. The result revealed an accuracy rate of 0.84 ± 0.05, 0.79 ± 0.04, and 0.62 ± 0.06, respectively, for classifying AD vs. HC, MCIc vs. HC, and MCIc vs. MCInc, comparable to previous reports and a 3D deep learning approach (3D-SENet) based on a more state-of-the-art and popular Squeeze-and-Excitation Networks model using channel attention mechanism. Notably, the intersection points accurately located the medial temporal lobe and several other structures of the limbic system, i.e., brain regions known to be struck early in AD. More interestingly, the classifiers disclosed multiple patterned MRI changes in the brain in AD and MCIc, involving these key regions. These results suggest that as a data-driven method, the combined CNN and EL approach can locate the most discriminable brain regions indicated by the trained ensemble model while the generalization ability of the ensemble model was maximized to successfully capture AD-related brain variations early in the disease process; it can also provide new insights into understanding the complex heterogeneity of whole-brain MRI changes in AD. Further research is needed to examine the clinical implication of the finding, capability of the advocated CNN-EL approach to help understand and evaluate an individual subject’s disease status, symptom burden and progress, and the generalizability of the advocated CNN-EL approach to locate the most discriminable brain regions in the detection of other brain disorders such as schizophrenia, autism, and severe depression, in a data-driven way.

[1]  Zhang Chun,et al.  A Survey of Selective Ensemble Learning Algorithms , 2011 .

[2]  Charles DeCarli,et al.  Alzheimer abnormalities of the amygdala with Klüver-Bucy syndrome symptoms: an amygdaloid variant of Alzheimer disease. , 2009, Archives of neurology.

[3]  Martin N. Rossor,et al.  Alzheimer's disease and neuroimaging , 2001 .

[4]  Masao Kishikawa,et al.  Early diagnosis of Alzheimer's? , 1994, Nature.

[5]  N. Schuff,et al.  Magnetic resonance imaging of the entorhinal cortex and hippocampus in mild cognitive impairment and Alzheimer's disease , 2001, Journal of neurology, neurosurgery, and psychiatry.

[6]  SchmidhuberJürgen Deep learning in neural networks , 2015 .

[7]  Moo K. Chung,et al.  Spatially augmented LPboosting for AD classification with evaluations on the ADNI dataset , 2009, NeuroImage.

[8]  Dinggang Shen,et al.  Deep ensemble learning of sparse regression models for brain disease diagnosis , 2017, Medical Image Anal..

[9]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Sidong Liu,et al.  Early diagnosis of Alzheimer's disease with deep learning , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[11]  Nick C Fox,et al.  Amnestic Mild Cognitive Impairment: Structural MR Imaging Findings Predictive of Conversion to Alzheimer Disease , 2008, American Journal of Neuroradiology.

[12]  Ulrich Seidl,et al.  Hippocampal morphology and autobiographic memory in mild cognitive impairment and Alzheimer's disease. , 2012, Current Alzheimer research.

[13]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[14]  Yu Zhang,et al.  The Human Brainnetome Atlas: A New Brain Atlas Based on Connectional Architecture , 2016, Cerebral cortex.

[15]  Koenraad Van Leemput,et al.  Automated model-based tissue classification of MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[16]  Feng Shi,et al.  Study of brain morphology change in Alzheimer’s disease and amnestic mild cognitive impairment compared with normal controls , 2019, General Psychiatry.

[17]  Ming Yang,et al.  Classification of Alzheimer’s Disease Based on Eight-Layer Convolutional Neural Network with Leaky Rectified Linear Unit and Max Pooling , 2018, Journal of Medical Systems.

[18]  R. Castellani,et al.  Alzheimer disease. , 2010, Disease-a-month : DM.

[19]  Andrés Ortiz,et al.  Ensembles of Deep Learning Architectures for the Early Diagnosis of the Alzheimer's Disease , 2016, Int. J. Neural Syst..

[20]  Fan Li,et al.  Alzheimer's disease diagnosis based on multiple cluster dense convolutional networks , 2018, Comput. Medical Imaging Graph..

[21]  M. Gilardi,et al.  Magnetic resonance imaging biomarkers for the early diagnosis of Alzheimer's disease: a machine learning approach , 2015, Front. Neurosci..

[22]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[23]  Jyoti Islam,et al.  Brain MRI analysis for Alzheimer’s disease diagnosis using an ensemble system of deep convolutional neural networks , 2018, Brain Informatics.

[24]  Chun-Xia Zhang,et al.  A Survey of Selective Ensemble Learning Algorithms: A Survey of Selective Ensemble Learning Algorithms , 2011 .

[25]  M. Folstein,et al.  Clinical diagnosis of Alzheimer's disease , 1984, Neurology.

[26]  Dimitrios I. Fotiadis,et al.  A supervised method to assist the diagnosis and monitor progression of Alzheimer's disease using data from an fMRI experiment , 2011, Artif. Intell. Medicine.

[27]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[28]  Bela G Nelson,et al.  The Amygdala as a Locus of Pathologic Misfolding in Neurodegenerative Diseases , 2018, Journal of neuropathology and experimental neurology.

[29]  H. Möller,et al.  Functional connectivity of the fusiform gyrus during a face-matching task in subjects with mild cognitive impairment. , 2006, Brain : a journal of neurology.

[30]  M. Mesulam,et al.  Neurofibrillary tangles, amyloid, and memory in aging and mild cognitive impairment. , 2003, Archives of neurology.

[31]  P. Scheltens,et al.  Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS–ADRDA criteria , 2007, The Lancet Neurology.

[32]  Ronald J Killiany,et al.  Hippocampal Subregions are Differentially Affected in the Progression to Alzheimer's Disease , 2012, Anatomical record.

[33]  Charles D. Smith,et al.  Hippocampal Sclerosis of Aging Can Be Segmental: Two Cases and Review of the Literature , 2015, Journal of neuropathology and experimental neurology.

[34]  R. Mayeux,et al.  Hippocampal and entorhinal atrophy in mild cognitive impairment , 2007, Neurology.

[35]  Marina Boccardi,et al.  Medial temporal atrophy in early and late-onset Alzheimer's disease , 2014, Neurobiology of Aging.

[36]  Szu-Han Wang,et al.  The striatum, the hippocampus, and short-term memory binding: Volumetric analysis of the subcortical grey matter's role in mild cognitive impairment , 2019, NeuroImage: Clinical.

[37]  Reinhard Klette,et al.  Early Diagnosis of Alzheimer's Disease Using Deep Learning , 2019, Proceedings of the 2nd International Conference on Control and Computer Vision - ICCCV 2019.

[38]  Di Guo,et al.  Convolutional Neural Networks-Based MRI Image Analysis for the Alzheimer’s Disease Prediction From Mild Cognitive Impairment , 2018, Front. Neurosci..

[39]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[40]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[41]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[42]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[43]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[44]  G. Small,et al.  Thickness in Entorhinal and Subicular Cortex Predicts Episodic Memory Decline in Mild Cognitive Impairment , 2011, International journal of Alzheimer's disease.

[45]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[46]  J. Morris The Clinical Dementia Rating (CDR) , 1993, Neurology.

[47]  Narendra Ahuja,et al.  Cresceptron: a self-organizing neural network which grows adaptively , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[48]  Shuo Wang,et al.  Overview of deep learning , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[49]  F. Schmitt,et al.  Synaptic loss in the inferior temporal gyrus in mild cognitive impairment and Alzheimer's disease. , 2011, Journal of Alzheimer's disease : JAD.

[50]  Robert Howard,et al.  The dopaminergic basis of cognitive and motor performance in Alzheimer's disease , 2010, Neurobiology of Disease.

[51]  G. V. Van Hoesen,et al.  The Parahippocampal Gyrus in Alzheimer's Disease: Clinical and Preclinical Neuroanatomical Correlates , 2000, Annals of the New York Academy of Sciences.

[52]  Matthias L. Schroeter,et al.  Neural correlates of Alzheimer's disease and mild cognitive impairment: A systematic and quantitative meta-analysis involving 1351 patients , 2009, NeuroImage.

[53]  Ninon Burgos,et al.  Convolutional Neural Networks for Classification of Alzheimer's Disease: Overview and Reproducible Evaluation , 2019, Medical Image Anal..

[54]  Zhijun Zhang,et al.  Can multi-modal neuroimaging evidence from hippocampus provide biomarkers for the progression of amnestic mild cognitive impairment? , 2014, Neuroscience Bulletin.

[55]  Athanasios Alexiou,et al.  Biomarkers for Alzheimer’s Disease Diagnosis , 2017, Current Alzheimer research.

[56]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[57]  K Davidson,et al.  Early diagnosis? , 2001, The New Zealand medical journal.

[58]  Nikos A. Aspragathos,et al.  Introduction to the special issue on Theories and Methodologies for mechatronics design , 2010 .

[59]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[60]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[61]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[63]  Shan Sung Liew,et al.  Bounded activation functions for enhanced training stability of deep neural networks on visual pattern recognition problems , 2016, Neurocomputing.

[64]  D. Selkoe Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[65]  Mohamad Habes,et al.  A deep learning model for early prediction of Alzheimer's disease dementia based on hippocampal magnetic resonance imaging data , 2019, Alzheimer's & Dementia.

[66]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[67]  S. Rigatti Random Forest. , 2017, Journal of insurance medicine.

[68]  Geoffrey E. Hinton Deep belief networks , 2009, Scholarpedia.

[69]  Stavros J. Baloyannis,et al.  Mitochondrial alterations in Alzheimer's disease. , 2006, Journal of Alzheimer's disease : JAD.

[70]  Sanjeev Arora,et al.  The Multiplicative Weights Update Method: a Meta-Algorithm and Applications , 2012, Theory Comput..

[71]  M. Albert,et al.  Entorhinal and transentorhinal atrophy in mild cognitive impairment using longitudinal diffeomorphometry , 2017, Alzheimer's & dementia.

[72]  Alan C. Evans,et al.  Structural neuroimaging as clinical predictor: A review of machine learning applications , 2018, NeuroImage: Clinical.

[73]  Heikki Huttunen,et al.  Machine learning framework for early MRI-based Alzheimer's conversion prediction in MCI subjects , 2015, NeuroImage.