DeepAD: Alzheimer’s Disease Classification via Deep Convolutional Neural Networks using MRI and fMRI

To extract patterns from neuroimaging data, various statistical methods and machine learning algorithms have been explored for the diagnosis of Alzheimer’s disease among older adults in both clinical and research applications; however, distinguishing between Alzheimer’s and healthy brain data has been challenging in older adults (age > 75) due to highly similar patterns of brain atrophy and image intensities. Recently, cutting-edge deep learning technologies have rapidly expanded into numerous fields, including medical image analysis. This paper outlines state-of-the-art deep learning-based pipelines employed to distinguish Alzheimer’s magnetic resonance imaging (MRI) and functional MRI (fMRI) from normal healthy control data for a given age group. Using these pipelines, which were executed on a GPU-based high-performance computing platform, the data were strictly and carefully preprocessed. Next, scale- and shift-invariant low- to high-level features were obtained from a high volume of training images using convolutional neural network (CNN) architecture. In this study, fMRI data were used for the first time in deep learning applications for the purposes of medical image analysis and Alzheimer’s disease prediction. These proposed and implemented pipelines, which demonstrate a significant improvement in classification output over other studies, resulted in high and reproducible accuracy rates of 99.9% and 98.84% for the fMRI and MRI pipelines, respectively. Additionally, for clinical purposes, subject-level classification was performed, resulting in an average accuracy rate of 94.32% and 97.88% for the fMRI and MRI pipelines, respectively. Finally, a decision making algorithm designed for the subject-level classification improved the rate to 97.77% for fMRI and 100% for MRI pipelines.

[1]  Anna Goldenberg,et al.  TensorFlow: Biology's Gateway to Deep Learning? , 2016, Cell systems.

[2]  E. Arvesen Automatic classification of alzheimer's disease from structural MRI , 2015 .

[3]  Giovanni Montana,et al.  Predicting Alzheimer's disease: a neuroimaging study with 3D convolutional neural networks , 2015, ICPRAM 2015.

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Chalavadi Krishna Mohan,et al.  Hybrid deep neural network model for human action recognition , 2016, Appl. Soft Comput..

[6]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[7]  Dinggang Shen,et al.  Deep Learning-Based Feature Representation for AD/MCI Classification , 2013, MICCAI.

[8]  Ayman El-Baz,et al.  Alzheimer's disease diagnostics by adaptation of 3D convolutional network , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[9]  Seong-Whan Lee,et al.  Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis , 2014, NeuroImage.

[10]  Jian Sun,et al.  Functional Brain Imaging: A Comprehensive Survey , 2016, 1602.02225.

[11]  Stephen C. Strother,et al.  The Associative Memory Deficit in Aging Is Related to Reduced Selectivity of Brain Activity during Encoding , 2016, Journal of Cognitive Neuroscience.

[12]  Michael D. Greicius,et al.  Resting-State Functional MRI: A Novel Tool for Understanding Brain Networks in Neuropsychiatric Disorders , 2016 .

[13]  P. Pietrini,et al.  Altered brain functional connectivity and impaired short-term memory in Alzheimer's disease. , 2001, Brain : a journal of neurology.

[14]  Juhan Nam,et al.  Multimodal Deep Learning , 2011, ICML.

[15]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[16]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Chunhua Shen,et al.  Learning Deep Convolutional Features for MRI Based Alzheimer's Disease Classification , 2014, ArXiv.

[19]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[20]  D. Selkoe Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[21]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[22]  M. Warsi,et al.  The Fractal Nature and Functional Connectivity of Brain Function as Measured by BOLD MRI in Alzheimer’s Disease , 2012 .

[23]  Sidong Liu,et al.  High-level feature based PET image retrieval with deep learning architecture , 2014 .

[24]  Dimitrios I. Fotiadis,et al.  A supervised method to assist the diagnosis and classification of the status of Alzheimer's disease using data from an fMRI experiment , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  ALLAN RAVENTÓS,et al.  AUTOMATING NEUROLOGICAL DISEASE DIAGNOSIS USING STRUCTURAL MR BRAIN SCAN FEATURES , 2015 .

[26]  Wendy J Mack,et al.  Vascular risk factors and Alzheimer's disease: are these risk factors for plaques and tangles or for concomitant vascular pathology that increases the likelihood of dementia? An evidence-based review , 2011, Alzheimer's Research & Therapy.

[27]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[28]  Seong-Whan Lee,et al.  Latent feature representation with stacked auto-encoder for AD/MCI diagnosis , 2013, Brain Structure and Function.

[29]  S. Black,et al.  Evidence from Functional Neuroimaging of a Compensatory Prefrontal Network in Alzheimer's Disease , 2003, The Journal of Neuroscience.

[30]  Tianzi Jiang,et al.  Regional coherence changes in the early stages of Alzheimer’s disease: A combined structural and resting-state functional MRI study , 2007, NeuroImage.

[31]  Sidong Liu,et al.  Multimodal Neuroimaging Feature Learning for Multiclass Diagnosis of Alzheimer's Disease , 2015, IEEE Transactions on Biomedical Engineering.

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[33]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[34]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[35]  Dinggang Shen,et al.  A Robust Deep Model for Improved Classification of AD/MCI Patients , 2015, IEEE Journal of Biomedical and Health Informatics.

[36]  C. Grady,et al.  Age differences in the functional interactions among the default, frontoparietal control, and dorsal attention networks , 2016, Neurobiology of Aging.

[37]  David T. Jones,et al.  Resting state functional MRI in Alzheimer's Disease , 2012, Alzheimer's Research & Therapy.

[38]  Heung-Il Suk,et al.  Deep Learning in Diagnosis of Brain Disorders , 2015 .

[39]  Xiaofeng Zhu,et al.  A novel matrix-similarity based loss function for joint regression and classification in AD diagnosis , 2014, NeuroImage.

[40]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[41]  Ghassem Tofighi,et al.  Classification of Alzheimer's Disease using fMRI Data and Deep Learning Convolutional Neural Networks , 2016, ArXiv.

[42]  Yu Qiao,et al.  Object-Scene Convolutional Neural Networks for event recognition in images , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[43]  Timothy Edward John Behrens,et al.  Anatomically related grey and white matter abnormalities in adolescent-onset schizophrenia. , 2007, Brain : a journal of neurology.

[44]  Daoqiang Zhang,et al.  Label-aligned multi-task feature learning for multimodal classification of Alzheimer’s disease and mild cognitive impairment , 2016, Brain Imaging and Behavior.

[45]  Giovanni Montana,et al.  Deep neural networks for anatomical brain segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[46]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[47]  Daoqiang Zhang,et al.  Inherent Structure-Based Multiview Learning With Multitemplate Feature Representation for Alzheimer's Disease Diagnosis , 2016, IEEE Transactions on Biomedical Engineering.

[48]  Roger C. Tam,et al.  Manifold Learning of Brain MRIs by Deep Learning , 2013, MICCAI.