3D CNN-based classification using sMRI and MD-DTI images for Alzheimer disease studies

Computer-aided early diagnosis of Alzheimers Disease (AD) and its prodromal form, Mild Cognitive Impairment (MCI), has been the subject of extensive research in recent years. Some recent studies have shown promising results in the AD and MCI determination using structural and functional Magnetic Resonance Imaging (sMRI, fMRI), Positron Emission Tomography (PET) and Diffusion Tensor Imaging (DTI) modalities. Furthermore, fusion of imaging modalities in a supervised machine learning framework has shown promising direction of research. In this paper we first review major trends in automatic classification methods such as feature extraction based methods as well as deep learning approaches in medical image analysis applied to the field of Alzheimer's Disease diagnostics. Then we propose our own algorithm for Alzheimer's Disease diagnostics based on a convolutional neural network and sMRI and DTI modalities fusion on hippocampal ROI using data from the Alzheimers Disease Neuroimaging Initiative (ADNI) database (this http URL). Comparison with a single modality approach shows promising results. We also propose our own method of data augmentation for balancing classes of different size and analyze the impact of the ROI size on the classification results as well.

[1]  Hyung-Jeong Yang,et al.  Multimodal learning using convolution neural network and Sparse Autoencoder , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[2]  Chokri Ben Amar,et al.  Recognition of Alzheimer's disease and Mild Cognitive Impairment with multimodal image-derived biomarkers and Multiple Kernel Learning , 2017, Neurocomputing.

[3]  Wei Chen,et al.  Automatic Recognition of Mild Cognitive Impairment from MRI Images Using Expedited Convolutional Neural Networks , 2017, ICANN.

[4]  Dong Ni,et al.  Discriminative Learning for Alzheimer's Disease Diagnosis via Canonical Correlation Analysis and Multimodal Fusion , 2016, Front. Aging Neurosci..

[5]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[6]  Byungkyu Brian Park,et al.  SVM-Based Classification of Diffusion Tensor Imaging Data for Diagnosing Alzheimer's Disease and Mild Cognitive Impairment , 2015, ICIC.

[7]  Danni Cheng,et al.  Classification of MR brain images by combination of multi-CNNs for AD diagnosis , 2017, International Conference on Digital Image Processing.

[8]  H. Benali,et al.  Support vector machine-based classification of Alzheimer’s disease from whole-brain anatomical MRI , 2009, Neuroradiology.

[9]  Ghassem Tofighi,et al.  Classification of Alzheimer's Disease Structural MRI Data by Deep Learning Convolutional Neural Networks , 2016, ArXiv.

[10]  Yu Li,et al.  Predicting Clinical Outcomes of Alzheimer's Disease from Complex Brain Networks , 2017, ADMA.

[11]  Dinggang Shen,et al.  Deep Multi-task Multi-channel Learning for Joint Classification and Regression of Brain Status , 2017, MICCAI.

[12]  Pierrick Coupé,et al.  Hippocampal microstructural damage correlates with memory impairment in clinically isolated syndrome suggestive of multiple sclerosis , 2017, Multiple sclerosis.

[13]  Yulia Dodonova,et al.  Residual and plain convolutional neural networks for 3D brain MRI classification , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[14]  Ghassem Tofighi,et al.  DeepAD: Alzheimer’s Disease Classification via Deep Convolutional Neural Networks using MRI and fMRI , 2016, bioRxiv.

[15]  Parisa Rashidi,et al.  Ensemble Classification of Alzheimer's Disease and Mild Cognitive Impairment Based on Complex Graph Measures from Diffusion Tensor Images , 2017, Front. Neurosci..

[16]  Jenny Benois-Pineau,et al.  FuseMe: Classification of sMRI images by fusion of Deep CNNs in 2D+ε projections , 2017, CBMI.

[17]  Dinggang Shen,et al.  Deep ensemble learning of sparse regression models for brain disease diagnosis , 2017, Medical Image Anal..

[18]  Ghassem Tofighi,et al.  Deep Learning-based Pipeline to Recognize Alzheimer’s Disease using fMRI Data , 2016, bioRxiv.

[19]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[20]  Chokri Ben Amar,et al.  Classification of Alzheimer’s disease subjects from MRI using hippocampal visual features , 2014, Multimedia Tools and Applications.

[21]  Eduardo Romero,et al.  Exploring Alzheimer's anatomical patterns through convolutional networks , 2017, Symposium on Medical Information Processing and Analysis.

[22]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[23]  G. Frisoni,et al.  Structural correlates of early and late onset Alzheimer’s disease: voxel based morphometric study , 2004, Journal of Neurology, Neurosurgery & Psychiatry.

[24]  R. Newcombe.  Two-sided confidence intervals for the single proportion: comparison of seven methods. , 1998, Statistics in medicine.

[25]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[26]  Mohamad Habes,et al.  Deep Ordinal Ranking for Multi-Category Diagnosis of Alzheimer's Disease using Hippocampal MRI data , 2017, ArXiv.

[27]  Prospero C. Naval,et al.  DemNet: A Convolutional Neural Network for the detection of Alzheimer's Disease and Mild Cognitive Impairment , 2016, 2016 IEEE Region 10 Conference (TENCON).

[28]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[29]  Suhuai Luo,et al.  Automatic Alzheimer’s Disease Recognition from MRI Data Using Deep Learning Method , 2017 .

[30]  Giovanni Montana,et al.  Predicting Alzheimer's disease: a neuroimaging study with 3D convolutional neural networks , 2015, ICPRAM 2015.

[31]  Ayman El-Baz,et al.  Alzheimer's Disease Diagnostics by a Deeply Supervised Adaptable 3D Convolutional Network , 2016, ArXiv.

[32]  Chokri Ben Amar,et al.  Alzheimer's disease diagnosis on structural MR images using circular harmonic functions descriptors on hippocampus and posterior cingulate cortex , 2015, Comput. Medical Imaging Graph..

[33]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[34]  E. B. Wilson.  Probable Inference, the Law of Succession, and Statistical Inference , 1927 .

[35]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[36]  Colin Studholme,et al.  Deformation-based mapping of volume change from serial brain MRI in the presence of local tissue contrast change , 2006, IEEE Transactions on Medical Imaging.

[37]  Shihui Ying,et al.  Multimodal Neuroimaging Feature Learning With Multimodal Stacked Deep Polynomial Networks for Diagnosis of Alzheimer's Disease , 2018, IEEE Journal of Biomedical and Health Informatics.

[38]  Jenny Benois-Pineau,et al.  Classification of sMRI for AD Diagnosis with Convolutional Neuronal Networks: A Pilot 2-D+ \epsilon Study on ADNI , 2017, MMM.

[39]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.