3D Inception-based CNN with sMRI and MD-DTI data fusion for Alzheimer's Disease diagnostics

In the last decade, computer-aided early diagnostics of Alzheimer's Disease (AD) and its prodromal form, Mild Cognitive Impairment (MCI), has been the subject of extensive research. Some recent studies have shown promising results in the AD and MCI determination using structural and functional Magnetic Resonance Imaging (sMRI, fMRI), Positron Emission Tomography (PET) and Diffusion Tensor Imaging (DTI) modalities. Furthermore, fusion of imaging modalities in a supervised machine learning framework has shown promising direction of research. In this paper we first review major trends in automatic classification methods such as feature extraction based methods as well as deep learning approaches in medical image analysis applied to the field of Alzheimer's Disease diagnostics. Then we propose our own design of a 3D Inception-based Convolutional Neural Network (CNN) for Alzheimer's Disease diagnostics. The network is designed with an emphasis on the interior resource utilization and uses sMRI and DTI modalities fusion on hippocampal ROI. The comparison with the conventional AlexNet-based network using data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset (this http URL) demonstrates significantly better performance of the proposed 3D Inception-based CNN.

[1]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[2]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[3]  Eduardo Romero,et al.  Exploring Alzheimer's anatomical patterns through convolutional networks , 2017, Symposium on Medical Information Processing and Analysis.

[4]  Colin Studholme,et al.  Deformation-based mapping of volume change from serial brain MRI in the presence of local tissue contrast change , 2006, IEEE Transactions on Medical Imaging.

[5]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[6]  Byungkyu Brian Park,et al.  SVM-Based Classification of Diffusion Tensor Imaging Data for Diagnosing Alzheimer's Disease and Mild Cognitive Impairment , 2015, ICIC.

[7]  Wei Chen,et al.  Automatic Recognition of Mild Cognitive Impairment from MRI Images Using Expedited Convolutional Neural Networks , 2017, ICANN.

[8]  Danni Cheng,et al.  Classification of MR brain images by combination of multi-CNNs for AD diagnosis , 2017, International Conference on Digital Image Processing.

[9]  H. Benali,et al.  Support vector machine-based classification of Alzheimer’s disease from whole-brain anatomical MRI , 2009, Neuroradiology.

[10]  Yu Li,et al.  Predicting Clinical Outcomes of Alzheimer's Disease from Complex Brain Networks , 2017, ADMA.

[11]  Parisa Rashidi,et al.  Ensemble Classification of Alzheimer's Disease and Mild Cognitive Impairment Based on Complex Graph Measures from Diffusion Tensor Images , 2017, Front. Neurosci..

[12]  M. Gilardi,et al.  Magnetic resonance imaging biomarkers for the early diagnosis of Alzheimer's disease: a machine learning approach , 2015, Front. Neurosci..

[13]  Ayman El-Baz,et al.  Alzheimer's Disease Diagnostics by a Deeply Supervised Adaptable 3D Convolutional Network , 2016, ArXiv.

[14]  Jenny Benois-Pineau,et al.  FuseMe: Classification of sMRI images by fusion of Deep CNNs in 2D+ε projections , 2017, CBMI.

[15]  Danni Cheng,et al.  Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis , 2018, Neuroinformatics.

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[18]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[19]  Stanley Durrleman,et al.  FLAIR MR Image Synthesis By Using 3D Fully Convolutional Networks for Multiple Sclerosis , 2018 .

[20]  Dorin Comaniciu,et al.  Multi-Scale Deep Reinforcement Learning for Real-Time 3D-Landmark Detection in CT Scans , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Lauge Sørensen,et al.  Early detection of Alzheimer's disease using MRI hippocampal texture , 2016, Human brain mapping.

[22]  Dinggang Shen,et al.  Multi-stage Diagnosis of Alzheimer's Disease with Incomplete Multimodal Data via Multi-task Deep Learning , 2017, DLMIA/ML-CDS@MICCAI.

[23]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[24]  Yaozong Gao,et al.  Detecting Anatomical Landmarks for Fast Alzheimer’s Disease Diagnosis , 2016, IEEE Transactions on Medical Imaging.

[25]  Suhuai Luo,et al.  Automatic Alzheimer’s Disease Recognition from MRI Data Using Deep Learning Method , 2017 .

[26]  Giovanni Montana,et al.  Predicting Alzheimer's disease: a neuroimaging study with 3D convolutional neural networks , 2015, ICPRAM 2015.

[27]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[28]  Kaiming He,et al.  Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour , 2017, ArXiv.

[29]  Shihui Ying,et al.  Multimodal Neuroimaging Feature Learning With Multimodal Stacked Deep Polynomial Networks for Diagnosis of Alzheimer's Disease , 2018, IEEE Journal of Biomedical and Health Informatics.

[30]  Pierrick Coupé,et al.  Towards a unified analysis of brain maturation and aging across the entire lifespan: A MRI analysis , 2017, Human brain mapping.

[31]  Jenny Benois-Pineau,et al.  Classification of sMRI for AD Diagnosis with Convolutional Neuronal Networks: A Pilot 2-D+ \epsilon Study on ADNI , 2017, MMM.

[32]  Tanya Glozman,et al.  Hidden Cues : Deep Learning for Alzheimer ’ s Disease Classification CS 331 B project final report , 2016 .

[33]  Jun Zhang,et al.  Detecting Anatomical Landmarks From Limited Medical Imaging Data Using Two-Stage Task-Oriented Deep Neural Networks , 2017, IEEE Transactions on Image Processing.

[34]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Hyung-Jeong Yang,et al.  Multimodal learning using convolution neural network and Sparse Autoencoder , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[36]  Chokri Ben Amar,et al.  Recognition of Alzheimer's disease and Mild Cognitive Impairment with multimodal image-derived biomarkers and Multiple Kernel Learning , 2017, Neurocomputing.

[37]  Ghassem Tofighi,et al.  Classification of Alzheimer's Disease Structural MRI Data by Deep Learning Convolutional Neural Networks , 2016, ArXiv.

[38]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[39]  E. B. Wilson.  Probable Inference, the Law of Succession, and Statistical Inference , 1927 .

[40]  Jenny Benois-Pineau,et al.  3D CNN-based classification using sMRI and MD-DTI images for Alzheimer disease studies , 2018, ArXiv.

[41]  Dong Ni,et al.  Discriminative Learning for Alzheimer's Disease Diagnosis via Canonical Correlation Analysis and Multimodal Fusion , 2016, Front. Aging Neurosci..

[42]  Oualid M. Benkarim,et al.  Early Prediction of Alzheimer's Disease with Non-local Patch-Based Longitudinal Descriptors , 2017, Patch-MI@MICCAI.

[43]  Pierrick Coupé,et al.  Hippocampal microstructural damage correlates with memory impairment in clinically isolated syndrome suggestive of multiple sclerosis , 2017, Multiple sclerosis.

[44]  Yulia Dodonova,et al.  Residual and plain convolutional neural networks for 3D brain MRI classification , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[45]  Ghassem Tofighi,et al.  Deep Learning-based Pipeline to Recognize Alzheimer’s Disease using fMRI Data , 2016, bioRxiv.

[46]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[47]  Chokri Ben Amar,et al.  Classification of Alzheimer’s disease subjects from MRI using hippocampal visual features , 2014, Multimedia Tools and Applications.

[48]  G. Frisoni,et al.  Structural correlates of early and late onset Alzheimer’s disease: voxel based morphometric study , 2004, Journal of Neurology, Neurosurgery & Psychiatry.

[49]  Dinggang Shen,et al.  Deep ensemble learning of sparse regression models for brain disease diagnosis , 2017, Medical Image Anal..

[50]  Ghassem Tofighi,et al.  DeepAD: Alzheimer’s Disease Classification via Deep Convolutional Neural Networks using MRI and fMRI , 2016, bioRxiv.

[51]  R. Newcombe.  Two-sided confidence intervals for the single proportion: comparison of seven methods. , 1998, Statistics in medicine.

[52]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[53]  Mohamad Habes,et al.  Deep Ordinal Ranking for Multi-Category Diagnosis of Alzheimer's Disease using Hippocampal MRI data , 2017, ArXiv.

[54]  Prospero C. Naval,et al.  DemNet: A Convolutional Neural Network for the detection of Alzheimer's Disease and Mild Cognitive Impairment , 2016, 2016 IEEE Region 10 Conference (TENCON).

[55]  Chokri Ben Amar,et al.  Alzheimer's disease diagnosis on structural MR images using circular harmonic functions descriptors on hippocampus and posterior cingulate cortex , 2015, Comput. Medical Imaging Graph..

[56]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[57]  Dinggang Shen,et al.  Deep Multi-task Multi-channel Learning for Joint Classification and Regression of Brain Status , 2017, MICCAI.