Residual and plain convolutional neural networks for 3D brain MRI classification

In the recent years there have been a number of studies that applied deep learning algorithms to neuroimaging data. Pipelines used in those studies mostly require multiple processing steps for feature extraction, although modern advancements in deep learning for image classification can provide a powerful framework for automatic feature generation and more straightforward analysis. In this paper, we show how similar performance can be achieved skipping these feature extraction steps with the residual and plain 3D convolutional neural network architectures. We demonstrate the performance of the proposed approach for classification of Alzheimer's disease versus mild cognitive impairment and normal controls on the Alzheimers Disease National Initiative (ADNI) dataset of 3D structural MRI brain scans.

[1]  Jessica A. Turner,et al.  Generation of synthetic structural magnetic resonance images for deep learning pre-training , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[2]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Roger C. Tam,et al.  Manifold Learning of Brain MRIs by Deep Learning , 2013, MICCAI.

[5]  Sidong Liu,et al.  Early diagnosis of Alzheimer's disease with deep learning , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[6]  Vince D. Calhoun,et al.  Deep learning for neuroimaging: a validation study , 2013, Front. Neurosci..

[7]  Assawin Gongvatana,et al.  Brain ventricular volume and cerebrospinal fluid biomarkers of Alzheimer's disease. , 2010, Journal of Alzheimer's disease : JAD.

[8]  Seong-Whan Lee,et al.  Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis , 2014, NeuroImage.

[9]  Hao Chen,et al.  VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain Segmentation , 2016, ArXiv.

[10]  F. Gage,et al.  Adult hippocampal neurogenesis and its role in Alzheimer's disease , 2011, Molecular Neurodegeneration.

[11]  Ayman El-Baz,et al.  Alzheimer's Disease Diagnostics by a Deeply Supervised Adaptable 3D Convolutional Network , 2016, ArXiv.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.