Attention-based 3D Convolutional Network for Alzheimer’s Disease Diagnosis and Biomarkers Exploration

Modern advancements in deep learning provide a powerful framework for disease classification based on neuroimaging data. However, interpreting the classification decision of convolutional neural network remains a challenging task. It is crucial to track the attention of neural network and provide valuable information about which brain areas are particularly related to the diagnosis of disease. In this paper, we propose a novel attention-based 3D ResNet architecture to diagnose Alzheimer’s disease (AD) and explore potential biological markers. Experiments are conducted on 532 subjects (0227 of patients with AD and 305 of normal controls). By introducing the attention mechanism, the proposed approach further improves the classification performance and identifies important brain regions for AD classification simultaneously. The experiments also show that significant brain regions for AD diagnosis captured by our attention-based network are accompanied by significant changes in gray matter.

[1]  Sidong Liu,et al.  Early diagnosis of Alzheimer's disease with deep learning , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[2]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[5]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[7]  Anthony Maida,et al.  Natural Image Bases to Represent Neuroimaging Data , 2013, ICML.

[8]  Jenny Benois-Pineau,et al.  Classification of sMRI for Alzheimer's disease Diagnosis with CNN: Single Siamese Networks with 2D+? Approach and Fusion on ADNI , 2017, ICMR.

[9]  Matthew Toews,et al.  Local discriminative characterization of MRI for Alzheimer's disease , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[10]  Christos Davatzikos,et al.  A review on neuroimaging-based classification studies and associated feature extraction methods for Alzheimer's disease and its prodromal stages , 2017, NeuroImage.

[11]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[12]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.

[13]  Sandra E. Black,et al.  Functional imaging studies of episodic memory in Alzheimer's disease: a quantitative meta-analysis , 2009, NeuroImage.

[14]  Sanjay Ranka,et al.  Visual Explanations From Deep 3D Convolutional Neural Networks for Alzheimer's Disease Classification , 2018, AMIA.

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Dinggang Shen,et al.  Deep ensemble learning of sparse regression models for brain disease diagnosis , 2017, Medical Image Anal..

[17]  Tianzi Jiang,et al.  Regional homogeneity, functional connectivity and imaging markers of Alzheimer's disease: A review of resting-state fMRI studies , 2008, Neuropsychologia.

[18]  H. Braak,et al.  Staging of alzheimer's disease-related neurofibrillary changes , 1995, Neurobiology of Aging.

[19]  Jing Yang,et al.  Voxelwise meta-analysis of gray matter anomalies in Alzheimer's disease and mild cognitive impairment using anatomic likelihood estimation , 2012, Journal of the Neurological Sciences.

[20]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[21]  Yulia Dodonova,et al.  Residual and plain convolutional neural networks for 3D brain MRI classification , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).