Jointly Analyzing Alzheimer's Disease Related Structure-Function Using Deep Cross-Model Attention Network

Reversing the pathology of Alzheimer's disease (AD) has so far not been possible, a more tractable way may be having the intervention in its earlier stage, such as mild cognitive impairment (MCI) which is considered as the precursor of AD. Recent advances in deep learning have triggered a new era in AD/MCI classification and a variety of deep models and algorithms have been developed to classify multiple clinical groups (e.g. aged normal control - CN vs. MCI) and AD conversion. Unfortunately, it is still largely unknown what is the relationship between the altered functional connectivity and structural connectome at individual level. In this work, we introduced a deep cross-model attention network (DCMAT) to jointly model brain structure and function. Specifically, DCMAT is composed of one RNN (Recurrent Neural Network) layer and multiple graph attention (GAT) blocks, which can effectively represent disease-specific functional dynamics on individual structural network. The designed attention layer (in GAT block) aims to learn deep relations among different brain regions when differentiating MCI from CN. The proposed DCMAT shows promising classification performance compared to recent studies. More importantly, our results suggest that the MCI related functional interactions might go beyond the directly connected brain regions.

[1]  Wei Xu,et al.  CNN-RNN: A Unified Framework for Multi-label Image Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Xin Zhang,et al.  Characterization of task-free and task-performance brain states via functional connectome patterns , 2013, Medical Image Anal..

[4]  Li Wang,et al.  A Cascaded Multi-modality Analysis in Mild Cognitive Impairment , 2019, MLMI@MICCAI.

[5]  O Sporns,et al.  Predicting human resting-state functional connectivity from structural connectivity , 2009, Proceedings of the National Academy of Sciences.

[6]  Dinggang Shen,et al.  Deep Multi-task Multi-channel Learning for Joint Classification and Regression of Brain Status , 2017, MICCAI.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Karl J. Friston,et al.  Voxel-Based Morphometry—The Methods , 2000, NeuroImage.

[9]  Xin Zhang,et al.  Intrinsic Functional Component Analysis via Sparse Representation on Alzheimer's Disease Neuroimaging Initiative Database , 2014, Brain Connect..

[10]  Nicolai Franzmeier,et al.  Functional brain network architecture may route progression of Alzheimer's disease pathology. , 2017, Brain : a journal of neurology.

[11]  Dinggang Shen,et al.  Deep ensemble learning of sparse regression models for brain disease diagnosis , 2017, Medical Image Anal..

[12]  Daniel Rueckert,et al.  Tract-based spatial statistics: Voxelwise analysis of multi-subject diffusion data , 2006, NeuroImage.

[13]  Ghassem Tofighi,et al.  DeepAD: Alzheimer’s Disease Classification via Deep Convolutional Neural Networks using MRI and fMRI , 2016, bioRxiv.

[14]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[15]  Wenwu Zhu,et al.  Deep Learning on Graphs: A Survey , 2018, IEEE Transactions on Knowledge and Data Engineering.

[16]  Clifford R. Jack,et al.  Accelerated vs. unaccelerated serial MRI based TBM-SyN measurements for clinical trials in Alzheimer's disease , 2015, NeuroImage.

[17]  Ben Glocker,et al.  Spectral Graph Convolutions for Population-based Disease Prediction , 2017, MICCAI.

[18]  Giovanni Montana,et al.  Predicting Alzheimer's disease: a neuroimaging study with 3D convolutional neural networks , 2015, ICPRAM 2015.

[19]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[20]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[21]  Ayman El-Baz,et al.  Alzheimer's Disease Diagnostics by a Deeply Supervised Adaptable 3D Convolutional Network , 2016, ArXiv.

[22]  P. Thompson,et al.  Computational anatomical methods as applied to ageing and dementia. , 2007, The British journal of radiology.

[23]  Liang Chen,et al.  Multi-modal classification of Alzheimer's disease using nonlinear graph fusion , 2017, Pattern Recognit..