Multicenter and Multichannel Pooling GCN for Early AD Diagnosis Based on Dual-Modality Fused Brain Network

For significant memory concern (SMC) and mild cognitive impairment (MCI), their classification performance is limited by confounding features, diverse imaging protocols, and limited sample size. To address the above limitations, we introduce a dual-modality fused brain connectivity network combining resting-state functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI), and propose three mechanisms in the current graph convolutional network (GCN) to improve classifier performance. First, we introduce a DTI-strength penalty term for constructing functional connectivity networks. Stronger structural connectivity and bigger structural strength diversity between groups provide a higher opportunity for retaining connectivity information. Second, a multi-center attention graph with each node representing a subject is proposed to consider the influence of data source, gender, acquisition equipment, and disease status of those training samples in GCN. The attention mechanism captures their different impacts on edge weights. Third, we propose a multi-channel mechanism to improve filter performance, assigning different filters to features based on feature statistics. Applying those nodes with low-quality features to perform convolution would also deteriorate filter performance. Therefore, we further propose a pooling mechanism, which introduces the disease status information of those training samples to evaluate the quality of nodes. Finally, we obtain the final classification results by inputting the multi-center attention graph into the multi-channel pooling GCN. The proposed method is tested on three datasets (i.e., an ADNI 2 dataset, an ADNI 3 dataset, and an in-house dataset). Experimental results indicate that the proposed method is effective and superior to other related algorithms, with a mean classification accuracy of 93.05% in our binary classification tasks. Our code is available at: https://github.com/Xuegang-S.

[1]  Jingyu Liu,et al.  Virtual Adversarial Training-Based Deep Feature Aggregation Network From Dynamic Effective Connectivity for MCI Identification , 2021, IEEE Transactions on Medical Imaging.

[2]  Mingxia Liu,et al.  Distribution-Guided Network Thresholding for Functional Connectivity Analysis in fMRI-Based Brain Disorder Identification , 2021, IEEE Journal of Biomedical and Health Informatics.

[3]  Alejandro F. Frangi,et al.  Parkinson’s Disease Classification and Clinical Score Regression via United Embedding and Sparse Learning From Longitudinal Data , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Mingxia Liu,et al.  Multiview Feature Learning With Multiatlas-Based Functional Connectivity Networks for MCI Diagnosis , 2020, IEEE Transactions on Cybernetics.

[5]  Shuiwang Ji,et al.  Graph U-Nets , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Dinggang Shen,et al.  Multi-site MRI harmonization via attention-guided deep domain adaptation for brain disorder identification , 2021, Medical Image Anal..

[7]  Tianfu Wang,et al.  Augmented Multicenter Graph Convolutional Network for COVID-19 Diagnosis , 2021, IEEE Transactions on Industrial Informatics.

[8]  Dinggang Shen,et al.  A Mutual Multi-Scale Triplet Graph Convolutional Network for Classification of Brain Disorders Using Functional or Structural Connectivity , 2021, IEEE Transactions on Medical Imaging.

[9]  Peng Yang,et al.  Fused Sparse Network Learning for Longitudinal Analysis of Mild Cognitive Impairment , 2021, IEEE Transactions on Cybernetics.

[10]  Alejandro F. Frangi,et al.  Graph convolution network with similarity awareness and adaptive calibration for disease-induced deterioration prediction , 2020, Medical Image Anal..

[11]  Zexuan Zhu,et al.  Identifying Autism Spectrum Disorder From Resting-State fMRI Using Deep Belief Network , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Pierrick Coupé,et al.  Multi-scale Graph-based Grading for Alzheimer's Disease Prediction , 2019, Medical Image Anal..

[13]  Dinggang Shen,et al.  Attention-Guided Deep Domain Adaptation for Brain Dementia Identification with Multi-site Neuroimaging Data , 2020, DART/DCL@MICCAI.

[14]  Chunfeng Lian,et al.  Designing weighted correlation kernels in convolutional neural networks for functional connectivity based brain disease diagnosis , 2020, Medical Image Anal..

[15]  Qian Wang,et al.  Multi-Class ASD Classification Based on Functional Connectivity and Functional Correlation Tensor via Multi-Source Domain Adaptation and Multi-View Sparse Representation , 2020, IEEE Transactions on Medical Imaging.

[16]  Dinggang Shen,et al.  Hierarchical Fully Convolutional Network for Joint Atrophy Localization and Alzheimer's Disease Diagnosis Using Structural MRI , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Dan Hu,et al.  A toolbox for brain network construction and classification (BrainNetClass) , 2019, Human brain mapping.

[18]  2020 Alzheimer's disease facts and figures , 2020, Alzheimer's & dementia : the journal of the Alzheimer's Association.

[19]  Dinggang Shen,et al.  Identifying Autism Spectrum Disorder With Multi-Site fMRI via Low-Rank Domain Adaptation , 2020, IEEE Transactions on Medical Imaging.

[20]  Yang Li,et al.  Deep Spatial-Temporal Feature Fusion From Adaptive Dynamic Functional Connectivity for MCI Identification , 2020, IEEE Transactions on Medical Imaging.

[21]  Ee-Leng Tan,et al.  Self-calibrated brain network estimation and joint non-convex multi-task learning for identification of early Alzheimer's disease , 2020, Medical Image Anal..

[22]  Daoqiang Zhang,et al.  Spatial-Temporal Dependency Modeling and Network Hub Detection for Functional MRI Analysis via Convolutional-Recurrent Network , 2019, IEEE Transactions on Biomedical Engineering.

[23]  Paul Thompson,et al.  Integrating Heterogeneous Brain Networks for Predicting Brain Disease Conditions , 2019, MICCAI.

[24]  Yue Gao,et al.  Dynamic Hypergraph Neural Networks , 2019, IJCAI.

[25]  Dinggang Shen,et al.  Weighted graph regularized sparse brain network construction for MCI identification , 2019, Pattern Recognit..

[26]  Charu C. Aggarwal,et al.  Graph Convolutional Networks with EigenPooling , 2019, KDD.

[27]  Dinggang Shen,et al.  Strength and similarity guided group-level brain functional network construction for MCI diagnosis , 2019, Pattern Recognit..

[28]  Dinggang Shen,et al.  Multimodal hyper‐connectivity of functional networks using functionally‐weighted LASSO for MCI classification , 2019, Medical Image Anal..

[29]  Jure Leskovec,et al.  Hierarchical Graph Representation Learning with Differentiable Pooling , 2018, NeurIPS.

[30]  Ben Glocker,et al.  Disease prediction using graph convolutional networks: Application to Autism Spectrum Disorder and Alzheimer's disease , 2018, Medical Image Anal..

[31]  Ben Glocker,et al.  Metric learning with spectral graph convolutions on brain connectivity networks , 2018, NeuroImage.

[32]  Chong Wang,et al.  Attention-based Graph Neural Network for Semi-supervised Learning , 2018, ArXiv.

[33]  Ronald C. Petersen,et al.  Practice guideline update summary: Mild cognitive impairment , 2018, Neurology.

[34]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[35]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[36]  Dinggang Shen,et al.  Connectivity strength‐weighted sparse group representation‐based brain network construction for MCI classification , 2017, Human brain mapping.

[37]  John J. Foxe,et al.  Insula and Inferior Frontal Gyrus' Activities Protect Memory Performance Against Alzheimer's Disease Pathology in Old Age. , 2016, Journal of Alzheimer's disease : JAD.

[38]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[39]  Dinggang Shen,et al.  Estimating functional brain networks by incorporating a modularity prior , 2016, NeuroImage.

[40]  Yang Yu,et al.  Abnormal Resting-State Functional Connectivity Strength in Mild Cognitive Impairment and Its Conversion to Alzheimer's Disease , 2015, Neural plasticity.

[41]  L. Yao,et al.  Prediction of Progressive Mild Cognitive Impairment by Multi-Modal Neuroimaging Biomarkers. , 2016, Journal of Alzheimer's disease : JAD.

[42]  D. Shen,et al.  Sparse temporally dynamic resting-state functional connectivity networks for early MCI identification , 2016, Brain Imaging and Behavior.

[43]  Laura C. Buchanan,et al.  Tracking ongoing cognition in individuals using brief, whole-brain functional connectivity patterns , 2015, Proceedings of the National Academy of Sciences.

[44]  Melonie P. Heron.  Deaths: leading causes for 2010. , 2013, National vital statistics reports : from the Centers for Disease Control and Prevention, National Center for Health Statistics, National Vital Statistics System.

[45]  Olaf Sporns,et al.  Can structure predict function in the human brain? , 2010, NeuroImage.

[46]  Li Yao,et al.  Impairment and compensation coexist in amnestic MCI default mode network , 2010, NeuroImage.

[47]  G. Zubicaray,et al.  Diffusion indices on magnetic resonance imaging and neuropsychological performance in amnestic mild cognitive impairment , 2006, Journal of Neurology, Neurosurgery & Psychiatry.

[48]  P. Whitehouse,et al.  Mild cognitive impairment , 2006, Lancet.

[49]  D. Bub,et al.  Semantic memory loss in dementia of Alzheimer's type. What do various measures measure? , 1990, Brain : a journal of neurology.