GAT-LI: a graph attention network based learning and interpreting method for functional brain network classification

Background Autism spectrum disorders (ASD) imply a spectrum of symptoms rather than a single phenotype. ASD could affect brain connectivity at different degree based on the severity of the symptom. Given their excellent learning capability, graph neural networks (GNN) methods have recently been used to uncover functional connectivity patterns and biological mechanisms in neuropsychiatric disorders, such as ASD. However, there remain challenges to develop an accurate GNN learning model and understand how specific decisions of these graph models are made in brain network analysis. Results In this paper, we propose a graph attention network based learning and interpreting method, namely GAT-LI, which learns to classify functional brain networks of ASD individuals versus healthy controls (HC), and interprets the learned graph model with feature importance. Specifically, GAT-LI includes a graph learning stage and an interpreting stage. First, in the graph learning stage, a new graph attention network model, namely GAT2, uses graph attention layers to learn the node representation, and a novel attention pooling layer to obtain the graph representation for functional brain network classification. We experimentally compared GAT2 model’s performance on the ABIDE I database from 1035 subjects against the classification performances of other well-known models, and the results showed that the GAT2 model achieved the best classification performance. We experimentally compared the influence of different construction methods of brain networks in GAT2 model. We also used a larger synthetic graph dataset with 4000 samples to validate the utility and power of GAT2 model. Second, in the interpreting stage, we used GNNExplainer to interpret learned GAT2 model with feature importance. We experimentally compared GNNExplainer with two well-known interpretation methods including Saliency Map and DeepLIFT to interpret the learned model, and the results showed GNNExplainer achieved the best interpretation performance. We further used the interpretation method to identify the features that contributed most in classifying ASD versus HC. Conclusion We propose a two-stage learning and interpreting method GAT-LI to classify functional brain networks and interpret the feature importance in the graph model. The method should also be useful in the classification and interpretation tasks for graph data from other biomedical scenarios.

[1]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[2]  Brittany G Travers,et al.  Motor Learning in Individuals With Autism Spectrum Disorder: Activation in Superior Parietal Lobule Related to Learning and Repetitive Behaviors , 2015, Autism research : official journal of the International Society for Autism Research.

[3]  Mert R. Sabuncu,et al.  Machine learning in resting-state fMRI analysis , 2018, Magnetic resonance imaging.

[4]  Alvis Cheuk M. Fong,et al.  ASD-DiagNet: A Hybrid Learning Approach for Detection of Autism Spectrum Disorder Using fMRI Data , 2019, Front. Neuroinform..

[5]  Li Qingyang,et al.  Towards Automated Analysis of Connectomes: The Configurable Pipeline for the Analysis of Connectomes (C-PAC) , 2013 .

[6]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[7]  Christian Desrosiers,et al.  Learnable Pooling in Graph Convolutional Networks for Brain Surface Analysis , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Avanti Shrikumar,et al.  Learning Important Features Through Propagating Activation Differences , 2017, ICML.

[9]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[10]  Margot J. Taylor,et al.  Atypical spatiotemporal signatures of working memory brain processes in autism , 2015, Translational Psychiatry.

[11]  Yuan Zhou,et al.  Efficient Interpretation of Deep Learning Models Using Graph Structure and Cooperative Game Theory: Application to ASD Biomarker Discovery , 2019, IPMI.

[12]  Ben Glocker,et al.  Graph Saliency Maps through Spectral Convolutional Networks: Application to Sex Classification with Brain Connectivity , 2018, GRAIL/Beyond-MIC@MICCAI.

[13]  Daniel P. Kennedy,et al.  The Autism Brain Imaging Data Exchange: Towards Large-Scale Evaluation of the Intrinsic Brain Architecture in Autism , 2013, Molecular Psychiatry.

[14]  Jure Leskovec,et al.  Hierarchical Graph Representation Learning with Differentiable Pooling , 2018, NeurIPS.

[15]  Bin Liao,et al.  Interpretable Learning Approaches in Resting-State Functional Connectivity Analysis: The Case of Autism Spectrum Disorder , 2020, Comput. Math. Methods Medicine.

[16]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[17]  G. Dichter,et al.  Reward Circuitry Function in Autism During Face Anticipation and Outcomes , 2011, Journal of Autism and Developmental Disorders.

[18]  Jaewoo Kang,et al.  Self-Attention Graph Pooling , 2019, ICML.

[19]  James C. Gee,et al.  Interpretable Multimodality Embedding Of Cerebral Cortex Using Attention Graph Network For Identifying Bipolar Disorder , 2019, bioRxiv.

[20]  Jure Leskovec,et al.  GNNExplainer: Generating Explanations for Graph Neural Networks , 2019, NeurIPS.

[21]  Martijn P. van den Heuvel,et al.  The parcellation-based connectome: Limitations and extensions , 2013, NeuroImage.

[22]  Juntang Zhuang,et al.  Brain Biomarker Interpretation in ASD Using Deep Learning and fMRI , 2018, MICCAI.

[23]  Hailong Li,et al.  Diagnosing Autism Spectrum Disorder from Brain Resting-State Functional Connectivity Patterns Using a Deep Neural Network with a Novel Feature Selection Method , 2017, Front. Neurosci..

[24]  Comte Harry Kessler 1904 , 1904, The Hospital.

[25]  A. Franco,et al.  NeuroImage: Clinical , 2022 .

[26]  Liang Wang,et al.  Parcellation‐dependent small‐world brain functional networks: A resting‐state fMRI study , 2009, Human brain mapping.

[27]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[28]  Philip S. Yu,et al.  Similarity Learning with Higher-Order Graph Convolutions for Brain Network Analysis , 2018 .

[29]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[30]  Ben Glocker,et al.  Metric learning with spectral graph convolutions on brain connectivity networks , 2018, NeuroImage.

[31]  Fei Wang,et al.  Integrative Analysis of Patient Health Records and Neuroimages via Memory-Based Graph Convolutional Network , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[32]  M. P. van den Heuvel,et al.  The parcellation-based connectome: limitations and extensions. , 2013, NeuroImage.

[33]  Nicholas Lange,et al.  Longitudinal changes in cortical thickness in autism and typical development. , 2014, Brain : a journal of neurology.

[34]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[35]  James C. Gee,et al.  Interpretable Multimodality Embedding of Cerebral Cortex Using Attention Graph Network for Identifying Bipolar Disorder , 2019, MICCAI.