BrainGB: A Benchmark for Brain Network Analysis With Graph Neural Networks

Mapping the connectome of the human brain using structural or functional connectivity has become one of the most pervasive paradigms for neuroimaging analysis. Recently, Graph Neural Networks (GNNs) motivated from geometric deep learning have attracted broad interest due to their established power for modeling complex networked data. Despite their superior performance in many fields, there has not yet been a systematic study of how to design effective GNNs for brain network analysis. To bridge this gap, we present BrainGB, a benchmark for brain network analysis with GNNs. BrainGB standardizes the process by (1) summarizing brain network construction pipelines for both functional and structural neuroimaging modalities and (2) modularizing the implementation of GNN designs. We conduct extensive experiments on datasets across cohorts and modalities and recommend a set of general recipes for effective GNN designs on brain networks. To support open and reproducible research on GNN-based brain network analysis, we host the BrainGB website at https://braingb.us with models, tutorials, examples, as well as an out-of-box Python package. We hope that this work will provide useful empirical evidence and offer insights for future research in this novel and promising direction.

[1]  Carl Yang,et al.  Brain Network Transformer , 2022, NeurIPS.

[2]  Paul M. Thompson,et al.  A Hierarchical Graph Learning Model for Brain Network Regression Analysis , 2022, Frontiers in Neuroscience.

[3]  Carl Yang,et al.  Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis , 2022, MICCAI.

[4]  Carl Yang,et al.  Data-Efficient Brain Connectome Analysis via Multi-Task Meta-Learning , 2022, KDD.

[5]  Carl Yang,et al.  FBNETGEN: Task-aware GNN-based fMRI Analysis via Functional Brain Network Generation , 2022, MIDL.

[6]  Longchuan Li,et al.  A Multimodal Multilevel Neuroimaging Model for Investigating Brain Connectome Development , 2022, Journal of the American Statistical Association.

[7]  Paul M. Thompson,et al.  Hierarchical Brain Embedding Using Explainable Graph Learning , 2022, 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI).

[8]  Ralph R. Martin,et al.  Attention mechanisms in computer vision: A survey , 2021, Computational Visual Media.

[9]  C. Alippi,et al.  Understanding Pooling in Graph Neural Networks , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[10]  A. L. Ware,et al.  Harmonisation of multi-site MRS data with ComBat , 2021, bioRxiv.

[11]  Carl Yang,et al.  BrainNNExplainer: An Interpretable Graph Neural Network Framework for Brain Network based Disease Analysis , 2021, ArXiv.

[12]  Carl Yang,et al.  Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis , 2021, 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[13]  Carl Yang,et al.  On Positional and Structural Node Features for Graph Neural Networks on Non-attributed Graphs , 2021, CIKM.

[14]  I. Rekik,et al.  Graph Neural Networks in Network Neuroscience , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Olaf Sporns,et al.  Edges in brain networks: Contributions to models of structure and function , 2021, Network Neuroscience.

[16]  Hui Yu,et al.  A review on the attention mechanism of deep learning , 2021, Neurocomputing.

[17]  Cordelia Schmid,et al.  ViViT: A Video Vision Transformer , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[18]  Ilya Sutskever,et al.  Learning Transferable Visual Models From Natural Language Supervision , 2021, ICML.

[19]  Qian Huang,et al.  Combining Label Propagation and Simple Models Out-performs Graph Neural Networks , 2020, ICLR.

[20]  S. Gelly,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2020, ICLR.

[21]  Samuel Kaski,et al.  Rethinking pooling in graph neural networks , 2020, NeurIPS.

[22]  Juntang Zhuang,et al.  BrainGNN: Interpretable Brain Graph Neural Network for fMRI Analysis , 2020, bioRxiv.

[23]  Yu Zhang,et al.  Conformer: Convolution-augmented Transformer for Speech Recognition , 2020, INTERSPEECH.

[24]  Jan Sijbers,et al.  Harmonization of Brain Diffusion MRI: Concepts and Methods , 2020, Frontiers in Neuroscience.

[25]  Fei Wang,et al.  Deep learning in mental health outcome research: a scoping review , 2020, Translational Psychiatry.

[26]  Gopikrishna Deshpande,et al.  Multi-Level Clustering of Dynamic Directional Brain Network Patterns and Their Behavioral Relevance , 2020, Frontiers in Neuroscience.

[27]  A. Micheli,et al.  A Fair Comparison of Graph Neural Networks for Graph Classification , 2019, ICLR.

[28]  Christos Davatzikos,et al.  Harmonization of large MRI datasets for the analysis of brain imaging patterns throughout the lifespan , 2019, NeuroImage.

[29]  Russell T. Shinohara,et al.  Removal of Scanner Effects in Covariance Improves Multivariate Pattern Analysis in Neuroimaging Data , 2019, bioRxiv.

[30]  Christian Desrosiers,et al.  Learnable Pooling in Graph Convolutional Networks for Brain Surface Analysis , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Karl Aberer,et al.  On Node Features for Graph Neural Networks , 2019, ArXiv.

[32]  Chandan Ganesh,et al.  BrainNET: Inference of brain network topology using Machine Learning , 2019, bioRxiv.

[33]  Helen S Mayberg,et al.  A difference degree test for comparing brain networks , 2019, Human brain mapping.

[34]  Yuan Zhou,et al.  Graph Neural Network for Interpreting Task-fMRI Biomarkers , 2019, MICCAI.

[35]  Jessica A. Turner,et al.  Characterizing Whole Brain Temporal Variation of Functional Connectivity via Zero and First Order Derivatives of Sliding Window Correlations , 2019, Front. Neurosci..

[36]  T. Kaufmann,et al.  Multimodal fusion of structural and functional brain imaging in depression using linked independent component analysis , 2019, bioRxiv.

[37]  Daoqiang Zhang,et al.  Hybrid Functional Brain Network With First-Order and Second-Order Information for Computer-Aided Diagnosis of Schizophrenia , 2019, Front. Neurosci..

[38]  Waldemar Karwowski,et al.  Application of Graph Theory for Identifying Connectivity Patterns in Human Brain Networks: A Systematic Review , 2019, Front. Neurosci..

[39]  Dinggang Shen,et al.  Weighted graph regularized sparse brain network construction for MCI identification , 2019, Pattern Recognit..

[40]  Liqun Kuang,et al.  Metabolic Brain Network Analysis of FDG-PET in Alzheimer’s Disease Using Kernel-Based Persistent Features , 2019, Molecules.

[41]  Jure Leskovec,et al.  Position-aware Graph Neural Networks , 2019, ICML.

[42]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[43]  Jiayu Zhou,et al.  Boosted Sparse and Low-Rank Tensor Regression , 2018, NeurIPS.

[44]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[45]  Saori C. Tanaka,et al.  Harmonization of resting-state functional MRI data across multiple imaging sites via the separation of site differences into sampling bias and measurement bias , 2018, bioRxiv.

[46]  Jure Leskovec,et al.  How Powerful are Graph Neural Networks? , 2018, ICLR.

[47]  Ying Guo,et al.  A hierarchical independent component analysis model for longitudinal neuroimaging studies , 2018, NeuroImage.

[48]  A. Simmons,et al.  Stability of graph theoretical measures in structural brain networks in Alzheimer’s disease , 2018, Scientific Reports.

[49]  Jure Leskovec,et al.  Hierarchical Graph Representation Learning with Differentiable Pooling , 2018, NeurIPS.

[50]  Yilin Zhang,et al.  Understanding Regularized Spectral Clustering via Graph Conductance , 2018, NeurIPS.

[51]  O. Sporns Graph theory methods: applications in brain networks , 2018, Dialogues in clinical neuroscience.

[52]  Philip S. Yu,et al.  Multi-View Multi-Graph Embedding for Brain Network Clustering Analysis , 2018, AAAI.

[53]  Anthony R. McIntosh,et al.  Unique Mapping of Structural and Functional Connectivity on Cognition , 2018, The Journal of Neuroscience.

[54]  Anders M. Dale,et al.  The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sites , 2018, Developmental Cognitive Neuroscience.

[55]  Petra Perner,et al.  MRI brain imagery processing software in data analysis , 2018 .

[56]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[57]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[58]  Russell T. Shinohara,et al.  Harmonization of cortical thickness measurements across scanners and sites , 2017, NeuroImage.

[59]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[60]  Ying Guo,et al.  Predicting individual brain functional connectivity using a Bayesian hierarchical model , 2017, NeuroImage.

[61]  Ghassan Hamarneh,et al.  BrainNetCNN: Convolutional neural networks for brain networks; towards predicting neurodevelopment , 2017, NeuroImage.

[62]  Ying Guo,et al.  INVESTIGATING DIFFERENCES IN BRAIN FUNCTIONAL NETWORKS USING HIERARCHICAL COVARIATE-ADJUSTED INDEPENDENT COMPONENT ANALYSIS. , 2016, The annals of applied statistics.

[63]  Daoqiang Zhang,et al.  Sub-network Based Kernels for Brain Network Classification , 2016, BCB.

[64]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[65]  Xuelong Li,et al.  Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification , 2016, IJCAI.

[66]  V. Calhoun,et al.  Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness. , 2016, Biological psychiatry. Cognitive neuroscience and neuroimaging.

[67]  L. Williams,et al.  Precision psychiatry: a neural circuit taxonomy for depression and anxiety. , 2016, The lancet. Psychiatry.

[68]  Takeo Watanabe,et al.  A small number of abnormal brain connections predicts adult autism spectrum disorder , 2016, Nature Communications.

[69]  Michael R Sperling,et al.  Functional MRI, resting state fMRI, and DTI for predicting verbal fluency outcome following resective surgery for temporal lobe epilepsy. , 2016, Journal of neurosurgery.

[70]  Yikai Wang,et al.  An Efficient and Reliable Statistical Method for Estimating Functional Connectivity in Large Scale Brain Networks Using Partial Correlation , 2016, Front. Neurosci..

[71]  Xi Chen,et al.  A Novel Brain Network Construction Method for Exploring Age-Related Functional Reorganization , 2016, Comput. Intell. Neurosci..

[72]  Jian Sun,et al.  Functional Brain Imaging: A Comprehensive Survey , 2016, 1602.02225.

[73]  Daniel S. Margulies,et al.  The Neuro Bureau ADHD-200 Preprocessed repository , 2016, NeuroImage.

[74]  Efstathios D. Gennatas,et al.  Linked Sex Differences in Cognition and Functional Connectivity in Youth. , 2015, Cerebral cortex.

[75]  Paul M. Thompson,et al.  Boosting brain connectome classification accuracy in Alzheimer's disease using higher-order singular value decomposition , 2015, Front. Neurosci..

[76]  S. Teipel,et al.  Multimodal analysis of functional and structural disconnection in Alzheimer's disease using multiple kernel SVM , 2015, Human brain mapping.

[77]  T. Insel,et al.  Brain disorders? Precisely , 2015, Science.

[78]  Cassandra D. Leonardo,et al.  Comparison of nine tractography algorithms for detecting abnormal structural brain networks in Alzheimer’s disease , 2015, Front. Aging Neurosci..

[79]  Jessica A. Turner,et al.  Exploration of scanning effects in multi-site structural MRI studies , 2014, Journal of Neuroscience Methods.

[80]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[81]  Daniel P. Kennedy,et al.  The Autism Brain Imaging Data Exchange: Towards Large-Scale Evaluation of the Intrinsic Brain Architecture in Autism , 2013, Molecular Psychiatry.

[82]  Ying Wu,et al.  Structural brain alterations can be detected early in HIV infection , 2012, Neurology.

[83]  Timothy Edward John Behrens,et al.  The Human Connectome Project: A data acquisition perspective , 2012, NeuroImage.

[84]  Stephen M. Smith,et al.  The future of FMRI connectivity , 2012, NeuroImage.

[85]  Fan Chung Graham,et al.  Spectral Clustering of Graphs with General Degrees in the Extended Planted Partition Model , 2012, COLT.

[86]  M. Knyazeva,et al.  EEG-Based Functional Brain Networks: Does the Network Size Matter? , 2012, PloS one.

[87]  A. Singleton,et al.  The Parkinson Progression Marker Initiative (PPMI) , 2011, Progress in Neurobiology.

[88]  Timothy O. Laumann,et al.  Functional Network Organization of the Human Brain , 2011, Neuron.

[89]  Ivor W. Tsang,et al.  Spectral Embedded Clustering: A Framework for In-Sample and Out-of-Sample Spectral Clustering , 2011, IEEE Transactions on Neural Networks.

[90]  Mark W. Woolrich,et al.  Network modelling methods for FMRI , 2011, NeuroImage.

[91]  Stephen M Smith,et al.  Correspondence of the brain's functional architecture during activation and rest , 2009, Proceedings of the National Academy of Sciences.

[92]  C. Rowe,et al.  The Australian Imaging, Biomarkers and Lifestyle (AIBL) study of aging: methodology and baseline characteristics of 1112 individuals recruited for a longitudinal study of Alzheimer's disease , 2009, International Psychogeriatrics.

[93]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[94]  M. Lindquist The Statistical Analysis of fMRI Data. , 2008, 0906.3662.

[95]  Paul M. Thompson,et al.  The tensor distribution function , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[96]  Mark W. Woolrich,et al.  Probabilistic diffusion tractography with multiple fibre orientations: What can we gain? , 2007, NeuroImage.

[97]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[98]  Timothy Edward John Behrens,et al.  Characterization and propagation of uncertainty in diffusion‐weighted MR imaging , 2003, Magnetic resonance in medicine.

[99]  Rajendra Kale Website of the week: Neuroimaging , 2002 .

[100]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[101]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[102]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[103]  Chen Cai L G ] 3 M ay 2 01 9 A simple yet effective baseline for non-attributed graph classification , 2019 .

[104]  Alexander Bernstein,et al.  MRI brain imagery processing software in data analysis , 2018, Trans. Mass Data Anal. Images Signals.

[105]  T. Prokop,et al.  Heterogeneous Medical Data Processing , 2017 .

[106]  G. Deco,et al.  Emerging concepts for the dynamical organization of resting-state activity in the brain , 2010, Nature Reviews Neuroscience.

[107]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.