Spatio-Temporal Graph Convolution for Resting-State fMRI Analysis

The BOLD signal of resting-state fMRI (rs-fMRI) records the functional brain connectivity in a rich dynamic spatio-temporal setting. However, existing methods applied to rs-fMRI often fail to consider both spatial and temporal characteristics of the data. They either neglect the functional dependency between different brain regions in a network or discard the information in the temporal dynamics of brain activity. To overcome those shortcomings, we propose to formulate functional connectivity networks within the context of spatio-temporal graphs. We then train a spatio-temporal graph convolutional network (ST-GCN) on short sub-sequences of the BOLD time series to model the non-stationary nature of functional connectivity. We simultaneously learn the graph edge importance within ST-GCN to enable interpretation of functional connectivities contributing to the prediction model. In analyzing the rs-fMRI of the Human Connectome Project (HCP, N=1,091) and the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA, N=773), ST-GCN is significantly more accurate than common approaches in predicting gender and age based on BOLD signals. The matrix recording edge importance localizes brain regions and functional connections with significant aging and sex effects, which are verified by the neuroscience literature.

[1]  Yong Fan,et al.  Brain age prediction based on resting-state functional connectivity patterns using convolutional neural networks , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[2]  Dahua Lin,et al.  Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition , 2018, AAAI.

[3]  Kilian M. Pohl,et al.  Variational Autoencoder with Truncated Mixture of Gaussians for Functional Connectivity Analysis , 2019, IPMI.

[4]  Torsten Rohlfing,et al.  The National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA): A Multisite Study of Adolescent Development and Substance Use. , 2015, Journal of studies on alcohol and drugs.

[5]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[6]  Alex D. Leow,et al.  From Default Mode Network to the Basal Configuration: Sex Differences in the Resting-State Brain Connectivity as a Function of Age and Their Clinical Correlates , 2018, Front. Psychiatry.

[7]  Pierre Bellec,et al.  Functional Annotation of Human Cognitive States using Graph Convolution Networks , 2019 .

[8]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[9]  Jiening Zhan,et al.  Temporal Graph Convolutional Networks for Automatic Seizure Detection , 2019, MLHC.

[10]  Simon B. Eickhoff,et al.  Sex classification by resting state brain connectivity , 2019 .

[11]  A. Dale,et al.  Life-span changes of the human brain white matter: diffusion tensor imaging (DTI) and volumetry. , 2010, Cerebral cortex.

[12]  Yong Fan,et al.  Brain Decoding from Functional MRI Using Long Short-Term Memory Recurrent Neural Networks , 2018, MICCAI.

[13]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[14]  Fenna M. Krienen,et al.  Opportunities and limitations of intrinsic functional connectivity MRI , 2013, Nature Neuroscience.

[15]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Kilian M. Pohl,et al.  Confounder-Aware Visualization of ConvNets , 2019, MLMI@MICCAI.

[18]  Jesper Andersson,et al.  A multi-modal parcellation of human cerebral cortex , 2016, Nature.

[19]  Kaiming Li,et al.  Application of Convolutional Recurrent Neural Network for Individual Recognition Based on Resting State fMRI Data , 2019, Front. Neurosci..

[20]  Lei Guo,et al.  Identifying Brain Networks of Multiple Time Scales via Deep Recurrent Neural Network , 2018, MICCAI.

[21]  Torsten Rohlfing,et al.  Influences of Age, Sex, and Moderate Alcohol Drinking on the Intrinsic Functional Architecture of Adolescent Brains , 2018, Cerebral cortex.

[22]  Qingyu Zhao,et al.  Longitudinally consistent estimates of intrinsic functional networks , 2019, Human brain mapping.

[23]  Arno Klein,et al.  101 Labeled Brain Images and a Consistent Human Cortical Labeling Protocol , 2012, Front. Neurosci..

[24]  Thomas E. Nichols,et al.  Functional connectomics from resting-state fMRI , 2013, Trends in Cognitive Sciences.

[25]  Yuan Zhou,et al.  Graph Neural Network for Interpreting Task-fMRI Biomarkers , 2019, MICCAI.

[26]  Ben Glocker,et al.  Distance Metric Learning Using Graph Convolutional Networks: Application to Functional Brain Networks , 2017, MICCAI.

[27]  Eswar Damaraju,et al.  Tracking whole-brain connectivity dynamics in the resting state. , 2014, Cerebral cortex.

[28]  Jalil Taghia,et al.  Bayesian switching factor analysis for estimating time-varying functional connectivity in fMRI , 2017, NeuroImage.