Simultaneous Spatial-Temporal Decomposition of Connectome-Scale Brain Networks by Deep Sparse Recurrent Auto-Encoders

Exploring the spatial patterns and temporal dynamics of human brain activities has long been a great topic, yet development of a unified spatial-temporal model for such purpose is still challenging. To better understand brain networks based on fMRI data and inspired by the success in applying deep learning for brain encoding/decoding, we propose a novel deep sparse recurrent auto-encoder (DSRAE) in an unsupervised spatial-temporal way to learn spatial and temporal patterns of brain networks jointly. The proposed DSRAE has been validated on the publicly available human connectome project (HCP) fMRI datasets with promising results. To our best knowledge, the proposed DSRAE is among the early unified models that can extract connectome-scale spatial-temporal networks from 4D fMRI data simultaneously.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Karl J. Friston.  Transients, Metastability, and Neuronal Dynamics , 1997, NeuroImage.

[3]  Walter Schneider,et al.  A rapid fMRI task battery for mapping of visual, motor, cognitive, and emotional function , 2006, NeuroImage.

[4]  N. Logothetis.  What we can do and what we cannot do with fMRI , 2008, Nature.

[5]  Steven C. R. Williams,et al.  Measuring fMRI reliability with the intra-class correlation coefficient , 2009, NeuroImage.

[6]  M. Fox,et al.  Resting-state spontaneous fluctuations in brain activity: a new paradigm for presurgical planning using fMRI. , 2009, Academic radiology.

[7]  Kurt E. Weaver,et al.  Mapping anterior temporal lobe language areas with fMRI: A multicenter normative study , 2011, NeuroImage.

[8]  Stephen M. Smith,et al.  Temporally-independent functional modes of spontaneous brain activity , 2012, Proceedings of the National Academy of Sciences.

[9]  Abraham Z. Snyder,et al.  Function in the human connectome: Task-fMRI and individual differences in behavior , 2013, NeuroImage.

[10]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[11]  L. Pessoa.  Understanding brain networks and brain organization. , 2014, Physics of life reviews.

[12]  Vince D. Calhoun,et al.  Deep learning for neuroimaging: a validation study , 2013, Front. Neurosci..

[13]  Daniel S. Margulies,et al.  Prioritizing spatial accuracy in high-resolution fMRI data using multivariate feature weight mapping , 2014, Front. Neurosci..

[14]  Jieping Ye,et al.  Holistic Atlases of Functional Networks and Interactions Reveal Reciprocal Organizational Architecture of Cortical Function , 2015, IEEE Transactions on Biomedical Engineering.

[15]  Jinglei Lv,et al.  Sparse representation of HCP grayordinate data reveals novel functional architecture of cerebral cortex , 2015, Human brain mapping.

[16]  Yu Zhao,et al.  Modeling Task fMRI Data Via Deep Convolutional Autoencoder , 2018, IEEE Transactions on Medical Imaging.

[17]  Xiang Li,et al.  Modeling 4D fMRI Data via Spatio-Temporal Convolutional Neural Networks (ST-CNN) , 2018, MICCAI.

[18]  Bo Peng,et al.  Latent source mining in FMRI via restricted Boltzmann machine , 2018, Human brain mapping.

[19]  Han Wang,et al.  Recognizing Brain States Using Deep Sparse Recurrent Neural Network , 2019, IEEE Transactions on Medical Imaging.

[20]  Jinglei Lv,et al.  Experimental Comparisons of Sparse Dictionary Learning and Independent Component Analysis for Brain Network Inference From fMRI Data , 2019, IEEE Transactions on Biomedical Engineering.