Encoding Multi-Resolution Brain Networks Using Unsupervised Deep Learning

The main goal of this study is to extract a set of brain networks in multiple time-resolutions to analyze the connectivity patterns among the anatomic regions for a given cognitive task. We suggest a deep architecture which learns the natural groupings of the connectivity patterns of human brain in multiple time-resolutions. The suggested architecture is tested on task data set of Human Connectome Project (HCP) where we extract multi-resolution networks, each of which corresponds to a cognitive task. At the first level of this architecture, we decompose the fMRI signal into multiple sub-bands using wavelet decompositions. At the second level, for each sub-band, we estimate a brain network extracted from short time windows of the fMRI signal. At the third level, we feed the adjacency matrices of each mesh network at each time-resolution into an unsupervised deep learning algorithm, namely, a Stacked De- noising Auto-Encoder (SDAE). The outputs of the SDAE provide a compact connectivity representation for each time window at each sub-band of the fMRI signal. We concatenate the learned representations of all sub-bands at each window and cluster them by a hierarchical algorithm to find the natural groupings among the windows. We observe that each cluster represents a cognitive task with a performance of 93% Rand Index and 71% Adjusted Rand Index. We visualize the mean values and the precisions of the networks at each component of the cluster mixture. The mean brain networks at cluster centers show the variations among cognitive tasks and the precision of each cluster shows the within cluster variability of networks, across the subjects.

[1]  G. W. Milligan,et al.  A Study of the Comparability of External Criteria for Hierarchical Cluster Analysis. , 1986, Multivariate behavioral research.

[2]  C. Fiebach,et al.  Predicting errors from reconfiguration patterns in human brain networks , 2012, Proceedings of the National Academy of Sciences.

[3]  V. Calhoun,et al.  The Chronnectome: Time-Varying Connectivity Networks as the Next Frontier in fMRI Data Discovery , 2014, Neuron.

[4]  Dimitri Van De Ville,et al.  Machine Learning with Brain Graphs: Predictive Modeling Approaches for Functional Imaging in Systems Neuroscience , 2013, IEEE Signal Processing Magazine.

[5]  E. Bullmore,et al.  Wavelets and functional magnetic resonance imaging of the human brain , 2004, NeuroImage.

[6]  William H. Thompson,et al.  The frequency dimension of fMRI dynamic connectivity: Network connectivity, functional hubs and integration in the resting brain , 2015, NeuroImage.

[7]  M. Greicius,et al.  Decoding subject-driven cognitive states with whole-brain connectivity patterns. , 2012, Cerebral cortex.

[8]  Mete Ozay,et al.  A New Representation of fMRI Signal by a Set of Local Meshes for Brain Decoding , 2017, IEEE Transactions on Signal and Information Processing over Networks.

[9]  Fatos T. Yarman-Vural,et al.  Hierarchical multi-resolution mesh networks for brain decoding , 2017, Brain Imaging and Behavior.

[10]  Fatos T. Yarman-Vural,et al.  Learning Deep Temporal Representations for fMRI Brain Decoding , 2015, MLMMI@ICML.

[11]  Abraham Z. Snyder,et al.  Function in the human connectome: Task-fMRI and individual differences in behavior , 2013, NeuroImage.

[12]  Marc'Aurelio Ranzato,et al.  Efficient Learning of Sparse Representations with an Energy-Based Model , 2006, NIPS.

[13]  Paul Pavlidis,et al.  Decoding Unattended Fearful Faces with Whole-Brain Correlations: An Approach to Identify Condition-Dependent Large-Scale Functional Connectivity , 2012, PLoS Comput. Biol..

[14]  Sida I. Wang,et al.  Dropout Training as Adaptive Regularization , 2013, NIPS.