Auto-encoding graph-valued data with applications to brain connectomes

There has been a huge interest in studying human brain connectomes inferred from different imaging modalities and exploring their relationships with human traits, such as cognition. Brain connectomes are usually represented as networks, with nodes corresponding to different regions of interest (ROIs) and edges to connection strengths between ROIs. Due to the high-dimensionality and non-Euclidean nature of networks, it is challenging to depict their population distribution and relate them to human traits. Current approaches focus on summarizing the network using either pre-specified topological features or principal components analysis (PCA). In this paper, building on recent advances in deep learning, we develop a nonlinear latent factor model to characterize the population distribution of brain graphs and infer their relationships to human traits. We refer to our method as Graph AuTo-Encoding (GATE). We applied GATE to two large-scale brain imaging datasets, the Adolescent Brain Cognitive Development (ABCD) study and the Human Connectome Project (HCP) for adults, to study the structural brain connectome and its relationship with cognition. Numerical results demonstrate huge advantages of GATE over competitors in terms of prediction accuracy, statistical inference, and computing efficiency. We found that the structural connectome has a stronger association with a wide range of human cognitive traits than was apparent using previous approaches.

[1]  Alan Connelly,et al.  Anatomically-constrained tractography: Improved diffusion MRI streamlines tractography through effective use of anatomical information , 2012, NeuroImage.

[2]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[3]  Peter F. Neher,et al.  The challenge of mapping the human connectome based on diffusion tractography , 2017, Nature Communications.

[4]  Michael I. Jordan,et al.  An Introduction to Variational Methods for Graphical Models , 1999, Machine Learning.

[5]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[6]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[7]  Ben Glocker,et al.  Metric learning with spectral graph convolutions on brain connectivity networks , 2018, NeuroImage.

[8]  Steen Moeller,et al.  The Human Connectome Project: A data acquisition perspective , 2012, NeuroImage.

[9]  Lu Wang,et al.  Symmetric Bilinear Regression for Signal Subgraph Estimation , 2018, IEEE Transactions on Signal Processing.

[10]  Hongtu Zhu,et al.  Tensor Regression with Applications in Neuroimaging Data Analysis , 2012, Journal of the American Statistical Association.

[11]  Chong Wang,et al.  Stochastic variational inference , 2012, J. Mach. Learn. Res..

[12]  Thomas R. Knösche,et al.  White matter integrity, fiber count, and other fallacies: The do's and don'ts of diffusion MRI , 2013, NeuroImage.

[13]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[14]  Anders M. Dale,et al.  The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sites , 2018, Developmental Cognitive Neuroscience.

[15]  Ying Nian Wu,et al.  Decoding the encoding of functional brain networks: An fMRI classification comparison of non-negative matrix factorization (NMF), independent component analysis (ICA), and sparse coding algorithms , 2016, Journal of Neuroscience Methods.

[16]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[17]  Yiannis Demiris,et al.  Variational Autoencoded Regression: High Dimensional Regression of Visual Data on Complex Manifold , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[19]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[20]  P. Matthews,et al.  Multimodal population brain imaging in the UK Biobank prospective epidemiological study , 2016, Nature Neuroscience.

[21]  Kilian M. Pohl,et al.  Variational Autoencoder with Truncated Mixture of Gaussians for Functional Connectivity Analysis , 2019, IPMI.

[22]  Karl J. Friston,et al.  Structural and Functional Brain Networks: From Connections to Cognition , 2013, Science.

[23]  Stephen M. Smith,et al.  Investigations into resting-state connectivity using independent component analysis , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[24]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[25]  Robert K. Heaton,et al.  Reliability and Validity of Composite Scores from the NIH Toolbox Cognition Battery in Adults , 2014, Journal of the International Neuropsychological Society.

[26]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[27]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[28]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[29]  Keith Heberlein,et al.  Imaging human connectomes at the macroscale , 2013, Nature Methods.

[30]  N. Fox,et al.  NIH Toolbox for Assessment of Neurological and Behavioral Function , 2013, Neurology.

[31]  ModelsMICHAEL,et al.  An Introduction to Variational Methods forGraphical , 1998 .

[32]  Daniele Durante,et al.  Bayesian Inference and Testing of Group Differences in Brain Networks , 2014, 1411.6506.

[33]  Lexin Li,et al.  Network Response Regression for Modeling Population of Networks with Covariates , 2018, 1810.03192.

[34]  B. Dubois,et al.  Functions of the left superior frontal gyrus in humans: a lesion study. , 2006, Brain : a journal of neurology.

[35]  Ghassan Hamarneh,et al.  BrainNetCNN: Convolutional neural networks for brain networks; towards predicting neurodevelopment , 2017, NeuroImage.

[36]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[37]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[38]  Daniele Durante,et al.  Nonparametric Bayes Modeling of Populations of Networks , 2014, 1406.7851.

[39]  Zhengwu Zhang,et al.  Tensor network factorizations: Relationships between brain structural connectomes and traits , 2018, NeuroImage.

[40]  David B. Dunson,et al.  Common and Individual Structure of Multiple Networks , 2017 .

[41]  Donald B. Johnson,et al.  Efficient Algorithms for Shortest Paths in Sparse Networks , 1977, J. ACM.

[42]  David B. Dunson,et al.  Mapping population-based structural connectomes , 2018, NeuroImage.

[43]  D. Tuch Q‐ball imaging , 2004, Magnetic resonance in medicine.

[44]  Michael Breakspear,et al.  Graph analysis of the human connectome: Promise, progress, and pitfalls , 2013, NeuroImage.

[45]  Stephen M. Rao,et al.  Human Brain Language Areas Identified by Functional Magnetic Resonance Imaging , 1997, The Journal of Neuroscience.

[46]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[47]  Yann LeCun,et al.  Convolutional neural networks applied to house numbers digit classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[48]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[49]  Steen Moeller,et al.  The Human Connectome Project's neuroimaging approach , 2016, Nature Neuroscience.

[50]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[51]  Rachid Deriche,et al.  Towards quantitative connectivity analysis: reducing tractography biases , 2014, NeuroImage.

[52]  Peter D. Hoff,et al.  Latent Space Approaches to Social Network Analysis , 2002 .

[53]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[54]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.