Bayesian Optimisation of Large-Scale Biophysical Networks

The relationship between structure and function in the human brain is well established, but not yet well characterised. Large-scale biophysical models allow us to investigate this relationship, by leveraging structural information (e.g. derived from diffusion tractography) in order to couple dynamical models of local neuronal activity into networks of interacting regions distributed across the cortex. In practice however, these models are difficult to parametrise, and their simulation is often delicate and computationally expensive. This undermines the experimental aspect of scientific modelling, and stands in the way of comparing different parametrisations, network architectures, or models in general, with confidence. Here, we advocate the use of Bayesian optimisation for assessing the capabilities of biophysical network models, given a set of desired properties (e.g. band-specific functional connectivity); and in turn the use of this assessment as a principled basis for incremental modelling and model comparison. We adapt an optimisation method designed to cope with costly, high-dimensional, non-convex problems, and demonstrate its use and effectiveness. We find that this method is able to converge to regions of high functional similarity with real MEG data, with very few samples given the number of parameters, without getting stuck in local extrema, and while building and exploiting a map of uncertainty defined smoothly across the parameter space. We compare the results obtained using different methods of structural connectivity estimation from diffusion tractography, and find that one method leads to better simulations.

[1]  Hamid Reza Mohseni,et al.  Exploring mechanisms of spontaneous functional connectivity in MEG: How delayed network interactions lead to structured amplitude envelopes of band-pass filtered oscillations , 2014, NeuroImage.

[2]  Karl J. Friston,et al.  The Dynamic Brain: From Spiking Neurons to Neural Masses and Cortical Fields , 2008, PLoS Comput. Biol..

[3]  C. Koch,et al.  The origin of extracellular fields and currents — EEG, ECoG, LFP and spikes , 2012, Nature Reviews Neuroscience.

[4]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[5]  Ravi S. Menon,et al.  Identification of Optimal Structural Connectivity Using Functional Connectivity and Neural Modeling , 2014, The Journal of Neuroscience.

[6]  Mark W. Woolrich,et al.  Biophysical network models and the human connectome , 2013, NeuroImage.

[7]  Steen Moeller,et al.  Advances in diffusion MRI acquisition and processing in the Human Connectome Project , 2013, NeuroImage.

[8]  O. Sporns,et al.  Key role of coupling, delay, and noise in resting brain fluctuations , 2009, Proceedings of the National Academy of Sciences.

[9]  W G Regehr,et al.  Timing of synaptic transmission. , 1999, Annual review of physiology.

[10]  José M. García,et al.  Accelerating Fibre Orientation Estimation from Diffusion Weighted Magnetic Resonance Imaging Using GPUs , 2012, PDP.

[11]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[12]  Chad J. Donahue,et al.  Using Diffusion Tractography to Predict Cortical Connection Strength and Distance: A Quantitative Comparison with Tracers in the Monkey , 2016, The Journal of Neuroscience.

[13]  Viktor K. Jirsa,et al.  Mathematical framework for large-scale brain network modeling in The Virtual Brain , 2015, NeuroImage.

[14]  Sébastien Bubeck,et al.  Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems , 2012, Found. Trends Mach. Learn..

[15]  Alexander J. Smola,et al.  Exponential Regret Bounds for Gaussian Process Bandits with Deterministic Observations , 2012, ICML.

[16]  Siân E. Robson,et al.  Abnormal visuomotor processing in schizophrenia , 2015, NeuroImage: Clinical.

[17]  Karl J. Friston,et al.  Tractography-based priors for dynamic causal models , 2009, NeuroImage.

[18]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[19]  Steen Moeller,et al.  The Human Connectome Project: A data acquisition perspective , 2012, NeuroImage.

[20]  O Sporns,et al.  Predicting human resting-state functional connectivity from structural connectivity , 2009, Proceedings of the National Academy of Sciences.

[21]  Karl J. Friston,et al.  Network discovery with DCM , 2011, NeuroImage.

[22]  Karline Soetaert,et al.  Solving Ordinary Differential Equations in R , 2012 .

[23]  Karl J. Friston Functional integration and inference in the brain , 2002, Progress in Neurobiology.

[24]  Mark W. Woolrich,et al.  A biophysical model of dynamic balancing of excitation and inhibition in fast oscillatory large-scale networks , 2018, PLoS Comput. Biol..

[25]  M. Greicius,et al.  Resting-state functional connectivity reflects structural connectivity in the default mode network. , 2009, Cerebral cortex.

[26]  Leslie Pack Kaelbling,et al.  Bayesian Optimization with Exponential Convergence , 2015, NIPS.

[27]  L. Vaina,et al.  Mapping the signal‐to‐noise‐ratios of cortical sources in magnetoencephalography and electroencephalography , 2009, Human brain mapping.

[28]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[29]  Andrew Zalesky,et al.  Building connectomes using diffusion MRI: why, how and but , 2017, NMR in biomedicine.

[30]  Timothy Edward John Behrens,et al.  Accelerating Fibre Orientation Estimation from Diffusion Weighted Magnetic Resonance Imaging Using GPUs , 2012, 2012 20th Euromicro International Conference on Parallel, Distributed and Network-based Processing.

[31]  Mark W. Woolrich,et al.  A symmetric multivariate leakage correction for MEG connectomes , 2015, NeuroImage.

[32]  H. Kennedy,et al.  A Large-Scale Circuit Mechanism for Hierarchical Dynamical Processing in the Primate Cortex , 2015, Neuron.

[33]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[34]  L. Abbott,et al.  Neural network dynamics. , 2005, Annual review of neuroscience.

[35]  Manuel Graña,et al.  Model‐based analysis of multishell diffusion MR data for tractography: How to get over fitting problems , 2012, Magnetic resonance in medicine.

[36]  Maurizio Corbetta,et al.  Resting-State Functional Connectivity Emerges from Structurally and Dynamically Shaped Slow Linear Fluctuations , 2013, The Journal of Neuroscience.

[37]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[38]  Piet Van Mieghem,et al.  A Mapping Between Structural and Functional Brain Networks , 2016, Brain Connect..

[39]  Darren Price,et al.  Complexity Measures in Magnetoencephalography: Measuring "Disorder" in Schizophrenia , 2015, PloS one.

[40]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[41]  Mark W. Woolrich,et al.  Probabilistic diffusion tractography with multiple fibre orientations: What can we gain? , 2007, NeuroImage.

[42]  Karl J. Friston,et al.  Generalised Filtering , 2010 .

[43]  M. Breakspear Dynamic models of large-scale brain activity , 2017, Nature Neuroscience.

[44]  Timothy E. J. Behrens,et al.  Measuring macroscopic brain connections in vivo , 2015, Nature Neuroscience.