Active learning of cortical connectivity from two-photon imaging data

Understanding how groups of neurons interact within a network is a fundamental question in system neuroscience. Instead of passively observing the ongoing activity of a network, we can typically perturb its activity, either by external sensory stimulation or directly via techniques such as two-photon optogenetics. A natural question is how to use such perturbations to identify the connectivity of the network efficiently. Here we introduce a method to infer sparse connectivity graphs from in-vivo, two-photon imaging of population activity in response to external stimuli. A novel aspect of the work is the introduction of a recommended distribution, incrementally learned from the data, to optimally refine the inferred network. Unlike existing system identification techniques, this “active learning” method automatically focuses its attention on key undiscovered areas of the network, instead of targeting global uncertainty indicators like parameter variance. We show how active learning leads to faster inference while, at the same time, provides confidence intervals for the network parameters. We present simulations on artificial small-world networks to validate the methods and apply the method to real data. Analysis of frequency of motifs recovered show that cortical networks are consistent with a small-world topology model.

[1]  Kechen Zhang,et al.  Adaptive stimulus optimization for sensory systems neuroscience , 2013, Front. Neural Circuits.

[2]  Shan Yu,et al.  A Small World of Neuronal Synchrony , 2008, Cerebral cortex.

[3]  M. Stryker,et al.  Identification of a Brainstem Circuit Regulating Visual Cortical State in Parallel with Locomotion , 2014, Neuron.

[4]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[5]  David Pfau,et al.  Robust learning of low-dimensional dynamics from large neural ensembles , 2013, NIPS.

[6]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[7]  Mijung Park,et al.  Bayesian active learning with localized priors for fast receptive field characterization , 2012, NIPS.

[8]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[9]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[10]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[11]  Robert J. Butera,et al.  Real-time adaptive information-theoretic optimization of neurophysiology experiments , 2006, NIPS.

[12]  Il Memming Park,et al.  Encoding and decoding in parietal cortex during sensorimotor decision-making , 2014, Nature Neuroscience.

[13]  Duane Q Nykamp,et al.  A stimulus-dependent connectivity analysis of neuronal networks , 2009, Journal of mathematical biology.

[14]  Liam Paninski,et al.  Statistical models for neural encoding, decoding, and optimal stimulus design. , 2007, Progress in brain research.

[15]  Joseph L. Natale,et al.  Reverse-engineering biological networks from large data sets , 2017, bioRxiv.

[16]  Matthias Durr,et al.  Methods In Neuronal Modeling From Ions To Networks , 2016 .

[17]  Andreas V. M. Herz,et al.  Searching for Optimal Sensory Signals: Iterative Stimulus Reconstruction in Closed-Loop Experiments , 2004, Journal of Computational Neuroscience.

[18]  L. L. Cam,et al.  Asymptotic Methods In Statistical Decision Theory , 1986 .

[19]  Michal Linial,et al.  Using Bayesian Networks to Analyze Expression Data , 2000, J. Comput. Biol..

[20]  Tim Gollisch,et al.  From response to stimulus: adaptive sampling in sensory physiology , 2007, Current Opinion in Neurobiology.

[21]  Robert J. Butera,et al.  Efficient active learning with generalized linear models , 2007, AISTATS.

[22]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[23]  Bonnie Berger,et al.  Reconstructing Causal Biological Networks through Active Learning , 2016, PloS one.

[24]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[25]  Robert J. Butera,et al.  Sequential Optimal Design of Neurophysiology Experiments , 2009, Neural Computation.

[26]  Brooks Paige,et al.  Bayesian Inference and Online Experimental Design for Mapping Neural Microcircuits , 2013, NIPS.

[27]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[28]  Dario L Ringach,et al.  Enhanced Spatial Resolution During Locomotion and Heightened Attention in Mouse Primary Visual Cortex , 2016, The Journal of Neuroscience.

[29]  Matthias Bethge,et al.  Community-based benchmarking improves spike inference from two-photon calcium imaging data , 2017, bioRxiv.

[30]  Ian Nauhaus,et al.  Nonlinearity of two-photon Ca2+ imaging yields distorted measurements of tuning for V1 neuronal populations. , 2012, Journal of neurophysiology.

[31]  F. Harrell,et al.  Regression modelling strategies for improved prognostic prediction. , 1984, Statistics in medicine.

[32]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[33]  A. Atkinson Subset Selection in Regression , 1992 .

[34]  Jie Yang,et al.  D-optimal Factorial Designs under Generalized Linear Models , 2013, Commun. Stat. Simul. Comput..

[35]  Danielle Smith Bassett,et al.  Small-World Brain Networks , 2006, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[36]  D. Posada,et al.  Model selection and model averaging in phylogenetics: advantages of akaike information criterion and bayesian approaches over likelihood ratio tests. , 2004, Systematic biology.

[37]  Rafael Yuste,et al.  Two-photon optogenetics of dendritic spines and neural circuits in 3D , 2012, Nature Methods.

[38]  P. McCullagh,et al.  Generalized Linear Models , 1972, Predictive Analytics.

[39]  David R. Anderson,et al.  Multimodel Inference , 2004 .

[40]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[41]  Lee E Miller,et al.  Inferring functional connections between neurons , 2008, Current Opinion in Neurobiology.

[42]  M. Symonds,et al.  A brief guide to model selection, multimodel inference and model averaging in behavioural ecology using Akaike’s information criterion , 2010, Behavioral Ecology and Sociobiology.

[43]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[44]  R. Reid,et al.  Local Diversity and Fine-Scale Organization of Receptive Fields in Mouse Visual Cortex , 2011, The Journal of Neuroscience.

[45]  Patrick J. Mineault,et al.  Spatial clustering of tuning in mouse primary visual cortex , 2016, Nature Communications.

[46]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[47]  Michael I. Ham,et al.  Functional structure of cortical neuronal networks grown in vitro. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[48]  M. Carandini,et al.  Integration of visual motion and locomotion in mouse visual cortex , 2013, Nature Neuroscience.

[49]  Kechen Zhang,et al.  Active Data Collection for Efficient Estimation and Comparison of Nonlinear Neural Models , 2011, Neural Computation.

[50]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[51]  Emery N. Brown,et al.  A Granger Causality Measure for Point Process Models of Ensemble Neural Spiking Activity , 2011, PLoS Comput. Biol..

[52]  David J. C. MacKay,et al.  Information-Based Objective Functions for Active Data Selection , 1992, Neural Computation.

[53]  M. Carandini,et al.  Locomotion Controls Spatial Integration in Mouse Visual Cortex , 2013, Current Biology.

[54]  Tim Gollisch,et al.  Closed-Loop Measurements of Iso-Response Stimuli Reveal Dynamic Nonlinear Stimulus Integration in the Retina , 2012, Neuron.

[55]  Olaf Sporns,et al.  The small world of the cerebral cortex , 2007, Neuroinformatics.

[56]  Guillermo Sapiro,et al.  A subspace reverse-correlation technique for the study of visual neurons , 1997, Vision Research.

[57]  Dario L Ringach,et al.  Dynamics of tuning in the Fourier domain. , 2008, Journal of neurophysiology.

[58]  Joshua T. Vogelstein,et al.  A Bayesian approach for inferring neuronal connectivity from calcium fluorescent imaging data , 2011, 1107.4228.

[59]  Mijung Park,et al.  Adaptive Bayesian Methods for Closed-Loop Neurophysiology , 2016 .