A Shotgun Sampling Solution for the Common Input Problem in Neural Connectivity Inference

Inferring connectivity in neuronal networks remains a key challenge in statistical neuroscience. The `common input' problem presents the major roadblock: it is difficult to reliably distinguish causal connections between pairs of observed neurons from correlations induced by common input from unobserved neurons. Since available recording techniques allow us to sample from only a small fraction of large networks simultaneously with sufficient temporal resolution, naive connectivity estimators that neglect these common input effects are highly biased. This work proposes a `shotgun' experimental design, in which we observe multiple sub-networks briefly, in a serial manner. Thus, while the full network cannot be observed simultaneously at any given time, we may be able to observe most of it during the entire experiment. Using a generalized linear model for a spiking recurrent neural network, we develop scalable approximate Bayesian methods to perform network inference given this type of data, in which only a small fraction of the network is observed in each time bin. We demonstrate in simulation that, using this method: (1) The shotgun experimental design can eliminate the biases induced by common input effects. (2) Networks with thousands of neurons, in which only a small fraction of the neurons is observed in each time bin, could be quickly and accurately estimated. (3) Performance can be improved if we exploit prior information about the probability of having a connection between two neurons, its dependence on neuronal cell types (e.g., Dale's law), or its dependence on the distance between neurons.

[1]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[2]  Il Memming Park,et al.  Bayesian Spike-Triggered Covariance Analysis , 2011, NIPS.

[3]  Katherine A. Heller,et al.  Evaluating Bayesian and L1 Approaches for Sparse Unsupervised Learning , 2011, ICML.

[4]  K. Deisseroth,et al.  Bi-stable neural state switches , 2009, Nature Neuroscience.

[5]  Michael Unser,et al.  Approximate Message Passing With Consistent Parameter Estimation and Applications to Sparse Learning , 2012, IEEE Transactions on Information Theory.

[6]  M. Stephens,et al.  Scalable Variational Inference for Bayesian Variable Selection in Regression, and Its Accuracy in Genetic Association Studies , 2012 .

[7]  Fabio Rigat,et al.  Bayesian modelling and analysis of spatio-temporal neuronal networks , 2006 .

[8]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[9]  Peter E. Latham,et al.  Neural characterization in partially observed populations of spiking neurons , 2007, NIPS.

[10]  Keith J. Kelleher,et al.  Three-dimensional random access multiphoton microscopy for functional imaging of neuronal activity , 2008, Nature Neuroscience.

[11]  M. Adams,et al.  Shotgun Sequencing of the Human Genome , 1998, Science.

[12]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[13]  Eero P. Simoncelli,et al.  Modeling the Impact of Common Noise Inputs on the Network Activity of Retinal Ganglion Cells Action Editor: Brent Doiron , 2022 .

[14]  Liam Paninski,et al.  Fast inference in generalized linear models via expected log-likelihoods , 2013, Journal of Computational Neuroscience.

[15]  Manfred Opper,et al.  Expectation Propagation with Factorizing Distributions: A Gaussian Approximation and Performance Results for Simple Models , 2011, Neural Computation.

[16]  D. Q. Nykamp,et al.  A mathematical framework for inferring connectivity in probabilistic neuronal networks. , 2007, Mathematical biosciences.

[17]  G D Field,et al.  Monte Carlo Methods for Localization of Cones given Multielectrode Retinal Ganglion Cell Recordings , 2012 .

[18]  T. J. Mitchell,et al.  Bayesian Variable Selection in Linear Regression , 1988 .

[19]  John Hertz,et al.  Ising Models for Inferring Network Structure From Spike Data , 2011, 1106.1752.

[20]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[21]  Aaron S. Andalman,et al.  Structural and molecular interrogation of intact biological systems , 2013, Nature.

[22]  Liam Paninski,et al.  Efficient methods for sampling spike trains in networks of coupled neurons , 2011, 1111.7098.

[23]  Katherine A. Heller,et al.  Bayesian and L1 Approaches to Sparse Unsupervised Learning , 2011, ICML 2012.

[24]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[25]  Jakob H. Macke,et al.  Inferring interactions between cell types from multiple calcium imaging snapshots of the same neural circuit , 2013 .

[26]  Philipp J. Keller,et al.  Whole-brain functional imaging at cellular resolution using light-sheet microscopy , 2013, Nature Methods.

[27]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[28]  Liam Paninski,et al.  Optimal experimental design for sampling voltage on dendritic trees in the low-SNR regime , 2012, Journal of Computational Neuroscience.

[29]  Thomas Hofmann,et al.  A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation , 2007 .

[30]  J. Livet,et al.  A technicolour approach to the connectome , 2008, Nature Reviews Neuroscience.

[31]  John Hertz,et al.  Network inference with hidden units. , 2013, Mathematical biosciences and engineering : MBE.

[32]  John Hertz,et al.  Ising model for inferring network structure from spike data : In Principal of Neural Coding , 2013 .

[33]  Jun S. Liu,et al.  Metropolized independent sampling with comparisons to rejection sampling and importance sampling , 1996, Stat. Comput..

[34]  D. Brillinger Maximum likelihood analysis of spike trains of interacting nerve cells , 2004, Biological Cybernetics.

[35]  Adam M. Packer,et al.  Inferring neural population dynamics from multiple partial recordings of the same neural circuit , 2013, NIPS.

[36]  Benjamin F. Grewe,et al.  High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision , 2010, Nature Methods.

[37]  Konrad Kording,et al.  Automatic discovery of cell types and microcircuitry from neural connectomics , 2014, eLife.

[38]  J. Diebolt,et al.  A Stochastic EM algorithm for approximating the maximum likelihood estimate , 1995 .

[39]  Joshua T. Vogelstein,et al.  A Bayesian approach for inferring neuronal connectivity from calcium fluorescent imaging data , 2011, 1107.4228.

[40]  Katherine A. Heller,et al.  Bayesian and L$_\mathbf{1}$ Approaches to Sparse Unsupervised Learning , 2011 .