Inferring Neuronal Couplings From Spiking Data Using a Systematic Procedure With a Statistical Criterion

Recent remarkable advances in experimental techniques have provided a background for inferring neuronal couplings from point process data that include a great number of neurons. Here, we propose a systematic procedure for pre- and postprocessing generic point process data in an objective manner to handle data in the framework of a binary simple statistical model, the Ising or generalized McCulloch–Pitts model. The procedure has two steps: (1) determining time bin size for transforming the point process data into discrete-time binary data and (2) screening relevant couplings from the estimated couplings. For the first step, we decide the optimal time bin size by introducing the null hypothesis that all neurons would fire independently, then choosing a time bin size so that the null hypothesis is rejected with the strict criteria. The likelihood associated with the null hypothesis is analytically evaluated and used for the rejection process. For the second postprocessing step, after a certain estimator of coupling is obtained based on the preprocessed data set (any estimator can be used with the proposed procedure), the estimate is compared with many other estimates derived from data sets obtained by randomizing the original data set in the time direction. We accept the original estimate as relevant only if its absolute value is sufficiently larger than those of randomized data sets. These manipulations suppress false positive couplings induced by statistical noise. We apply this inference procedure to spiking data from synthetic and in vitro neuronal networks. The results show that the proposed procedure identifies the presence or absence of synaptic couplings fairly well, including their signs, for the synthetic and experimental data. In particular, the results support that we can infer the physical connections of underlying systems in favorable situations, even when using a simple statistical model.

[1]  D. Cox The Regression Analysis of Binary Sequences , 1958 .

[2]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .

[3]  F. James Rohlf,et al.  Biometry: The Principles and Practice of Statistics in Biological Research , 1969 .

[4]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[5]  Hilbert J. Kappen,et al.  Efficient Learning in Boltzmann Machines Using Linear Response Theory , 1998, Neural Computation.

[6]  Toshiyuki TANAKA Mean-field theory of Boltzmann machine learning , 1998 .

[7]  Shimon Marom,et al.  Development, learning and memory in large random networks of cortical neurons: lessons beyond anatomy , 2002, Quarterly Reviews of Biophysics.

[8]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[9]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[10]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.

[11]  G. Buzsáki Large-scale recording of neuronal ensembles , 2004, Nature Neuroscience.

[12]  W. Bialek,et al.  Features and dimensions: Motion estimation in fly vision , 2005, q-bio/0505003.

[13]  M. Wilson,et al.  Analyzing Functional Connectivity Using a Network Likelihood Model of Ensemble Neural Spiking Activity , 2005, Neural Computation.

[14]  Eero P. Simoncelli,et al.  Spike-triggered neural characterization. , 2006, Journal of vision.

[15]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[16]  A. Maritan,et al.  Using the principle of entropy maximization to infer genetic interaction networks from gene expression patterns , 2006, Proceedings of the National Academy of Sciences.

[17]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.

[18]  Byron M. Yu,et al.  Techniques for extracting single-trial activity patterns from large-scale neural recordings , 2007, Current Opinion in Neurobiology.

[19]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[20]  John M. Beggs,et al.  A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro , 2008, The Journal of Neuroscience.

[21]  J. Hertz,et al.  Ising model for neural data: model quality and approximate methods for extracting functional connectivity. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  T. Hwa,et al.  Identification of direct residue contacts in protein–protein interaction by message passing , 2009, Proceedings of the National Academy of Sciences.

[23]  S. Leibler,et al.  Neuronal couplings between retinal ganglion cells inferred by efficient inverse statistical physics methods , 2009, Proceedings of the National Academy of Sciences.

[24]  R. Monasson,et al.  Small-correlation expansions for the inverse Ising problem , 2008, 0811.3574.

[25]  Nicolas Brunel,et al.  How Connectivity, Background Activity, and Synaptic Properties Shape the Cross-Correlation between Spike Trains , 2009, The Journal of Neuroscience.

[26]  Tomoki Fukai,et al.  Accurate spike sorting for multi‐unit recordings , 2010, The European journal of neuroscience.

[27]  Ifije E. Ohiorhenuan,et al.  Sparse coding and high-order correlations in fine-scale cortical networks , 2010, Nature.

[28]  Timothy A. Machado,et al.  Functional connectivity in the retina at the resolution of photoreceptors , 2010, Nature.

[29]  Benjamin F. Grewe,et al.  High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision , 2010, Nature Methods.

[30]  J. Hertz,et al.  Mean field theory for nonequilibrium network reconstruction. , 2010, Physical review letters.

[31]  J. Tiago Gonçalves,et al.  Simultaneous 2-photon calcium imaging at different cortical depths in vivo with spatiotemporal multiplexing , 2010, Nature Methods.

[32]  Yasser Roudi,et al.  Effect of coupling asymmetry on mean-field solutions of the direct and inverse Sherrington–Kirkpatrick model , 2011, 1106.0452.

[33]  Erik Aurell,et al.  Network inference using asynchronously updated kinetic Ising model. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Marc Mézard,et al.  Exact mean field inference in asymmetric kinetic Ising systems , 2011 .

[35]  Hong-Li Zeng,et al.  L1 regularization for reconstruction of a non-equilibrium Ising model , 2012, 1211.3671.

[36]  E. Aurell,et al.  Inverse Ising inference using all the data. , 2011, Physical review letters.

[37]  Matteo Marsili,et al.  The effect of nonstationarity on models inferred from neural data , 2012, 1203.5673.

[38]  Erik Aurell,et al.  Maximum likelihood reconstruction for Ising models with asynchronous updates. , 2013, Physical review letters.

[39]  Yasser Roudi,et al.  Learning and inference in a nonequilibrium Ising model with hidden nodes. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Gordon Pipa,et al.  Untangling cross-frequency coupling in neuroscience , 2014 .

[41]  John Hertz,et al.  Belief-Propagation and replicas for inference and learning in a kinetic Ising model with hidden spins , 2014, 1412.1727.

[42]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[43]  Yasser Roudi,et al.  Correlations and Functional Connections in a Population of Grid Cells , 2014, PLoS Comput. Biol..

[44]  Federico Ricci-Tersenghi,et al.  Inferring Synaptic Structure in Presence of Neural Interaction Time Scales , 2014, PloS one.

[45]  M. Wibral,et al.  Untangling cross-frequency coupling in neuroscience , 2014, Current Opinion in Neurobiology.

[46]  R. Yuste From the neuron doctrine to neural networks , 2015, Nature Reviews Neuroscience.

[47]  Akimasa Takeuchi,et al.  Signal transfer within a cultured asymmetric cortical neuron circuit , 2015, Journal of neural engineering.

[48]  Yasser Roudi,et al.  Multi-neuronal activity and functional connectivity in cell assemblies , 2015, Current Opinion in Neurobiology.

[49]  Haiping Huang,et al.  Effects of hidden nodes on network structure inference , 2015, 1506.00358.

[50]  Pan Zhang,et al.  Inference of the sparse kinetic Ising model using the decimation method. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[51]  Andres D. Grosmark,et al.  Diversity in neural firing dynamics supports both rigid and learned hippocampal sequences , 2016, Science.

[52]  Matteo Marsili,et al.  Sparse model selection in the highly under-sampled regime , 2016, 1603.00952.

[53]  Wolfgang Maass,et al.  Searching for principles of brain computation , 2016, Current Opinion in Behavioral Sciences.

[54]  Jukka Corander,et al.  Statistical properties of interaction parameter estimates in direct coupling analysis , 2017 .

[55]  Yasser Roudi,et al.  Learning with unknowns: Analyzing biological data in the presence of hidden variables , 2017 .

[56]  Kenneth D Harris,et al.  Challenges and opportunities for large-scale electrophysiology with Neuropixels probes , 2018, Current Opinion in Neurobiology.

[57]  Jukka Corander,et al.  Inverse finite-size scaling for high-dimensional significance analysis. , 2018, Physical review. E.

[58]  L .Paninski,et al.  Neural data science: accelerating the experiment-analysis-theory cycle in large-scale neuroscience , 2017, Current Opinion in Neurobiology.

[59]  Yoshiyuki Kabashima,et al.  Objective and efficient inference for couplings in neuronal network , 2018, NeurIPS.

[60]  Ila R. Fiete,et al.  Systematic errors in connectivity inferred from activity in strongly coupled recurrent circuits , 2019, bioRxiv.

[61]  Sonja Grün,et al.  Second type of criticality in the brain uncovers rich multiple-neuron dynamics , 2016, Proceedings of the National Academy of Sciences.

[62]  Katsunori Kitano,et al.  Reconstructing neuronal circuitry from parallel spike trains , 2019, Nature Communications.

[63]  Nicholas A. Steinmetz,et al.  High-dimensional geometry of population responses in visual cortex , 2018, Nature.