Ising Models for Inferring Network Structure From Spike Data

Now that spike trains from many neurons can be recorded simultaneously, there is a need for methods to decode these data to learn about the networks that these neurons are part of. One approach to this problem is to adjust the parameters of a simple model network to make its spike trains resemble the data as much as possible. The connections in the model network can then give us an idea of how the real neurons that generated the data are connected and how they influence each other. In this chapter we describe how to do this for the simplest kind of model: an Ising network. We derive algorithms for finding the best model connection strengths for fitting a given data set, as well as faster approximate algorithms based on mean field theory. We test the performance of these algorithms on data from model networks and experiments.

[1]  Toshiyuki TANAKA.  Mean-field theory of Boltzmann machine learning , 1998 .

[2]  P. Peretto,et al.  Collective properties of neural networks: A statistical physics approach , 2004, Biological Cybernetics.

[3]  鈴木 増雄.  Time-Dependent Statistics of the Ising Model , 1965 .

[4]  T. Plefka.  Convergence condition of the TAP equation for the infinite-ranged Ising spin glass model , 1982 .

[5]  M. Wilson,et al.  Analyzing Functional Connectivity Using a Network Likelihood Model of Ensemble Neural Spiking Activity , 2005, Neural Computation.

[6]  J. Hertz,et al.  Ising model for neural data: model quality and approximate methods for extracting functional connectivity. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[8]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[9]  Lee E. Miller,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[10]  John Hertz,et al.  Cross-Correlations in High-Conductance States of a Model Cortical Network , 2010, Neural Computation.

[11]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[12]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[13]  H. Akaike.  A new look at the statistical model identification , 1974 .

[14]  J. Hertz,et al.  Mean field theory for nonequilibrium network reconstruction. , 2010, Physical review letters.

[15]  A. Maritan,et al.  Using the principle of entropy maximization to infer genetic interaction networks from gene expression patterns , 2006, Proceedings of the National Academy of Sciences.

[16]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[17]  Yasser Roudi,et al.  Effect of coupling asymmetry on mean-field solutions of the direct and inverse Sherrington–Kirkpatrick model , 2011, 1106.0452.

[18]  R. Palmer,et al.  Solution of 'Solvable model of a spin glass' , 1977 .

[19]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[20]  J. Lafferty,et al.  High-dimensional Ising model selection using ℓ1-regularized logistic regression , 2010, 1010.0311.

[21]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[22]  M. Mezard,et al.  Exact mean-field inference in asymmetric kinetic Ising systems , 2011, 1103.3433.

[23]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[24]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[25]  Hilbert J. Kappen,et al.  Efficient Learning in Boltzmann Machines Using Linear Response Theory , 1998, Neural Computation.

[26]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[27]  Yasser Roudi,et al.  Dynamical TAP equations for non-equilibrium Ising spin glasses , 2011, 1103.1044.