Stochastic firing rate models

We review a recent approach to the mean-field limits in neural networks that takes into account the stochastic nature of input current and the uncertainty in synaptic coupling. This approach was proved to be a rigorous limit of the network equations in a general setting, and we express here the results in a more customary and simpler framework. We propose a heuristic argument to derive these equations providing a more intuitive understanding of their origin. These equations are characterized by a strong coupling between the different moments of the solutions. We analyse the equations, present an algorithm to simulate the solutions of these mean-field equations, and investigate numerically the equations. In particular, we build a bridge between these equations and Sompolinsky and collaborators approach (1988, 1990), and show how the coupling between the mean and the covariance function deviates from customary approaches.

[1]  Jonathan Touboul,et al.  Finite-size and correlation-induced effects in mean-field dynamics , 2010, Journal of Computational Neuroscience.

[2]  Olivier D. Faugeras,et al.  A Constructive Mean-Field Analysis of Multi-Population Neural Networks with Random Synaptic Weights and Stochastic Inputs , 2008, Front. Comput. Neurosci..

[3]  Alain Destexhe,et al.  A Master Equation Formalism for Macroscopic Modeling of Asynchronous Irregular Activity States , 2009, Neural Computation.

[4]  Paul C. Bressloff,et al.  Stochastic Neural Field Theory and the System-Size Expansion , 2009, SIAM J. Appl. Math..

[5]  Aaditya V. Rangan,et al.  Kinetic theory for neuronal networks with fast and slow excitatory conductances driven by the same spike train. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Olivier Faugeras,et al.  The spikes trains probability distributions: A stochastic calculus approach , 2007, Journal of Physiology-Paris.

[7]  M. Shelley,et al.  An effective kinetic representation of fluctuation-driven neuronal networks with application to simple and complex cells in visual cortex. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[9]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.

[10]  Lawrence Sirovich,et al.  On the Simulation of Large Populations of Neurons , 2004, Journal of Computational Neuroscience.

[11]  Duane Q. Nykamp,et al.  A Population Density Approach That Facilitates Large-Scale Modeling of Neural Networks: Analysis and an Application to Orientation Tuning , 2004, Journal of Computational Neuroscience.

[12]  Philippe Faure,et al.  Is there chaos in the brain? II. Experimental evidence and related models. , 2003, Comptes rendus biologies.

[13]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[14]  M. Mattia,et al.  Population dynamics of interacting spiking neurons. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Carl van Vreeswijk,et al.  Temporal Correlations in Stochastic Networks of Spiking Neurons , 2002, Neural Computation.

[16]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[17]  H. Korn,et al.  Is there chaos in the brain? I. Concepts of nonlinear dynamics and methods of investigation. , 2001, Comptes rendus de l'Academie des sciences. Serie III, Sciences de la vie.

[18]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[19]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[20]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[21]  A. Guionnet Averaged and quenched propagation of chaos for spin glass dynamics , 1997 .

[22]  G. B. Arous,et al.  Symmetric Langevin spin glass dynamics , 1997 .

[23]  G. B. Arous,et al.  Large deviations for Langevin spin glass dynamics , 1995 .

[24]  B. Cessac Increase in Complexity in Random Neural Networks , 1995 .

[25]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[26]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[27]  Bard Ermentrout,et al.  Reduction of Conductance-Based Models with Slow Synapses to Neural Nets , 1994, Neural Computation.

[28]  Abbott,et al.  Asynchronous states in networks of pulse-coupled oscillators. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[29]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  John Rinzel,et al.  Activity Patterns of a Slow Synapse Network Predicted by Explicitly Averaging Spike Dynamics , 1992, Neural Computation.

[31]  D. Pollard Empirical Processes: Theory and Applications , 1990 .

[32]  G. Ermentrout,et al.  Analysis of neural excitability and oscillations , 1989 .

[33]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[34]  G. Ermentrout,et al.  Parabolic bursting in an excitable system coupled with a slow oscillation , 1986 .

[35]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[36]  S. Amari,et al.  A Mathematical Foundation for Statistical Neurodynamics , 1977 .

[37]  S. Amari,et al.  Characteristics of Random Nets of Analog Neuron-Like Elements , 1972, IEEE Trans. Syst. Man Cybern..

[38]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.