Finite-size and correlation-induced effects in mean-field dynamics

The brain’s activity is characterized by the interaction of a very large number of neurons that are strongly affected by noise. However, signals often arise at macroscopic scales integrating the effect of many neurons into a reliable pattern of activity. In order to study such large neuronal assemblies, one is often led to derive mean-field limits summarizing the effect of the interaction of a large number of neurons into an effective signal. Classical mean-field approaches consider the evolution of a deterministic variable, the mean activity, thus neglecting the stochastic nature of neural behavior. In this article, we build upon two recent approaches that include correlations and higher order moments in mean-field equations, and study how these stochastic effects influence the solutions of the mean-field equations, both in the limit of an infinite number of neurons and for large yet finite networks. We introduce a new model, the infinite model, which arises from both equations by a rescaling of the variables and, which is invertible for finite-size networks, and hence, provides equivalent equations to those previously derived models. The study of this model allows us to understand qualitative behavior of such large-scale networks. We show that, though the solutions of the deterministic mean-field equation constitute uncorrelated solutions of the new mean-field equations, the stability properties of limit cycles are modified by the presence of correlations, and additional non-trivial behaviors including periodic orbits appear when there were none in the mean field. The origin of all these behaviors is then explored in finite-size networks where interesting mesoscopic scale effects appear. This study leads us to show that the infinite-size system appears as a singular limit of the network equations, and for any finite network, the system will differ from the infinite system.

[1]  H. Neudecker Some Theorems on Matrix Differentiation with Special Reference to Kronecker Matrix Products , 1969 .

[2]  J. Touboul,et al.  A characterization of the first hitting time of double integral processes to curved boundaries , 2008, Advances in Applied Probability.

[3]  Boris S. Gutkin,et al.  Multiple Bumps in a Neuronal Model of Working Memory , 2002, SIAM J. Appl. Math..

[4]  J. A. Kuznecov Elements of applied bifurcation theory , 1998 .

[5]  S. Coombes,et al.  Bumps, breathers, and waves in a neural network with spike frequency adaptation. , 2005, Physical review letters.

[6]  Y. Kuznetsov Elements of applied bifurcation theory (2nd ed.) , 1998 .

[7]  H C Tuckwell,et al.  Noisy spiking neurons and networks: useful approximations for firing probabilities and global behavior. , 1998, Bio Systems.

[8]  Cheng Ly,et al.  Critical Analysis of Dimension Reduction by a Moment Closure Method in a Population Density Approach to Neural Network Modeling , 2007, Neural Computation.

[9]  Bard Ermentrout,et al.  Simulating, analyzing, and animating dynamical systems - a guide to XPPAUT for researchers and students , 2002, Software, environments, tools.

[10]  Nicolas Brunel,et al.  Firing Rate of the Noisy Quadratic Integrate-and-Fire Neuron , 2003, Neural Computation.

[11]  Marc Benayoun,et al.  Avalanches in a Stochastic Model of Spiking Neurons , 2010, PLoS Comput. Biol..

[12]  S. Amari,et al.  Characteristics of Random Nets of Analog Neuron-Like Elements , 1972, IEEE Trans. Syst. Man Cybern..

[13]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[14]  T. Kurtz Limit theorems and diffusion approximations for density dependent Markov chains , 1976 .

[15]  S. A. Robertson,et al.  NONLINEAR OSCILLATIONS, DYNAMICAL SYSTEMS, AND BIFURCATIONS OF VECTOR FIELDS (Applied Mathematical Sciences, 42) , 1984 .

[16]  Richard P Boland,et al.  How limit cycles and quasi-cycles are related in systems with intrinsic noise , 2008, 0805.1607.

[17]  Michael A. Buice,et al.  Systematic Fluctuation Expansion for Neural Network Activity Equations , 2009, Neural Computation.

[18]  P. Bressloff Metastable states and quasicycles in a stochastic Wilson-Cowan model of neuronal population dynamics. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Alain Destexhe,et al.  Brain Dynamics at Multiple Scales: Can One Reconcile the Apparent Low-Dimensional Chaos of Macroscopic Variables with the seemingly Stochastic Behavior of Single Neurons? , 2010, Int. J. Bifurc. Chaos.

[20]  Marian Stamp Dawkins,et al.  The Noisy Brain: Stochastic Dynamics as a Principle of Brain Function The Noisy Brain: Stochastic Dynamics as a Principle of Brain Function. By Edmund T. Rolls & Gustavo Deco. Oxford: Oxford University Press (2010). Pp. 310. Price £37.95 hardback. , 2010, Animal Behaviour.

[21]  Ohira,et al.  Master-equation approach to stochastic neurodynamics. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[22]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[23]  M. Mattia,et al.  Population dynamics of interacting spiking neurons. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  H. Plesser Aspects of Signal Processing in Noisy Neurons , 2001 .

[25]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[26]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[27]  Arjona,et al.  Dynamics of coherently pumped lasers with linearly polarized pump and generated fields. , 1993, Physical review. A, Atomic, molecular, and optical physics.

[28]  M. Shelley,et al.  An effective kinetic representation of fluctuation-driven neuronal networks with application to simple and complex cells in visual cortex. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[29]  M. Freidlin,et al.  Random Perturbations of Dynamical Systems , 1984 .

[30]  J. M. Herrmann,et al.  Phase transitions towards criticality in a neural system with adaptive interactions. , 2009, Physical review letters.

[31]  J. Touboul,et al.  Can Power-Law Scaling and Neuronal Avalanches Arise from Stochastic Dynamics? , 2009, PloS one.

[32]  Alain Destexhe,et al.  A Master Equation Formalism for Macroscopic Modeling of Asynchronous Irregular Activity States , 2009, Neural Computation.

[33]  J. Craggs Applied Mathematical Sciences , 1973 .

[34]  Werner Horsthemke,et al.  Noise-induced transitions , 1984 .

[35]  J. Doob Markoff chains—denumerable case , 1945 .

[36]  Paul C. Bressloff,et al.  Stochastic Neural Field Theory and the System-Size Expansion , 2009, SIAM J. Appl. Math..

[37]  Eleonora Bilotta,et al.  Chaos at School: Chua's Circuit for Students in Junior and Senior High School , 2010, Int. J. Bifurc. Chaos.

[38]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[39]  Olivier D. Faugeras,et al.  A Constructive Mean-Field Analysis of Multi-Population Neural Networks with Random Synaptic Weights and Stochastic Inputs , 2008, Front. Comput. Neurosci..

[40]  Abbott,et al.  Asynchronous states in networks of pulse-coupled oscillators. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[41]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[42]  Pierre Gaspard,et al.  The correlation time of mesoscopic chemical clocks , 2002 .

[43]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[44]  Olivier Faugeras,et al.  The spikes trains probability distributions: A stochastic calculus approach , 2007, Journal of Physiology-Paris.

[45]  Joe Brewer,et al.  Kronecker products and matrix calculus in system theory , 1978 .

[46]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[47]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Mark Dykman,et al.  Large fluctuations and optimal paths in chemical kinetics , 1994 .

[49]  D. Gillespie A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[50]  H. C. Tuckwell,et al.  A dynamical system for the approximate moments of nonlinear stochastic models of spiking neurons and networks , 2000 .

[51]  J. Cowan,et al.  A mathematical theory of visual hallucination patterns , 1979, Biological Cybernetics.

[52]  J. Cowan,et al.  Field-theoretic approach to fluctuation effects in neural networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  G Bard Ermentrout,et al.  Stochastic phase reduction for a general class of noisy limit cycle oscillators. , 2009, Physical review letters.

[54]  N. G. Parke,et al.  Ordinary Differential Equations. , 1958 .

[55]  A. McKane,et al.  Amplified Biochemical Oscillations in Cellular Systems , 2006, q-bio/0604001.

[56]  G. Casadesus,et al.  Walking Toward a Convergence in Aging Research , 2009, Front. Neurosci..

[57]  V. Araújo Random Dynamical Systems , 2006, math/0608162.

[58]  John M. Beggs,et al.  Behavioral / Systems / Cognitive Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004 .

[59]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.