Stochastic neurodynamics and the system size expansion

We present here a method for the study of stochastic neurodynamics in the master equation framework. Our aim is to obtain a statistical description of the dynamics of fluctuations and correlations of neural activity in large neural networks. We focus on a macroscopic description of the network via a master equation for the number of active neurons in the network. We present a systematic expansion of this equation using the “system size expansion”. We obtain coupled dynamical equations for the average activity and of fluctuations around this average. These equations exhibit non-monotonic approaches to equilibrium, as seen in Monte Carlo simulations.

[1]  Shun-ichi Amari,et al.  Statistical neurodynamics of associative memory , 1988, Neural Networks.

[2]  Joachim M. Buhmann,et al.  Pattern Segmentation in Associative Memory , 1990, Neural Computation.

[3]  Ohira,et al.  Master-equation approach to stochastic neurodynamics. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[4]  H. Nishimori,et al.  Retrieval dynamics of associative memory of the Hopfield type , 1993 .

[5]  Sherrington,et al.  Dynamics of fully connected attractor neural networks near saturation. , 1993, Physical review letters.

[6]  Jack D. Cowan,et al.  Stochastic Dynamics of Three-State Neural Networks , 1994, NIPS.

[7]  N Brunel,et al.  Correlations of cortical Hebbian reverberations: theory versus experiment , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[9]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[10]  Gerard T. Barkema,et al.  Monte Carlo Methods in Statistical Physics , 1999 .