Mean Field Analysis of Stochastic Neural Network Models with Synaptic Depression

We investigated the effects of synaptic depression on the macroscopic behavior of stochastic neural networks. Dynamical mean field equations were derived for such networks by taking the average of two stochastic variables: a firing state variable and a synaptic variable. In these equations, their average product is decoupled as the product of averaged them because the two stochastic variables are independent. We proved the independence of these two stochastic variables assuming that the synaptic weight is of the order of 1/N with respect to the number of neurons N. Using these equations, we derived macroscopic steady state equations for a network with uniform connections and a ring attractor network with Mexican hat type connectivity and investigated the stability of the steady state solutions. An oscillatory uniform state was observed in the network with uniform connections due to a Hopf instability. With the ring network, high-frequency perturbations were shown not to affect system stability. Two mechanisms destabilize the inhomogeneous steady state, leading two oscillatory states. A Turing instability leads to a rotating bump state, while a Hopf instability leads to an oscillatory bump state, which was previous unreported. Various oscillatory states take place in a network with synaptic depression depending on the strength of the interneuron connections.

[1]  D. Hansel,et al.  Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. , 2005, Physical review letters.

[2]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Jian-Young Wu,et al.  Compression and Reflection of Visually Evoked Cortical Waves , 2007, Neuron.

[4]  P. Bressloff,et al.  Effects of synaptic depression and adaptation on spatiotemporal dynamics of an excitatory neuronal network , 2010 .

[5]  Robert A. Frazor,et al.  Standing Waves and Traveling Waves Distinguish Two Circuits in Visual Cortex , 2007, Neuron.

[6]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[7]  G. Buzsáki Rhythms of the brain , 2006 .

[8]  Masato Okada,et al.  Retrieval Property of Attractor Network with Synaptic Depression(General) , 2007 .

[9]  E Tulving,et al.  Priming and human memory systems. , 1990, Science.

[10]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[11]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]/Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[12]  M. Okada,et al.  Effect of asymmetry in a binary state on the collective behavior of a system with spatially modulated interaction and quenched randomness. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[14]  J. Rothman,et al.  Synaptic depression enables neuronal gain control , 2009, Nature.

[15]  Feng Qi Han,et al.  Reverberation of Recent Visual Experience in Spontaneous Cortical Waves , 2008, Neuron.

[16]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[17]  Masato Okada,et al.  Analytic solution of neural network with disordered lateral inhibition. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  J. Deuchars,et al.  Temporal and spatial properties of local circuits in neocortex , 1994, Trends in Neurosciences.

[19]  S. Kirkpatrick,et al.  Solvable Model of a Spin-Glass , 1975 .

[20]  W. Regehr,et al.  Short-term synaptic plasticity. , 2002, Annual review of physiology.

[21]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[22]  R. W. Stewart,et al.  Waves and Turbulence , 1969 .

[23]  Paul C. Bressloff,et al.  Spatially structured oscillations in a two-dimensional excitatory neuronal network with synaptic depression , 2009, Journal of Computational Neuroscience.

[24]  P. C. Murphy,et al.  Cerebral Cortex , 2017, Cerebral Cortex.

[25]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[26]  Misha Tsodyks,et al.  Neural networks and perceptual learning , 2004, Nature.

[27]  Mark C. W. van Rossum,et al.  Recurrent networks with short term synaptic depression , 2009, Journal of Computational Neuroscience.

[28]  A. Kohn Visual adaptation: physiology, mechanisms, and functional benefits. , 2007, Journal of neurophysiology.

[29]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[30]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[31]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.