Retrieval Property of Attractor Network with Synaptic Depression(General)

Synaptic connections are known to change dynamically. High-frequency presynaptic inputs induce decrease of synaptic weights. This process is known as short-term synaptic depression. The synaptic depression controls a gain for presynaptic inputs. However, it remains a controversial issue what are functional roles of this gain control. We propose a new hypothesis that one of the functional roles is to enlarge basins of attraction. To verify this hypothesis, we employ a binary discrete-time associative memory model which consists of excitatory and inhibitory neurons. It is known that the excitatory–inhibitory balance controls an overall activity of the network. The synaptic depression might incorporate an activity control mechanism. Using a mean-field theory and computer simulations, we find that the synaptic depression enlarges the basins at a small loading rate while the excitatory–inhibitory balance enlarges them at a large loading rate. Furthermore the synaptic depression does not affect the steady state...

[1]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[2]  P C Bressloff,et al.  Mean-field theory of globally coupled integrate-and-fire neural oscillators with dynamic synapses. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[3]  Shigeru Yamane,et al.  Neuronal Mechanisms Encoding Global-to-Fine Information in Inferior-Temporal Cortex , 2005, Journal of Computational Neuroscience.

[4]  Masato Okada,et al.  Notions of Associative Memory and Sparse Coding , 1996, Neural Networks.

[5]  M. Shiino,et al.  Self-consistent signal-to-noise analysis and its application to analogue neural networks with asymmetric connections , 1992 .

[6]  Masato Okada,et al.  Self-Regulation Mechanism of Temporally Asymmetric Hebbian Plasticity , 2001, Neural Computation.

[7]  J. Deuchars,et al.  Temporal and spatial properties of local circuits in neocortex , 1994, Trends in Neurosciences.

[8]  S. Hestrin,et al.  Frequency-dependent synaptic depression and the balance of excitation and inhibition in the neocortex , 1998, Nature Neuroscience.

[9]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[10]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Lovorka Pantic,et al.  Storage capacity of attractor neural networks with depressing synapses. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  J. Leo van Hemmen,et al.  Short-Term Synaptic Plasticity and Network Behavior , 1999, Neural Computation.

[13]  N Brunel,et al.  Correlations of cortical Hebbian reverberations: theory versus experiment , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  Hilbert J. Kappen,et al.  Associative Memory with Dynamic Synapses , 2002, Neural Computation.

[15]  T. Geisel,et al.  Pattern storage and processing in attractor networks with short-time synaptic dynamics , 2002, Network.

[16]  Shun-ichi Amari,et al.  Statistical neurodynamics of associative memory , 1988, Neural Networks.