Effects of Fast Presynaptic Noise in Attractor Neural Networks

We study both analytically and numerically the effect of presynaptic noise on the transmission of information in attractor neural networks. The noise occurs on a very short timescale compared to that for the neuron dynamics and it produces short-time synaptic depression. This is inspired in recent neurobiological findings that show that synaptic strength may either increase or decrease on a short timescale depending on presynaptic activity. We thus describe a mechanism by which fast presynaptic noise enhances the neural network sensitivity to an external stimulus. The reason is that, in general, presynaptic noise induces nonequilibrium behavior and, consequently, the space of fixed points is qualitatively modified in such a way that the system can easily escape from the attractor. As a result, the model shows, in addition to pattern recognition, class identification and categorization, which may be relevant to the understanding of some of the brain complex tasks.

[1]  Hilbert J. Kappen,et al.  Associative Memory with Dynamic Synapses , 2002, Neural Computation.

[2]  Pedro L. Garrido,et al.  Kinetic lattice models of disorder , 1994 .

[3]  G. Laurent,et al.  Odor encoding as an active, dynamical process: experiments, computation, and theory. , 2001, Annual review of neuroscience.

[4]  A. Thomson,et al.  Target and temporal pattern selection at neocortical synapses. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  Joaquín J. Torres,et al.  Switching between memories in neural automata with synaptic noise , 2004, Neurocomputing.

[6]  Garrido,et al.  Nonequilibrium lattice models: A case with effective Hamiltonian in d dimensions. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[7]  C. Stevens,et al.  An evaluation of causes for unreliability of synaptic transmission. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[8]  B. Alger,et al.  Postsynaptic spike firing reduces synaptic GABAA responses in hippocampal pyramidal cells , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[10]  S. Amari,et al.  Characteristics of Random Nets of Analog Neuron-Like Elements , 1972, IEEE Trans. Syst. Man Cybern..

[11]  L. Abbott,et al.  Model neurons: From Hodgkin-Huxley to hopfield , 1990 .

[12]  Lovorka Pantic,et al.  Storage capacity of attractor neural networks with depressing synapses. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[14]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Joaquín J. Torres,et al.  Neural networks with fast time-variation of synapses , 1997 .

[16]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.

[17]  Joaquín J. Torres,et al.  Neural Networks in Which Synaptic Patterns Fluctuate with Time , 1999 .

[18]  Garrido,et al.  Effective Hamiltonian description of nonequilibrium spin systems. , 1989, Physical review letters.

[19]  Horn,et al.  Neural networks with dynamical thresholds. , 1989, Physical review. A, General physics.

[20]  T. Sejnowski,et al.  Independent Sources of Quantal Variability at Single Glutamatergic Synapses , 2003, The Journal of Neuroscience.

[21]  Sompolinsky,et al.  Neural networks with nonlinear synapses and a static noise. , 1986, Physical review. A, General physics.

[22]  J. Marro,et al.  Algorithms for identification and categorization , 2005 .

[23]  Joaquín Marro,et al.  Ising Systems with Conflicting Dynamics: Exact Results for Random Interactions and Fields , 1994 .

[24]  K. Vahala.  Handbook of stochastic methods for physics, chemistry and the natural sciences , 1986, IEEE Journal of Quantum Electronics.

[25]  L. B. Litinskii.  Hopfield Model with a Dynamic Threshold , 2001 .

[26]  L. Abbott,et al.  Synaptic computation , 2004, Nature.

[27]  Lee M. Miller,et al.  Stimulus-Based State Control in the Thalamocortical System , 2000, The Journal of Neuroscience.

[28]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[29]  Hilbert J. Kappen,et al.  Effects of Fast Presynaptic Noise in Attractor Neural Networks , 2006 .

[30]  T. Geisel,et al.  Pattern storage and processing in attractor networks with short-time synaptic dynamics , 2002, Network.

[31]  Joaquín J. Torres,et al.  Influence of topology on the performance of a neural network , 2004, Neurocomputing.

[32]  R. Dickman,et al.  Nonequilibrium Phase Transitions in Lattice Models , 1999 .

[33]  D. Amit,et al.  Statistical mechanics of neural networks near saturation , 1987 .

[34]  A. Zador.  Impact of synaptic unreliability on the information transmitted by spiking neurons. , 1998, Journal of neurophysiology.

[35]  Naftali Tishby,et al.  Cortical activity flips among quasi-stationary states. , 1995, Proceedings of the National Academy of Sciences of the United States of America.