Dynamics of temporal learning rules.

The changes of synaptic strength are analyzed on two time scales: the fast local field dynamics, and the slow synaptic modification dynamics. The fast dynamics are determined by the synaptic strengths and background noise in the system. The slow dynamics are determined by the functional form of a temporal learning rule. Temporal learning rules are defined to be functions yielding state dependent changes in synaptic strengths depending on the timing of pre- and postsynaptic states in the network. The evolution of local field dynamics that result from various learning rules are analyzed for a stochastic, discrete time neural model with no relative refractory period that receives a series of delayed adaptive inputs. A fixed point is found in the learning dynamics, and conditions for two types of instabilities are analyzed. Four universality classes of dynamics are found that are independent of the details of the temporal learning rules. Examples are given of biological systems in which these temporal learning rules have been identified, and their functional consequences are discussed.

[1]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[2]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[3]  K. Grant,et al.  Sensory processing and corollary discharge effects in the mormyromast regions of the mormyrid electrosensory lobe. I. Field potentials, cellular activity in associated structures. , 1992, Journal of neurophysiology.

[4]  R. W. Penney,et al.  Coupled dynamics of fast spins and slow interactions in neural networks and spin systems , 1993 .

[5]  M. Mézard,et al.  Partial annealing and overfrustration in disordered systems , 1994 .

[6]  D. Debanne,et al.  Asynchronous pre- and postsynaptic activity induces associative long-term depression in area CA1 of the rat hippocampus in vitro. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[8]  V. Han,et al.  Synaptic plasticity in a cerebellum-like structure depends on temporal order , 1997, Nature.

[9]  C. Bell,et al.  The generation and subtraction of sensory expectations within cerebellum-like structures. , 1997, Brain, behavior and evolution.

[10]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[11]  M. Mauk Roles of Cerebellar Cortex and Nuclei in Motor Learning: Contradictions or Clues? , 1997, Neuron.

[12]  Sebastiano Stramaglia,et al.  Dynamics of neural networks with nonmonotonic neurons and adapting synapses , 1998 .

[13]  Li I. Zhang,et al.  A critical window for cooperation and competition among developing retinotectal synapses , 1998, Nature.

[14]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .