A learning rule for the emergence of stable dynamics and timing in recurrent networks.

Neural dynamics within recurrent cortical networks is an important component of neural processing. However, the learning rules that allow networks composed of hundreds or thousands of recurrently connected neurons to develop stable dynamical states are poorly understood. Here I use a neural network model to examine the emergence of stable dynamical states within recurrent networks. I describe a learning rule that can account both for the development of stable dynamics and guide networks to states that have been observed experimentally, specifically, states that instantiate a sparse code for time. Across trials, each neuron fires during a specific time window; by connecting the neurons to a hypothetical set of output units, it is possible to generate arbitrary spatial-temporal output patterns. Intertrial jitter of the spike time of a given neuron increases as a direct function of the delay at which it fires. These results establish a learning rule by which cortical networks can potentially process temporal information in a self-organizing manner, in the absence of specialized timing mechanisms.

[1]  D. Buonomano,et al.  The neural basis of temporal processing. , 2004, Annual review of neuroscience.

[2]  K Albus,et al.  Activity-dependent development of spontaneous bioelectric activity in organotypic cultures of rat occipital cortex. , 2000, Brain research. Developmental brain research.

[3]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[4]  U. Karmarkar,et al.  A model of spike-timing dependent plasticity: one or two coincidence detectors? , 2002, Journal of neurophysiology.

[5]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[6]  U. Karmarkar,et al.  Temporal specificity of perceptual learning in an auditory discrimination task. , 2003, Learning & memory.

[7]  Kenneth D. Miller,et al.  The Role of Constraints in Hebbian Learning , 1994, Neural Computation.

[8]  D. Muller,et al.  Time course of synaptic development in hippocampal organotypic cultures. , 1993, Brain research. Developmental brain research.

[9]  G. Laurent,et al.  Temporal Representations of Odors in an Olfactory Network , 1996, The Journal of Neuroscience.

[10]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[11]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[12]  H. Markram,et al.  Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. , 2000, Science.

[13]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[14]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  Terrence J. Sejnowski,et al.  An Efficient Method for Computing Synaptic Conductances Based on a Kinetic Model of Receptor Binding , 1994, Neural Computation.

[16]  H. Robinson,et al.  Simultaneous induction of pathway-specific potentiation and depression in networks of cortical neurons. , 1999, Biophysical journal.

[17]  Alexander Borst,et al.  Information theory and neural coding , 1999, Nature Neuroscience.

[18]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[19]  R. Ivry The representation of temporal information in perception and motor control , 1996, Current Opinion in Neurobiology.

[20]  E. W. Kairiss,et al.  Hebbian synapses: biophysical mechanisms and algorithms. , 1990, Annual review of neuroscience.

[21]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[22]  Barak A. Pearlmutter Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[23]  Dean V. Buonomano,et al.  Timing and Balance of Inhibition Enhance the Effect of Long-Term Potentiation on Cell Firing , 2004, The Journal of Neuroscience.

[24]  Eduardo D. Sontag,et al.  Analog Neural Nets with Gaussian or Other Common Noise Distributions Cannot Recognize Arbitrary Regular Languages , 1999, Neural Computation.

[25]  P. J. Sjöström,et al.  Neocortical LTD via Coincident Activation of Presynaptic NMDA and Cannabinoid Receptors , 2003, Neuron.

[26]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[27]  Richard Hans Robert Hahnloser,et al.  An ultra-sparse code underliesthe generation of neural sequences in a songbird , 2002, Nature.

[28]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[29]  J. Hertz,et al.  Adjacent visual cortical complex cells share about 20% of their stimulus-related information. , 1996, Cerebral cortex.

[30]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[31]  A. Arnold,et al.  Developmental plasticity in neural circuits for a learned behavior. , 1997, Annual review of neuroscience.

[32]  H. Swadlow Efferent neurons and suspected interneurons in S-1 vibrissa cortex of the awake rabbit: receptive fields and axonal properties. , 1989, Journal of neurophysiology.

[33]  John M. Beggs,et al.  Behavioral / Systems / Cognitive Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004 .

[34]  Nicholas T. Carnevale,et al.  The NEURON Simulation Environment , 1997, Neural Computation.

[35]  M. Bear,et al.  Modulation of Long-Term Synaptic Depression in Visual Cortex by Acetylcholine and Norepinephrine , 1999, The Journal of Neuroscience.

[36]  V. Murthy,et al.  Multiple forms of synaptic plasticity triggered by selective suppression of activity in individual neurons , 2002, Nature.

[37]  M. Kilgard,et al.  Cholinergic Modulation of Skill Learning and Plasticity , 2003, Neuron.

[38]  Richard Hans Robert Hahnloser,et al.  Neural Mechanisms of Vocal Sequence Generation in the Songbird , 2004, Annals of the New York Academy of Sciences.

[39]  Francesco Marrosu,et al.  Microdialysis measurement of cortical and hippocampal acetylcholine release during sleep-wake cycle in freely moving cats , 1995, Brain Research.

[40]  Dario L. Ringach,et al.  Dynamics of orientation tuning in macaque primary visual cortex , 1997, Nature.

[41]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[42]  D V Buonomano,et al.  Decoding Temporal Information: A Model Based on Short-Term Synaptic Plasticity , 2000, The Journal of Neuroscience.

[43]  M. Kilgard,et al.  Plasticity of temporal information processing in the primary auditory cortex , 1998, Nature Neuroscience.

[44]  Javier F. Medina,et al.  Timing Mechanisms in the Cerebellum: Testing Predictions of a Large-Scale Computer Simulation , 2000, The Journal of Neuroscience.

[45]  F. Ebner,et al.  An innocuous bias in whisker use in adult rats modifies receptive fields of barrel cortex neurons , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  E. Marder,et al.  A Model Neuron with Activity-Dependent Conductances Regulated by Multiple Calcium Sensors , 1998, The Journal of Neuroscience.

[47]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[48]  J. Fuster,et al.  Unit activity in monkey parietal cortex related to haptic perception and temporary memory , 2004, Experimental Brain Research.

[49]  P. Castillo,et al.  Heterosynaptic LTD of Hippocampal GABAergic Synapses A Novel Role of Endocannabinoids in Regulating Excitability , 2003, Neuron.

[50]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[51]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  W. Singer,et al.  Modulation of visual cortical plasticity by acetylcholine and noradrenaline , 1986, Nature.

[53]  Dean V Buonomano,et al.  Timing of neural responses in cortical organotypic slices , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[54]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[55]  P. Kuhl,et al.  Birdsong and human speech: common themes and mechanisms. , 1999, Annual review of neuroscience.

[56]  M. Cynader,et al.  Quantitative distribution of GABA-immunopositive and -immunonegative neurons and synapses in the monkey striate cortex (area 17). , 1992, Cerebral cortex.

[57]  T. Hashikawa,et al.  Temporal Integration and Duration Tuning in the Dorsal Zone of Cat Auditory Cortex , 1997, The Journal of Neuroscience.