Role of synaptic dynamics and heterogeneity in neuronal learning of temporal code.

Temporal codes are believed to play important roles in neuronal representation of information. Neuronal ability to classify and learn temporal spiking patterns is thus essential for successful extraction and processing of information. Understanding neuronal learning of temporal code has been complicated, however, by the intrinsic stochasticity of synaptic transmission. Using a computational model of a learning neuron, the tempotron, we studied the effects of synaptic unreliability and short-term dynamics on the neuron's ability to learn spike timing rules. Our results suggest that such a model neuron can learn to classify spike timing patterns even with unreliable synapses, albeit with a significantly reduced success rate. We explored strategies to improve correct spike timing classification and found that firing clustered spike bursts significantly improves learning performance. Furthermore, rapid activity-dependent modulation of synaptic unreliability, implemented with realistic models of dynamic synapses, further improved classification of different burst properties and spike timing modalities. Neuronal models with only facilitating or only depressing inputs exhibited preference for specific types of spike timing rules, but a mixture of facilitating and depressing synapses permitted much improved learning of multiple rules. We tested applicability of these findings to real neurons by considering neuronal learning models with the naturally distributed input release probabilities found in excitatory hippocampal synapses. Our results suggest that spike bursts comprise several encoding modalities that can be learned effectively with stochastic dynamic synapses, and that distributed release probabilities significantly improve learning performance. Synaptic unreliability and dynamics may thus play important roles in the neuron's ability to learn spike timing rules during decoding.

[1]  W. Regehr,et al.  Short-term synaptic plasticity. , 2002, Annual review of physiology.

[2]  M. London,et al.  Dendritic computation. , 2005, Annual review of neuroscience.

[3]  E. Fortune,et al.  Short-term synaptic plasticity as a temporal filter , 2001, Trends in Neurosciences.

[4]  L. Abbott,et al.  Redundancy Reduction and Sustained Firing with Stochastic Depressing Synapses , 2002, The Journal of Neuroscience.

[5]  W. Singer,et al.  Temporal Coding in the Brain , 1994, Research and Perspectives in Neurosciences.

[6]  D V Buonomano,et al.  Decoding Temporal Information: A Model Based on Short-Term Synaptic Plasticity , 2000, The Journal of Neuroscience.

[7]  L. F. Abbott,et al.  Decorrelation of spike trains by synaptic depression , 1999, Neurocomputing.

[8]  Michael I. Jordan,et al.  A more biologically plausible learning rule for neural networks. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Frank C. Hoppensteadt,et al.  Bursts as a unit of neural information: selective communication via resonance , 2003, Trends in Neurosciences.

[10]  G. Laurent,et al.  Odour encoding by temporal sequences of firing in oscillating neural assemblies , 1996, Nature.

[11]  R. Muller,et al.  Place cell discharge is extremely variable during individual passes of the rat through the firing field. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[12]  T. Sejnowski,et al.  Heterogeneous Release Properties of Visualized Individual Hippocampal Synapses , 1997, Neuron.

[13]  C. Stevens,et al.  Heterogeneity of Release Probability, Facilitation, and Depletion at Central Synapses , 1997, Neuron.

[14]  A. Zador Impact of synaptic unreliability on the information transmitted by spiking neurons. , 1998, Journal of neurophysiology.

[15]  G. Rose,et al.  Counting on Inhibition and Rate-Dependent Excitation in the Auditory System , 2007, The Journal of Neuroscience.

[16]  Daqing Guo,et al.  Signal propagation in feedforward neuronal networks with unreliable synapses , 2011, Journal of Computational Neuroscience.

[17]  E. Todeva Networks , 2007 .

[18]  H. Seung,et al.  Learning in Spiking Neural Networks by Reinforcement of Stochastic Synaptic Transmission , 2003, Neuron.

[19]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.

[20]  V. Klyachko,et al.  Short-Term Plasticity Optimizes Synaptic Information Transmission , 2011, The Journal of Neuroscience.

[21]  Roger D. Traub,et al.  Rates and Rhythms: A Synergistic View of Frequency and Temporal Coding in Neuronal Networks , 2012, Neuron.

[22]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[23]  Wolfgang Maass,et al.  A Model for Fast Analog Computation Based on Unreliable Synapses , 2000, Neural Computation.

[24]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[25]  D. Baylor,et al.  Concerted Signaling by Retinal Ganglion Cells , 1995, Science.

[26]  Joaquín J. Torres,et al.  Maximum Memory Capacity on Neural Networks with Short-Term Synaptic Depression and Facilitation , 2009, Neural Computation.

[27]  Marwan A. Jabri,et al.  Weight perturbation: an optimal architecture and learning technique for analog VLSI feedforward and recurrent multilayer networks , 1992, IEEE Trans. Neural Networks.

[28]  R. Romo,et al.  Neuronal Population Coding of Parametric Working Memory , 2010, The Journal of Neuroscience.

[29]  B. Carlson Temporal-Pattern Recognition by Single Neurons in a Sensory Pathway Devoted to Social Communication Behavior , 2009, The Journal of Neuroscience.

[30]  Adam Kepecs,et al.  Information encoding and computation with spikes and bursts , 2003, Network.

[31]  W. Singer,et al.  Long-range synchronization of oscillatory light responses in the cat retina and lateral geniculate nucleus , 1996, Nature.

[32]  Pan-Yue Deng,et al.  The diverse functions of short-term plasticity components in synaptic computations , 2011 .

[33]  J. Lisman Bursts as a unit of neural information: making unreliable synapses reliable , 1997, Trends in Neurosciences.

[34]  Wolfgang Maass,et al.  Dynamic Stochastic Synapses as Computational Units , 1997, Neural Computation.

[35]  C. Stevens,et al.  Excitatory and Feed-Forward Inhibitory Hippocampal Synapses Work Synergistically as an Adaptive Filter of Natural Spike Trains , 2006, PLoS biology.

[36]  Lav R. Varshney,et al.  Optimal Information Storage in Noisy Synapses under Resource Constraints , 2006, Neuron.

[37]  John O'Keefe,et al.  Independent rate and temporal coding in hippocampal pyramidal cells , 2003, Nature.

[38]  L. Abbott,et al.  Synaptic computation , 2004, Nature.

[39]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[40]  K. P. Unnikrishnan,et al.  Alopex: A Correlation-Based Learning Algorithm for Feedforward and Recurrent Neural Networks , 1994, Neural Computation.

[41]  B. Doiron,et al.  Interval coding. I. Burst interspike intervals as indicators of stimulus intensity. , 2007, Journal of neurophysiology.

[42]  Christof Koch,et al.  The Impact of Spike Timing Variability on the Signal-Encoding Performance of Neural Spiking Models , 2002, Neural Computation.

[43]  C. Stevens,et al.  The Role of Presynaptic Dynamics in Processing of Natural Spike Trains in Hippocampal Synapses , 2010, The Journal of Neuroscience.

[44]  R. Christopher deCharms,et al.  Primary cortical representation of sounds by the coordination of action-potential timing , 1996, Nature.

[45]  D. Buonomano,et al.  A Novel Learning Rule for Long-Term Plasticity of Short-Term Synaptic Plasticity Enhances Temporal Processing , 2011, Front. Integr. Neurosci..