Spiking neurons, dopamine, and plasticity: Timing is everything, but concentration also matters

While both dopamine (DA) fluctuations and spike‐timing‐dependent plasticity (STDP) are known to influence long‐term corticostriatal plasticity, little attention has been devoted to the interaction between these two fundamental mechanisms. Here, a theoretical framework is proposed to account for experimental results specifying the role of presynaptic activation, postsynaptic activation, and concentrations of extracellular DA in synaptic plasticity. Our starting point was an explicitly‐implemented multiplicative rule linking STDP to Michaelis‐Menton equations that models the dynamics of extracellular DA fluctuations. This rule captures a wide range of results on conditions leading to long‐term potentiation and depression in simulations that manipulate the frequency of induced corticostriatal stimulation and DA release. A well‐documented biphasic function relating DA concentrations to synaptic plasticity emerges naturally from simulations involving a multiplicative rule linking DA and neural activity. This biphasic function is found consistently across different neural coding schemes employed (voltage‐based vs. spike‐based models). By comparison, an additive rule fails to capture these results. The proposed framework is the first to generate testable predictions on the dual influence of DA concentrations and STDP on long‐term plasticity, suggesting a way in which the biphasic influence of DA concentrations can modulate the direction and magnitude of change induced by STDP, and raising the possibility that DA concentrations may inverse the LTP/LTD components of the STDP rule. Synapse 61:375‐390, 2007. © 2007 Wiley‐Liss, Inc.

[1]  S. Snyder,et al.  Kinetics of serotonin accumulation into slices from rat brain: relationship to catecholamine uptake. , 1970, The Journal of pharmacology and experimental therapeutics.

[2]  J. D. Miller,et al.  Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat. , 1981, Life sciences.

[3]  Swee Lay Thein,et al.  Hypervariable ‘minisatellite’ regions in human DNA , 1985, Nature.

[4]  S. Kish,et al.  Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. , 1988, The New England journal of medicine.

[5]  P. Calabresi,et al.  Long-term synaptic depression in the striatum: physiological and pharmacological characterization , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  D. Lovinger,et al.  Short- and long-term synaptic depression in rat neostriatum. , 1993, Journal of neurophysiology.

[7]  J. Walsh Depression of excitatory synaptic input in rat striatal neurons , 1993, Brain Research.

[8]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[9]  D. Debanne,et al.  Asynchronous pre- and postsynaptic activity induces associative long-term depression in area CA1 of the rat hippocampus in vitro. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[10]  P. Calabresi,et al.  Transmitter Release Associated with Long‐term Synaptic Depression in Rat Corticostriatal Slices , 1995, The European journal of neuroscience.

[11]  C. Nicholson Interaction between diffusion and Michaelis-Menten uptake of dopamine after iontophoresis in striatum. , 1995, Biophysical journal.

[12]  J. Wickens,et al.  Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex In vitro , 1996, Neuroscience.

[13]  V. Han,et al.  Synaptic plasticity in a cerebellum-like structure depends on temporal order , 1997, Nature.

[14]  D. Lovinger,et al.  Decreased probability of neurotransmitter release underlies striatal long-term depression and postnatal development of corticostriatal synapses. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[15]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[16]  D. Johnston,et al.  A Synaptically Controlled, Associative Signal for Hebbian Plasticity in Hippocampal Neurons , 1997, Science.

[17]  S. Charpier,et al.  In vivo activity-dependent plasticity at cortico-striatal connections: evidence for physiological long-term potentiation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[18]  W. Schultz Predictive reward signal of dopamine neurons. , 1998, Journal of neurophysiology.

[19]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[20]  Li I. Zhang,et al.  A critical window for cooperation and competition among developing retinotectal synapses , 1998, Nature.

[21]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[22]  D. Debanne,et al.  Long‐term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures , 1998, The Journal of physiology.

[23]  W. Schultz,et al.  A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task , 1999, Neuroscience.

[24]  Joshua W. Brown,et al.  How the Basal Ganglia Use Parallel Excitatory and Inhibitory Learning Pathways to Selectively Respond to Unexpected Rewarding Cues , 1999, The Journal of Neuroscience.

[25]  J. Walsh,et al.  Modulation of long-term synaptic plasticity at excitatory striatal synapses , 1999, Neuroscience.

[26]  P. Calabresi,et al.  Glutamate-Triggered Events Inducing Corticostriatal Long-Term Depression , 1999, The Journal of Neuroscience.

[27]  B. Sakmann,et al.  Coincidence detection and changes of synaptic efficacy in spiny stellate neurons in rat barrel cortex , 1999, Nature Neuroscience.

[28]  P. Calabresi,et al.  Unilateral dopamine denervation blocks corticostriatal LTP. , 1999, Journal of neurophysiology.

[29]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[30]  G. Akopian,et al.  Functional state of corticostriatal synapses determines their expression of short‐ and long‐term plasticity , 2000, Synapse.

[31]  J. Spencer,et al.  Bi-directional changes in synaptic plasticity induced at corticostriatal synapses in vitro , 2000, Experimental Brain Research.

[32]  S. Wang,et al.  Coincidence detection in single dendritic spines mediated by calcium release , 2000, Nature Neuroscience.

[33]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[34]  John G. Taylor,et al.  A neural model of working memory processes in normal subjects, Parkinson's disease and schizophrenia for fMRI design and predictions , 2000, Neural Networks.

[35]  J. Partridge,et al.  Regional and postnatal heterogeneity of activity-dependent long-term changes in synaptic efficacy in the dorsal striatum. , 2000, Journal of neurophysiology.

[36]  J. Wickens,et al.  Substantia nigra dopamine regulates synaptic plasticity and membrane potential fluctuations in the rat neostriatum, in vivo , 2000, Neuroscience.

[37]  Henry Markram,et al.  An Algorithm for Modifying Neurotransmitter Release Probability Based on Pre- and Postsynaptic Spike Timing , 2001, Neural Computation.

[38]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[39]  J. Wickens,et al.  Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. , 2001, Journal of neurophysiology.

[40]  J. Wickens,et al.  A cellular mechanism of reward-related learning , 2001, Nature.

[41]  K. Tang,et al.  Dopamine-dependent synaptic plasticity in striatum during in vivo development. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Rajesh P. N. Rao,et al.  Spike-Timing-Dependent Hebbian Plasticity as Temporal Difference Learning , 2001, Neural Computation.

[43]  P. Calabresi,et al.  Selective involvement of mGlu1 receptors in corticostriatal LTD , 2001, Neuropharmacology.

[44]  C. Nicholson,et al.  Amphetamine Distorts Stimulation-Dependent Dopamine Overflow: Effects on D2 Autoreceptors, Transporters, and Synaptic Vesicle Stores , 2001, The Journal of Neuroscience.

[45]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[46]  P. Olshausen,et al.  Modelling constant potential amperometry for investigations of dopaminergic neurotransmission kinetics in vivo , 2001, Journal of Neuroscience Methods.

[47]  Charles Nicholson,et al.  Diffusion and related transport mechanisms in brain tissue , 2001 .

[48]  G. Bi,et al.  Temporal asymmetry in spike timing-dependent synaptic plasticity , 2002, Physiology & Behavior.

[49]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[50]  K. Holthoff,et al.  A problem with Hebb and local spikes , 2002, Trends in Neurosciences.

[51]  John N. J. Reynolds,et al.  Dopamine-dependent plasticity of corticostriatal synapses , 2002, Neural Networks.

[52]  Y. Dan,et al.  Spike-timing-dependent synaptic modification induced by natural spike trains , 2002, Nature.

[53]  U. Karmarkar,et al.  A model of spike-timing dependent plasticity: one or two coincidence detectors? , 2002, Journal of neurophysiology.

[54]  Hui Zhang,et al.  Real‐time decoding of dopamine concentration changes in the caudate–putamen during tonic and phasic firing , 2003 .

[55]  Ali Charara,et al.  Electrophysiological Interactions between Striatal Glutamatergic and Dopaminergic Systems , 2003, Annals of the New York Academy of Sciences.

[56]  Charles R. Yang,et al.  Dopamine D1/D5 Receptor Modulates State-Dependent Switching of Soma-Dendritic Ca2+ Potentials via Differential Protein Kinase A and C Activation in Rat Prefrontal Cortical Neurons , 2004, The Journal of Neuroscience.

[57]  Xiaohui Xie,et al.  Learning in neural networks by reinforcement of irregular spiking. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[58]  P. Montague,et al.  Dynamic Gain Control of Dopamine Delivery in Freely Moving Animals , 2004, The Journal of Neuroscience.

[59]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[60]  Clifton C. Rumsey,et al.  Equalization of synaptic efficacy by activity- and timing-dependent synaptic plasticity. , 2004, Journal of neurophysiology.

[61]  J. Wickens,et al.  Computational models of the basal ganglia: from robots to membranes , 2004, Trends in Neurosciences.

[62]  Patrick D. Roberts,et al.  Computational Consequences of Temporally Asymmetric Learning Rules: I. Differential Hebbian Learning , 1999, Journal of Computational Neuroscience.

[63]  Y. Dan,et al.  Spike Timing-Dependent Plasticity of Neural Circuits , 2004, Neuron.

[64]  Jean-Michel Deniau,et al.  Corticostriatal plasticity: life after the depression , 2004, Trends in Neurosciences.

[65]  L. Trussell,et al.  Cell-specific, spike timing–dependent plasticities in the dorsal cochlear nucleus , 2004, Nature Neuroscience.

[66]  Robert A. Legenstein,et al.  What Can a Neuron Learn with Spike-Timing-Dependent Plasticity? , 2005, Neural Computation.

[67]  Christopher C Lapish,et al.  Mesocortical Dopamine Neurons Operate in Distinct Temporal Domains Using Multimodal Signaling , 2005, The Journal of Neuroscience.

[68]  Y. Dan,et al.  Spike-timing-dependent synaptic plasticity depends on dendritic location , 2005, Nature.

[69]  F. Gregory Ashby,et al.  FROST: A Distributed Neurocomputational Model of Working Memory Maintenance , 2005, Journal of Cognitive Neuroscience.

[70]  Florentin Wörgötter,et al.  Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms , 2005, Neural Computation.

[71]  G. Bi,et al.  Timing in synaptic plasticity: from detection to integration , 2005, Trends in Neurosciences.

[72]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[73]  J. Glowinski,et al.  Bidirectional Activity-Dependent Plasticity at Corticostriatal Synapses , 2005, The Journal of Neuroscience.

[74]  Tim P Vogels,et al.  Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons , 2005, The Journal of Neuroscience.

[75]  Jean-Pascal Pfister,et al.  Optimal Spike-Timing-Dependent Plasticity for Precise Action Potential Firing in Supervised Learning , 2005, Neural Computation.

[76]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.