Modulation of striatal single units by expected reward: a spiny neuron model displaying dopamine-induced bistability.

Single-unit activity in the neostriatum of awake monkeys shows a marked dependence on expected reward. Responses to visual cues differ when animals expect primary reinforcements, such as juice rewards, in comparison to secondary reinforcements, such as tones. The mechanism of this reward-dependent modulation has not been established experimentally. To assess the hypothesis that direct neuromodulatory effects of dopamine on spiny neurons can account for this modulation, we develop a computational model based on simplified representations of key ionic currents and their modulation by D1 dopamine receptor activation. This minimal model can be analyzed in detail. We find that D1-mediated increases of inward rectifying potassium and L-type calcium currents cause a bifurcation: the native up/down state behavior of the spiny neuron model becomes truly bistable, which modulates the peak firing rate and the duration of the up state and introduces a dependence of the response on the past state history. These generic consequences of dopamine neuromodulation through bistability can account for both reward-dependent enhancement and suppression of spiny neuron single-unit responses to visual cues. We validate the model by simulating responses to visual targets in a memory-guided saccade task; our results are in close agreement with the main features of the experimental data. Our model provides a conceptual framework for understanding the functional significance of the short-term neuromodulatory actions of dopamine on signal processing in the striatum.

[1]  T. Powell,et al.  The cortico-striate projection in the monkey. , 1970, Brain : a journal of neurology.

[2]  M. Sugimori,et al.  Monosynaptic inputs to caudate neurons identified by intracellular injection of horseradish peroxidase , 1976, Brain Research.

[3]  Charles J. Wilson,et al.  Spontaneous firing patterns of identified spiny neurons in the rat neostriatum , 1981, Brain Research.

[4]  B. Hille Ionic channels of excitable membranes , 2001 .

[5]  Hypothesis for the etiology of schizophrenia: a genetic perspective. , 1984, Psychopharmacology bulletin.

[6]  P. Goldman-Rakic,et al.  Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[8]  P S Goldman-Rakic,et al.  Circuitry of the frontal association cortex and its relevance to dementia. , 1987, Archives of gerontology and geriatrics.

[9]  Akinori Akaike,et al.  Excitatory and inhibitory effects of dopamine on neuronal activity of the caudate nucleus neurons in vitro , 1987, Brain Research.

[10]  P. Calabresi,et al.  Intracellular studies on the dopamine-induced firing inhibition of neostriatal neurons in vitro: Evidence for D1 receptor involvement , 1987, Neuroscience.

[11]  X.-T. Hu,et al.  Comparison of effects of D-1 and D-2 dopamine receptor agonists on neurons in the rat caudate putamen: an electrophysiological study , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  G. Ermentrout,et al.  Analysis of neural excitability and oscillations , 1989 .

[13]  E. Richfield,et al.  Anatomical and affinity state comparisons between dopamine D1 and D2 receptors in the rat central nervous system , 1989, Neuroscience.

[14]  J. Millar,et al.  Concentration-dependent actions of stimulated dopamine release on neuronal activity in rat striatum , 1990, Neuroscience.

[15]  C. Gerfen,et al.  D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. , 1990, Science.

[16]  P. Goldman-Rakic,et al.  Visuospatial coding in primate prefrontal neurons revealed by oculomotor paradigms. , 1990, Journal of neurophysiology.

[17]  J D Cohen,et al.  A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. , 1990, Science.

[18]  W. Schultz,et al.  Responses of monkey midbrain dopamine neurons during delayed alternation performance , 1991, Brain Research.

[19]  A. Grace Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia , 1991, Neuroscience.

[20]  Alessandro Stefani,et al.  Developmental regulation of a slowly-inactivating potassium conductance in rat neostriatal neurons , 1991, Neuroscience Letters.

[21]  D. Surmeier,et al.  Dopamine receptor subtypes colocalize in rat striatonigral neurons. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[22]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[23]  P. Calabresi,et al.  Long-term synaptic depression in the striatum: physiological and pharmacological characterization , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  D. Surmeier,et al.  Grafted neostriatal neurons express a late-developing transient potassium current , 1992, Neuroscience.

[25]  D. Surmeier,et al.  D1 and D2 dopamine receptor modulation of sodium and potassium currents in rat neostriatal neurons. , 1993, Progress in brain research.

[26]  Charles J. Wilson,et al.  The generation of natural firing patterns in neostriatal neurons. , 1993, Progress in brain research.

[27]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  J. Hell,et al.  Identification and differential subcellular localization of the neuronal class C and class D L-type calcium channel alpha 1 subunits , 1993, The Journal of cell biology.

[29]  J. Wickens,et al.  The corticostriatal system on computer simulation: an intermediate mechanism for sequencing of actions. , 1993, Progress in brain research.

[30]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[31]  James C. Houk,et al.  Context-dependent Activity in Primate Striatum Reflecting Past and Future Behavioral Events , 1994 .

[32]  F. Gonon,et al.  Continuousin vivo monitoring of evoked dopamine release in the rat nucleus accumbens by amperometry , 1994, Neuroscience.

[33]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[34]  J. Bargas,et al.  Cellular and molecular characterization of Ca2+ currents in acutely isolated, adult rat neostriatal neurons , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  P. Greengard,et al.  Modulation of calcium currents by a D1 dopaminergic protein kinase/phosphatase cascade in rat neostriatal neurons , 1995, Neuron.

[36]  W. Schultz,et al.  Context-dependent activity in primate striatum reflecting past and future behavioral events. , 1995 .

[37]  A. Barto,et al.  Adaptive Critics and the Basal Ganglia , 1994 .

[38]  P. Calabresi,et al.  LONG-TERM CHANGES OF CORTICOSTRIATAL SYNAPTIC TRANSMISSION: POSSIBLE IMPLICATION FOR MOTOR MEMORY , 1995 .

[39]  G. Rebec,et al.  Iontophoresis in the neostriatum of awake, unrestrained rats: Differential effects of dopamine, glutamate and ascorbate on motor- and nonmotor-related neurons , 1995, Neuroscience.

[40]  S P Wise,et al.  Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. , 1995, Cerebral cortex.

[41]  C. Wilson,et al.  Potassium currents responsible for inward and outward rectification in rat neostriatal spiny projection neurons , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[42]  W. Schultz,et al.  Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli , 1996, Nature.

[43]  U. Ungerstedt,et al.  On the Origin of Extracellular Glutamate Levels Monitored in the Basal Ganglia of the Rat by In Vivo Microdialysis , 1996, Journal of neurochemistry.

[44]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  G. Rebec,et al.  Dopaminergic modulation of glutamate-induced excitations of neurons in the neostriatum and nucleus accumbens of awake, unrestrained rats. , 1996, Journal of neurophysiology.

[46]  M. Goldberg,et al.  Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. , 1996, Journal of neurophysiology.

[47]  Charles J. Wilson,et al.  The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  D. Surmeier,et al.  Isolation and characterization of a persistent potassium current in neostriatal neurons. , 1996, Journal of neurophysiology.

[49]  D. Surmeier,et al.  Coordinated Expression of Dopamine Receptors in Neostriatal Medium Spiny Neurons , 1996, The Journal of Neuroscience.

[50]  D. Surmeier,et al.  Voltage-dependent facilitation of calcium channels in rat neostriatal neurons. , 1996, Journal of neurophysiology.

[51]  Masataka Watanabe Reward expectancy in primate prefrental neurons , 1996, Nature.

[52]  J. Bargas,et al.  D1 Receptor Activation Enhances Evoked Discharge in Neostriatal Medium Spiny Neurons by Modulating an L-Type Ca2+ Conductance , 1997, The Journal of Neuroscience.

[53]  J. Fuster The Prefrontal Cortex , 1997 .

[54]  P. Strick,et al.  New concepts about the organization of basal ganglia output. , 1997, Advances in neurology.

[55]  L. Brown,et al.  Sensory and cognitive functions of the basal ganglia , 1997, Current Opinion in Neurobiology.

[56]  M. Umemiya,et al.  Dopaminergic modulation of excitatory postsynaptic currents in rat neostriatal neurons. , 1997, Journal of neurophysiology.

[57]  P. Calabresi,et al.  Synaptic plasticity and physiological interactions between dopamine and glutamate in the striatum , 1997, Neuroscience & Biobehavioral Reviews.

[58]  Charles J. Wilson,et al.  Spontaneous subthreshold membrane potential fluctuations and action potential variability of rat corticostriatal and striatal neurons in vivo. , 1997, Journal of neurophysiology.

[59]  J. Bargas,et al.  Dopamine facilitates striatal EPSPs through an L‐type Ca2+ conductance , 1997, Neuroreport.

[60]  J. Bargas,et al.  D 1 Receptor Activation Enhances Evoked Discharge in Neostriatal Medium Spiny Neurons by Modulating an L-Type Ca 2 1 Conductance , 1997 .

[61]  S. Charpier,et al.  In vivo activity-dependent plasticity at cortico-striatal connections: evidence for physiological long-term potentiation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[62]  F. Gonon Prolonged and Extrasynaptic Excitatory Action of Dopamine Mediated by D1 Receptors in the Rat Striatum In Vivo , 1997, The Journal of Neuroscience.

[63]  G. Rebec Real-time assessments of dopamine function during behavior: single-unit recording, iontophoresis, and fast-scan cyclic voltammetry in awake, unrestrained rats. , 1998, Alcoholism, clinical and experimental research.

[64]  J. Hollerman,et al.  Influence of reward expectation on behavior-related neuronal activity in primate striatum. , 1998, Journal of neurophysiology.

[65]  C. Cepeda,et al.  Dopaminergic modulation of NMDA-induced whole cell currents in neostriatal neurons in slices: contribution of calcium conductances. , 1998, Journal of neurophysiology.

[66]  Masataka Watanabe,et al.  Cognitive and Motivational Operations in Primate Prefrontal Neurons , 1998, Reviews in the neurosciences.

[67]  J. Houk,et al.  Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. , 1998, Journal of neurophysiology.

[68]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[69]  P. Mermelstein,et al.  Inwardly Rectifying Potassium (IRK) Currents Are Correlated with IRK Subunit Expression in Rat Nucleus Accumbens Medium Spiny Neurons , 1998, The Journal of Neuroscience.

[70]  Garrett E. Alexander Basal ganglia , 1998 .

[71]  P. Redgrave,et al.  Is the short-latency dopamine response too short to signal reward error? , 1999, Trends in Neurosciences.

[72]  J. Bargas,et al.  Ca2+ channels that activate Ca2+-dependent K+ currents in neostriatal neurons , 1999, Neuroscience.

[73]  G. Rebec,et al.  Striatal Neuronal Activity and Responsiveness to Dopamine and Glutamate after Selective Blockade of D1 and D2 Dopamine Receptors in Freely Moving Rats , 1999, The Journal of Neuroscience.

[74]  A. Graybiel,et al.  Role of [corrected] nigrostriatal dopamine system in learning to perform sequential motor tasks in a predictive manner. , 1999, Journal of neurophysiology.

[75]  T. Sejnowski,et al.  Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. , 2000, Journal of neurophysiology.

[76]  O. Hikosaka,et al.  Role of the basal ganglia in the control of purposive saccadic eye movements. , 2000, Physiological reviews.

[77]  J. Bargas,et al.  D2 Dopamine Receptors in Striatal Medium Spiny Neurons Reduce L-Type Ca2+ Currents and Excitability via a Novel PLCβ1–IP3–Calcineurin-Signaling Cascade , 2000, The Journal of Neuroscience.

[78]  W. Schultz,et al.  Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. , 2000, Journal of neurophysiology.

[79]  R. Malenka,et al.  Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. , 2000, Annual review of neuroscience.

[80]  P. Greengard,et al.  D(1) dopamine receptor activation reduces GABA(A) receptor currents in neostriatal neurons through a PKA/DARPP-32/PP1 signaling cascade. , 2000, Journal of neurophysiology.

[81]  F. J. White,et al.  L-type calcium channels modulate glutamate-driven bursting activity in the nucleus accumbens in vivo , 2000, Brain Research.

[82]  J. Partridge,et al.  Regional and postnatal heterogeneity of activity-dependent long-term changes in synaptic efficacy in the dorsal striatum. , 2000, Journal of neurophysiology.

[83]  J. Wickens,et al.  Substantia nigra dopamine regulates synaptic plasticity and membrane potential fluctuations in the rat neostriatum, in vivo , 2000, Neuroscience.

[84]  W. Schultz,et al.  Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. , 2001, Journal of neurophysiology.

[85]  J. Wickens,et al.  Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. , 2001, Journal of neurophysiology.

[86]  D. Surmeier,et al.  D1/D5 Dopamine Receptor Activation Differentially Modulates Rapidly Inactivating and Persistent Sodium Currents in Prefrontal Cortex Pyramidal Neurons , 2001, The Journal of Neuroscience.

[87]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[88]  T. Fukai,et al.  Two-State Membrane Potential Transitions of Striatal Spiny Neurons as Evidenced by Numerical Simulations and Electrophysiological Recordings in Awake Monkeys , 2002, The Journal of Neuroscience.

[89]  Leonard K. Kaczmarek,et al.  Protein Kinase Modulation of a Neuronal Cation Channel Requires Protein–Protein Interactions Mediated by an Src homology 3 Domain , 2002, The Journal of Neuroscience.

[90]  O. Hikosaka,et al.  Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. , 2002, Journal of neurophysiology.

[91]  P. Strick,et al.  Basal-ganglia 'projections' to the prefrontal cortex of the primate. , 2002, Cerebral cortex.

[92]  Shun-ichi Amari,et al.  Self-Organization in the Basal Ganglia with Modulation of Reinforcement Signals , 2002, Neural Computation.

[93]  K. Hikosaka,et al.  Coding and Monitoring of Motivational Context in the Primate Prefrontal Cortex , 2002, The Journal of Neuroscience.

[94]  Ling Xie,et al.  Alzheimer's β-Amyloid Peptides Compete for Insulin Binding to the Insulin Receptor , 2002, The Journal of Neuroscience.

[95]  Dominique M. Durand,et al.  Bistability Dynamics in Simulations of Neural Activity in High-Extracellular-Potassium Conditions , 2001, Journal of Computational Neuroscience.

[96]  J. Bargas,et al.  Inhibitory action of dopamine involves a subthreshold Cs+-sensitive conductance in neostriatal neurons , 1996, Experimental Brain Research.

[97]  G. L. Yuen,et al.  Bistability in cerebellar Purkinje cell dendrites modelled with high-threshold calcium and delayed-rectifier potassium channels , 1995, Biological Cybernetics.

[98]  Xiao-Jing Wang,et al.  A Model of Visuospatial Working Memory in Prefrontal Cortex: Recurrent Network and Cellular Bistability , 1998, Journal of Computational Neuroscience.

[99]  M. Ann The Basal Ganglia and Cognitive Pattern Generators , 2005 .