Intact discrimination reversal learning but slowed responding to reward-predictive cues after dopamine D1 and D2 receptor blockade in the nucleus accumbens of rats

RationaleThe prediction error hypothesis of dopamine action states that dopamine signals are necessary for the brain to update the predictive significance of cues. Yet, little is known whether D1 or D2 receptor-mediated signals in the nucleus accumbens core (AcbC) are required to learn a reversal of the predictive significance of cues.ObjectiveHere we examined the effects of a selective D1 or D2 receptor blockade in the AcbC on learning a reversal of previously acquired cue–reward magnitude contingencies.Materials and methodsRats were trained on a reaction time (RT) task demanding conditioned lever release with discriminative visual cues signalling in advance the upcoming reward magnitude (one or five food pellets). After acquisition, RTs were guided by cue-associated reward magnitudes, i.e. RTs of responses were significantly shorter for expected high vs low reward. Thereafter, cue–reward magnitude contingencies were reversed. Reversal learning was tested for 12 daily sessions with intra-AcbC micro-infusions being given on sessions 1–6. Subjects received pre-trial infusions of the selective D1 or D2 receptor antagonists, SCH23390 (0.5, 2 μg per side) or raclopride (1, 4 μg per side), or vehicle (0.5 μl).ResultsIntra-AcbC infusion of SCH23390 (0.5, 2 μg) or raclopride (1, 4 μg) did not inhibit discrimination reversal learning, but the higher dose of each drug increased RTs of instrumental responses.ConclusionsIn a visual discrimination task as used here, D1 and D2 receptor-mediated signals in the AcbC seem to be unnecessary in updating the reward-predictive significance of cues, rather, they serve to activate instrumental behaviour.

[1]  W. G. Cochran,et al.  Experimental Designs Second Edition , 1958 .

[2]  P. Holland,et al.  Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning. , 1979, Journal of experimental psychology. Animal behavior processes.

[3]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[4]  G. Koob,et al.  Depletion of dopamine in the caudate nucleus but not in nucleus accumbens impairs reaction-time performance in rats , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  R. Rescorla,et al.  Associations between the discriminative stimulus and the reinforcer in instrumental learning. , 1988 .

[6]  H. Simon,et al.  Limbic System, Basal Ganglia, and Dopaminergic Neurons , 1989 .

[7]  M. Le Moal,et al.  Limbic system, basal ganglia, and dopaminergic neurons. Executive and regulatory neurons and their role in the organization of behavior. , 1989, Brain, behavior and evolution.

[8]  T. Robbins,et al.  The effects of ibotenic acid lesions of the nucleus accumbens on spatial learning and extinction in the rat , 1989, Behavioural Brain Research.

[9]  Trevor W. Robbins,et al.  Effects of 6-hydroxydopamine lesions of the nucleus accumbens septi on performance of a 5-choice serial reaction time task in rats: Implications for theories of selective attention and arousal , 1989, Behavioural Brain Research.

[10]  Robert A. Rescorla,et al.  Effect of reinforcer devaluation on discriminative control of instrumental behavior. , 1990, Journal of experimental psychology. Animal behavior processes.

[11]  T. Robbins,et al.  Effects of dopamine depletion from the caudate-putamen and nucleus accumbens septi on the acquisition and performance of a conditional discrimination task , 1990, Behavioural Brain Research.

[12]  Richard S. Sutton,et al.  Time-Derivative Models of Pavlovian Reinforcement , 1990 .

[13]  M. Gabriel,et al.  Learning and Computational Neuroscience: Foundations of Adaptive Networks , 1990 .

[14]  M. Martres,et al.  Pharmacology of human dopamine D3 receptor expressed in a mammalian cell line: comparison with D2 receptor. , 1992, European journal of pharmacology.

[15]  J. Salamone The involvement of nucleus accumbens dopamine in appetitive and aversive motivation , 1994, Behavioural Brain Research.

[16]  B. Balleine,et al.  Effects of ibotenic acid lesions of the Nucleus Accumbens on instrumental action , 1994, Behavioural Brain Research.

[17]  V J Brown,et al.  Discriminative Cues Indicating Reward Magnitude Continue to Determine Reaction Time of Rats Following Lesions of the Nucleus Accumbens , 1995, The European journal of neuroscience.

[18]  T. Robbins,et al.  Unilateral Lesions of the Dorsal Striatum in Rats Disrupt Responding in Egocentric Space , 1997, The Journal of Neuroscience.

[19]  J. Hollerman,et al.  Influence of reward expectation on behavior-related neuronal activity in primate striatum. , 1998, Journal of neurophysiology.

[20]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[21]  G. Chiara,et al.  Differential responsiveness of dopamine transmission to food-stimuli in nucleus accumbens shell/core compartments , 1999, Neuroscience.

[22]  J. Salamone,et al.  Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement , 1999, Neuroscience.

[23]  P. Janak,et al.  Mesolimbic Neuronal Activity across Behavioral States , 1999, Annals of the New York Academy of Sciences.

[24]  J. Mirenowicz,et al.  Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. , 2000, Behavioral neuroscience.

[25]  R. Carelli,et al.  Evidence That Separate Neural Circuits in the Nucleus Accumbens Encode Cocaine Versus “Natural” (Water and Food) Reward , 2000, The Journal of Neuroscience.

[26]  J. Price,et al.  Effects of excitotoxic lesions in the ventral striatopallidal–thalamocortical pathway on odor reversal learning: inability to extinguish an incorrect response , 2000, Experimental Brain Research.

[27]  B. Everitt,et al.  Limbic cortical-ventral striatal systems underlying appetitive conditioning. , 2000, Progress in brain research.

[28]  B. Knowlton,et al.  Effects of US devaluation on win-stay and win-shift radial maze performance in rats. , 2000, Behavioral neuroscience.

[29]  M. Laubach,et al.  Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task , 2022 .

[30]  T. Robbins,et al.  Dissociation in Conditioned Dopamine Release in the Nucleus Accumbens Core and Shell in Response to Cocaine Cues and during Cocaine-Seeking Behavior in Rats , 2000, The Journal of Neuroscience.

[31]  K. Berridge,et al.  Intra-Accumbens Amphetamine Increases the Conditioned Incentive Salience of Sucrose Reward: Enhancement of Reward “Wanting” without Enhanced “Liking” or Response Reinforcement , 2000, The Journal of Neuroscience.

[32]  D. S. Zahm,et al.  An integrative neuroanatomical perspective on some subcortical substrates of adaptive responding with emphasis on the nucleus accumbens , 2000, Neuroscience & Biobehavioral Reviews.

[33]  W. Hauber,et al.  Nmda, but Not Dopamine D 2 , Receptors in the Rat Nucleus Accumbens Are Involved in Guidance of Instrumental Behavior by Stimuli Predicting Reward Magnitude , 2022 .

[34]  A. Dickinson,et al.  Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour , 2001, The European journal of neuroscience.

[35]  B. Balleine,et al.  The Role of the Nucleus Accumbens in Instrumental Conditioning: Evidence of a Functional Dissociation between Accumbens Core and Shell , 2001, The Journal of Neuroscience.

[36]  B. Everitt,et al.  Dissociable Effects of Antagonism of NMDA and AMPA/KA Receptors in the Nucleus Accumbens Core and Shell on Cocaine-seeking Behavior , 2001, Neuropsychopharmacology.

[37]  J. Salamone,et al.  D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption , 2001, Pharmacology Biochemistry and Behavior.

[38]  Wolfram Schultz,et al.  Behavioral reactions reflecting differential reward expectations in monkeys , 2001, Experimental Brain Research.

[39]  J. Salamone,et al.  Nucleus accumbens dopamine and work requirements on interval schedules , 2002, Behavioural Brain Research.

[40]  B. Everitt,et al.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex , 2002, Neuroscience & Biobehavioral Reviews.

[41]  J. N. P. Rawlins,et al.  Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats , 2002, Experimental Brain Research.

[42]  W. Hauber,et al.  NMDA receptors in the rat orbital prefrontal cortex are involved in guidance of instrumental behaviour under reversal conditions. , 2003, Cerebral cortex.

[43]  Samuel M. McClure,et al.  A computational substrate for incentive salience , 2003, Trends in Neurosciences.

[44]  John O'Doherty,et al.  Can't Learn without You Predictive Value Coding in Orbitofrontal Cortex Requires the Basolateral Amygdala , 2003, Neuron.

[45]  Wolfgang Hauber,et al.  The rat nucleus accumbens is involved in guiding of instrumental responses by stimuli predicting reward magnitude , 2003, The European journal of neuroscience.

[46]  G. Schoenbaum,et al.  Lesions of Nucleus Accumbens Disrupt Learning about Aversive Outcomes , 2003, The Journal of Neuroscience.

[47]  G. Schoenbaum,et al.  Neural Encoding in Ventral Striatum during Olfactory Discrimination Learning , 2003, Neuron.

[48]  J. Hollerman,et al.  Changes in behavior-related neuronal activity in the striatum during learning , 2003, Trends in Neurosciences.

[49]  S. Nicola,et al.  Dissociation of the role of nucleus accumbens dopamine in responding to reward-predictive cues and waiting for reward , 2004, Behavioural Brain Research.

[50]  S. Nicola,et al.  Contrasting effects of dopamine and glutamate receptor antagonist injection in the nucleus accumbens suggest a neural mechanism underlying cue‐evoked goal‐directed behavior , 2004, The European journal of neuroscience.

[51]  R. Wightman,et al.  Dopamine Operates as a Subsecond Modulator of Food Seeking , 2004, The Journal of Neuroscience.

[52]  J. Salamone,et al.  Accumbens dopamine and the regulation of effort in food-seeking behavior: modulation of work output by different ratio or force requirements , 2004, Behavioural Brain Research.

[53]  S. Nicola,et al.  The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues , 2004, The Journal of Neuroscience.

[54]  T. Robbins Chemistry of the mind: Neurochemical modulation of prefrontal cortical function , 2005, The Journal of comparative neurology.

[55]  W. Pan,et al.  Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network , 2005, The Journal of Neuroscience.

[56]  A. Kelley,et al.  Corticostriatal-hypothalamic circuitry and food motivation: Integration of energy, action and reward , 2005, Physiology & Behavior.

[57]  G. Glover,et al.  The Role of Ventral Frontostriatal Circuitry in Reward-Based Learning in Humans , 2005, The Journal of Neuroscience.

[58]  W. Hauber,et al.  Involvement of NMDA and AMPA/KA receptors in the nucleus accumbens core in instrumental learning guided by reward‐predictive cues , 2005, The European journal of neuroscience.

[59]  J. Salamone,et al.  Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. , 2005, Current opinion in pharmacology.

[60]  W. Hauber,et al.  Effects of a systemic AMPA/KA and NMDA receptor blockade on pavlovian–instrumental transfer , 2005, Psychopharmacology.

[61]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[62]  S. W. Kim,et al.  Nucleus accumbens dopamine release is necessary and sufficient to promote the behavioral response to reward-predictive cues , 2005, Neuroscience.

[63]  A. Kelley,et al.  AMPA/kainate, NMDA, and dopamine D1 receptor function in the nucleus accumbens core: a context-limited role in the encoding and consolidation of instrumental memory. , 2005, Learning & memory.

[64]  J. O'Doherty,et al.  Predictive Neural Coding of Reward Preference Involves Dissociable Responses in Human Ventral Midbrain and Ventral Striatum , 2006, Neuron.

[65]  W. Schultz Behavioral theories and the neurophysiology of reward. , 2006, Annual review of psychology.