The nucleus accumbens and inhibition in the ventral tegmental area play a causal role in the Kamin blocking effect

The discovery of Kamin blocking led to the idea that associative learning occurs only when there is a mismatch between actual and predicted outcomes, or prediction error. The neural substrates involved in regulating this prediction error during behavioral learning are still not fully elucidated. We investigated in rats the role of the ventral tegmental area and the nucleus accumbens in Kamin blocking. Our blocking paradigm involved three phases: appetitive classical conditioning of a lever cue, conditioning of a compound of the lever cue plus an auditory cue, and testing response to the auditory cue in extinction. We found that disruption of inhibition in the ventral tegmental area by bicuculline, or designer receptor mediated inactivation of the nucleus accumbens, during compound cue conditioning, attenuated Kamin blocking. These results suggest that inhibition in the ventral tegmental area and inhibitory output from the nucleus accumbens are necessary for blocking and make behaviorally significant contributions to the computation of reward prediction error. In addition, we found that inactivating the neurons in the nucleus accumbens during classical conditioning of the lever cue also attenuated blocking, without affecting classical conditioning of the lever. This indicates that learning in the nucleus accumbens is necessary for blocking and reward estimation. Our results reveal a causal role for nucleus accumbens modulated inhibitory inputs to the ventral tegmental area in the blocking effect and suggest that they contribute to computation of reward prediction error during associative learning.

[1]  L. Kamin Predictability, surprise, attention, and conditioning , 1967 .

[2]  P. Bronstein,et al.  The development of habituation in the rat , 1974 .

[3]  G. Davey,et al.  Autoshaping in the rat: Effects of omission on the form of the response. , 1981, Journal of the experimental analysis of behavior.

[4]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[5]  Timothy H. Hand,et al.  Differential effects of acute clozapine and haloperidol on the activity of ventral tegmental (A10) and nigrostriatal (A9) dopamine neurons , 1987, Brain Research.

[6]  C. Gerfen,et al.  The neostriatal mosaic: II. Patch- and matrix-directed mesostriatal dopaminergic and non-dopaminergic systems , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  D. S. Zahm,et al.  The patterns of afferent innervation of the core and shell in the “Accumbens” part of the rat ventral striatum: Immunohistochemical detection of retrogradely transported fluoro‐gold , 1993, The Journal of comparative neurology.

[8]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[9]  J. Rawlins,et al.  Differential involvement of the shell and core subterritories of the nucleus accumbens in latent inhibition and amphetamine-induced activity , 1996, Behavioural Brain Research.

[10]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[11]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[12]  Joshua W. Brown,et al.  How the Basal Ganglia Use Parallel Excitatory and Inhibitory Learning Pathways to Selectively Respond to Unexpected Rewarding Cues , 1999, The Journal of Neuroscience.

[13]  M. Diana,et al.  Clozapine potently stimulates mesocortical dopamine neurons. , 1999, European journal of pharmacology.

[14]  J. Tepper,et al.  Gabaergic control of rat substantia nigra dopaminergic neurons: role of globus pallidus and substantia nigra pars reticulata , 1999, Neuroscience.

[15]  H. Groenewegen,et al.  Convergence and Segregation of Ventral Striatal Inputs and Outputs , 1999, Annals of the New York Academy of Sciences.

[16]  J. Wickens,et al.  A cellular mechanism of reward-related learning , 2001, Nature.

[17]  B. Balleine,et al.  The Role of the Nucleus Accumbens in Instrumental Conditioning: Evidence of a Functional Dissociation between Accumbens Core and Shell , 2001, The Journal of Neuroscience.

[18]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[19]  B. Everitt,et al.  Dissociable Effects of Antagonism of NMDA and AMPA/KA Receptors in the Nucleus Accumbens Core and Shell on Cocaine-seeking Behavior , 2001, Neuropsychopharmacology.

[20]  T. Robbins,et al.  Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function , 2002, Behavioural Brain Research.

[21]  J. Feldon,et al.  A differential involvement of the shell and core subterritories of the nucleus accumbens of rats in attentional processes , 2002, Neuroscience.

[22]  A differential involvement of the shell and core subterritories of the nucleus accumbens of rats in memory processes. , 2003, Behavioral neuroscience.

[23]  V. Gurevich,et al.  The Nature of the Arrestin·Receptor Complex Determines the Ultimate Fate of the Internalized Receptor* , 2003, The Journal of Biological Chemistry.

[24]  S. Erhardt,et al.  Inhibitory Action of Clozapine on Rat Ventral Tegmental Area Dopamine Neurons Following Increased Levels of Endogenous Kynurenic Acid , 2003, Neuropsychopharmacology.

[25]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[26]  I. Weiner,et al.  Abnormally Persistent Latent Inhibition Induced by Lesions to the Nucleus Accumbens Core, Basolateral Amygdala and Orbitofrontal Cortex Is Reversed by Clozapine but Not by Haloperidol , 2022 .

[27]  Ralph R. Miller,et al.  Sometimes-competing retrieval (SOCR): a formalization of the comparator hypothesis. , 2007, Psychological review.

[28]  S. Ikemoto Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex , 2007, Brain Research Reviews.

[29]  R. Wightman,et al.  Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens , 2007, Nature Neuroscience.

[30]  A. Grace,et al.  Regulation of firing of dopaminergic neurons and control of goal-directed behaviors , 2007, Trends in Neurosciences.

[31]  B. Roth,et al.  Evolving the lock to fit the key to create a family of G protein-coupled receptors potently activated by an inert ligand , 2007, Proceedings of the National Academy of Sciences.

[32]  R. Wightman,et al.  Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation , 2008, Proceedings of the National Academy of Sciences.

[33]  Simon Hong,et al.  The Globus Pallidus Sends Reward-Related Signals to the Lateral Habenula , 2008, Neuron.

[34]  T. Robbins,et al.  Differential Effects of Nucleus Accumbens Core, Shell, or Dorsal Striatal Inactivations on the Persistence, Reacquisition, or Reinstatement of Responding for a Drug-Paired Conditioned Reinforcer , 2008, Neuropsychopharmacology.

[35]  A. Blaisdell,et al.  Rats Distinguish Between Absence of Events and Lack of Information in Sensory Preconditioning , 2009 .

[36]  Mark G. Baxter,et al.  The Rostromedial Tegmental Nucleus (RMTg), a GABAergic Afferent to Midbrain Dopamine Neurons, Encodes Aversive Stimuli and Inhibits Motor Responses , 2009, Neuron.

[37]  Ethan S. Bromberg-Martin,et al.  Distinct Tonic and Phasic Anticipatory Activity in Lateral Habenula and Dopamine Neurons , 2010, Neuron.

[38]  B. Balleine,et al.  At the limbic–motor interface: disconnection of basolateral amygdala from nucleus accumbens core and shell reveals dissociable components of incentive motivation , 2010, The European journal of neuroscience.

[39]  Ethan S. Bromberg-Martin,et al.  Multiple Timescales of Memory in Lateral Habenula and Dopamine Neurons , 2010, Neuron.

[40]  Elyssa B. Margolis,et al.  Nucleus Accumbens Medium Spiny Neurons Target Non-Dopaminergic Neurons in the Ventral Tegmental Area , 2011, The Journal of Neuroscience.

[41]  B. Balleine,et al.  The General and Outcome-Specific Forms of Pavlovian-Instrumental Transfer Are Differentially Mediated by the Nucleus Accumbens Core and Shell , 2011, The Journal of Neuroscience.

[42]  Anne E Carpenter,et al.  Neuron-type specific signals for reward and punishment in the ventral tegmental area , 2011, Nature.

[43]  J. Wickens,et al.  Neural control of dopamine neurotransmission: implications for reinforcement learning , 2012, The European journal of neuroscience.

[44]  Kelly R. Tan,et al.  GABA Neurons of the VTA Drive Conditioned Place Aversion , 2012, Neuron.

[45]  Simon Hong,et al.  Braking Dopamine Systems: A New GABA Master Structure for Mesolimbic and Nigrostriatal Functions , 2012, The Journal of Neuroscience.

[46]  Sachie K. Ogawa,et al.  Whole-Brain Mapping of Direct Inputs to Midbrain Dopamine Neurons , 2012, Neuron.

[47]  Kelly R. Tan,et al.  Cocaine Disinhibits Dopamine Neurons by Potentiation of GABA Transmission in the Ventral Tegmental Area , 2013, Science.

[48]  Josiah R. Boivin,et al.  A Causal Link Between Prediction Errors, Dopamine Neurons and Learning , 2013, Nature Neuroscience.

[49]  Anirvan Ghosh,et al.  Chemogenetic Synaptic Silencing of Neural Circuits Localizes a Hypothalamus→Midbrain Pathway for Feeding Behavior , 2014, Neuron.

[50]  Bryan L. Roth,et al.  Silencing Synapses with DREADDs , 2014, Neuron.

[51]  R. Palmiter,et al.  Dopamine dependency for acquisition and performance of Pavlovian conditioned response , 2014, Proceedings of the National Academy of Sciences.

[52]  Stefano Zucca,et al.  Role of Striatal Cholinergic Interneurons in Set-Shifting in the Rat , 2015, The Journal of Neuroscience.

[53]  Xi-Ping Huang,et al.  A New DREADD Facilitates the Multiplexed Chemogenetic Interrogation of Behavior , 2015, Neuron.

[54]  Naoshige Uchida,et al.  Arithmetic and local circuitry underlying dopamine prediction errors , 2015, Nature.

[55]  Jeremiah Y. Cohen,et al.  Distributed and Mixed Information in Monosynaptic Inputs to Dopamine Neurons , 2016, Neuron.

[56]  B. Roth DREADDs for Neuroscientists , 2016, Neuron.

[57]  Joshua L. Jones,et al.  Dopamine transients are sufficient and necessary for acquisition of model-based associations , 2017, Nature Neuroscience.

[58]  Jeffery R. Wickens,et al.  A Streamlined Method for the Preparation of Gelatin Embedded Brains and Simplified Organization of Sections for Serial Reconstructions. , 2017, Bio-protocol.

[59]  Thomas Wichmann,et al.  Metabolism and Distribution of Clozapine-N-oxide: Implications for Nonhuman Primate Chemogenetics. , 2017, ACS chemical neuroscience.

[60]  Brandon K. Harvey,et al.  Chemogenetics revealed: DREADD occupancy and activation via converted clozapine , 2017, Science.

[61]  J. Wickens,et al.  Cholinergic interneurons in the rat striatum modulate substitution of habits , 2018, The European journal of neuroscience.

[62]  S. Lammel,et al.  Nucleus Accumbens Subnuclei Regulate Motivated Behavior via Direct Inhibition and Disinhibition of VTA Dopamine Subpopulations , 2018, Neuron.

[63]  M. Farrell,et al.  The DREADD agonist clozapine N-oxide (CNO) is reverse-metabolized to clozapine and produces clozapine-like interoceptive stimulus effects in rats and mice , 2018, Scientific Reports.

[64]  T. Jhou,et al.  Three Rostromedial Tegmental Afferents Drive Triply Dissociable Aspects of Punishment Learning and Aversive Valence Encoding , 2019, Neuron.

[65]  Elyssa B. Margolis,et al.  Relative contributions and mapping of ventral tegmental area dopamine and GABA neurons by projection target in the rat , 2018, The Journal of comparative neurology.