Tonic or Phasic Stimulation of Dopaminergic Projections to Prefrontal Cortex Causes Mice to Maintain or Deviate from Previously Learned Behavioral Strategies

Dopamine neurons in the ventral tegmental area (VTA) encode reward prediction errors and can drive reinforcement learning through their projections to striatum, but much less is known about their projections to prefrontal cortex (PFC). Here, we studied these projections and observed phasic VTA–PFC fiber photometry signals after the delivery of rewards. Next, we studied how optogenetic stimulation of these projections affects behavior using conditioned place preference and a task in which mice learn associations between cues and food rewards and then use those associations to make choices. Neither phasic nor tonic stimulation of dopaminergic VTA–PFC projections elicited place preference. Furthermore, substituting phasic VTA–PFC stimulation for food rewards was not sufficient to reinforce new cue–reward associations nor maintain previously learned ones. However, the same patterns of stimulation that failed to reinforce place preference or cue–reward associations were able to modify behavior in other ways. First, continuous tonic stimulation maintained previously learned cue–reward associations even after they ceased being valid. Second, delivering phasic stimulation either continuously or after choices not previously associated with reward induced mice to make choices that deviated from previously learned associations. In summary, despite the fact that dopaminergic VTA–PFC projections exhibit phasic increases in activity that are time locked to the delivery of rewards, phasic activation of these projections does not necessarily reinforce specific actions. Rather, dopaminergic VTA–PFC activity can control whether mice maintain or deviate from previously learned cue–reward associations. SIGNIFICANCE STATEMENT Dopaminergic inputs from ventral tegmental area (VTA) to striatum encode reward prediction errors and reinforce specific actions; however, it is currently unknown whether dopaminergic inputs to prefrontal cortex (PFC) play similar or distinct roles. Here, we used bulk Ca2+ imaging to show that unexpected rewards or reward-predicting cues elicit phasic increases in the activity of dopaminergic VTA–PFC fibers. However, in multiple behavioral paradigms, we failed to observe reinforcing effects after stimulation of these fibers. In these same experiments, we did find that tonic or phasic patterns of stimulation caused mice to maintain or deviate from previously learned cue–reward associations, respectively. Therefore, although they may exhibit similar patterns of activity, dopaminergic inputs to striatum and PFC can elicit divergent behavioral effects.

[1]  B. Bunney,et al.  Opposite modulation of cortical N-methyl-d-aspartate receptor-mediated responses by low and high concentrations of dopamine , 1999, Neuroscience.

[2]  S. Sternson,et al.  A FLEX Switch Targets Channelrhodopsin-2 to Multiple Cell Types for Imaging and Long-Range Circuit Mapping , 2008, The Journal of Neuroscience.

[3]  K. Deisseroth,et al.  Input-specific control of reward and aversion in the ventral tegmental area , 2012, Nature.

[4]  J. Huguenard,et al.  Inhibitory Interconnections Control Burst Pattern and Emergent Network Synchrony in Reticular Thalamus , 2003, The Journal of Neuroscience.

[5]  A. Grace,et al.  The control of firing pattern in nigral dopamine neurons: burst firing , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  S. Floresco,et al.  Multiple Dopamine Receptor Subtypes in the Medial Prefrontal Cortex of the Rat Regulate Set-Shifting , 2006, Neuropsychopharmacology.

[7]  A. Graybiel,et al.  Prolonged Dopamine Signalling in Striatum Signals Proximity and Value of Distant Rewards , 2013, Nature.

[8]  Steven S. Vogel,et al.  Deep brain optical measurements of cell type–specific neural activity in behaving mice , 2014, Nature Protocols.

[9]  W. Schultz Updating dopamine reward signals , 2013, Current Opinion in Neurobiology.

[10]  Raag D. Airan,et al.  Natural Neural Projection Dynamics Underlying Social Behavior , 2014, Cell.

[11]  Kuei Yuan Tseng,et al.  D 2 Dopamine Receptors Recruit a GABA Component for Their Attenuation of Excitatory Synaptic Transmission in the Adult Rat Prefrontal Cortex , 2007 .

[12]  B. Moghaddam,et al.  Rule Learning and Reward Contingency Are Associated with Dissociable Patterns of Dopamine Activation in the Rat Prefrontal Cortex, Nucleus Accumbens, and Dorsal Striatum , 2006, The Journal of Neuroscience.

[13]  Anne E Carpenter,et al.  Neuron-type specific signals for reward and punishment in the ventral tegmental area , 2011, Nature.

[14]  R. P. Sullivan,et al.  Optogenetic control of striatal dopamine release in rats , 2010, Journal of neurochemistry.

[15]  A. Grace Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia , 1991, Neuroscience.

[16]  Talia N. Lerner,et al.  Intact-Brain Analyses Reveal Distinct Information Carried by SNc Dopamine Subcircuits , 2015, Cell.

[17]  Adam G. Carter,et al.  D1 Receptor Modulation of Action Potential Firing in a Subpopulation of Layer 5 Pyramidal Neurons in the Prefrontal Cortex , 2012, The Journal of Neuroscience.

[18]  A. Grace,et al.  Intracellular and extracellular electrophysiology of nigral dopaminergic neurons—1. Identification and characterization , 1983, Neuroscience.

[19]  V. Brown,et al.  Medial Frontal Cortex Mediates Perceptual Attentional Set Shifting in the Rat , 2000, The Journal of Neuroscience.

[20]  K. Deisseroth,et al.  Parvalbumin neurons and gamma rhythms enhance cortical circuit performance , 2009, Nature.

[21]  W. Schultz Multiple dopamine functions at different time courses. , 2007, Annual review of neuroscience.

[22]  Kuei Yuan Tseng,et al.  D2 dopamine receptors recruit a GABA component for their attenuation of excitatory synaptic transmission in the adult rat prefrontal cortex , 2007, Synapse.

[23]  M. Ungless,et al.  Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli , 2009, Proceedings of the National Academy of Sciences.

[24]  Karl Deisseroth,et al.  Synaptic Activity Unmasks Dopamine D2 Receptor Modulation of a Specific Class of Layer V Pyramidal Neurons in Prefrontal Cortex , 2012, The Journal of Neuroscience.

[25]  K. Berridge The debate over dopamine’s role in reward: the case for incentive salience , 2007, Psychopharmacology.

[26]  Kuei Yuan Tseng,et al.  Dopamine modulation of prefrontal cortical interneurons changes during adolescence. , 2006, Cerebral cortex.

[27]  Renee Hoch,et al.  Gamma Rhythms Link Prefrontal Interneuron Dysfunction with Cognitive Inflexibility in Dlx5/6 +/− Mice , 2015, Neuron.

[28]  O. Garaschuk,et al.  Cortical calcium waves in resting newborn mice , 2005, Nature Neuroscience.

[29]  Vikaas S Sohal,et al.  Inhibitory coupling specifically generates emergent gamma oscillations in diverse cell types. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[30]  G. B. Bissonette,et al.  Reversal learning and attentional set-shifting in mice , 2012, Neuropharmacology.

[31]  E. Miller,et al.  The Role of Prefrontal Dopamine D1 Receptors in the Neural Mechanisms of Associative Learning , 2012, Neuron.

[32]  P. Overton,et al.  Burst firing in midbrain dopaminergic neurons , 1997, Brain Research Reviews.

[33]  J. Seamans,et al.  The principal features and mechanisms of dopamine modulation in the prefrontal cortex , 2004, Progress in Neurobiology.

[34]  W. Schultz Behavioral theories and the neurophysiology of reward. , 2006, Annual review of psychology.

[35]  J. Seamans,et al.  D1 Receptor Modulation of Hippocampal–Prefrontal Cortical Circuits Integrating Spatial Memory with Executive Functions in the Rat , 1998, The Journal of Neuroscience.

[36]  S. Floresco,et al.  Dissociable Contributions by Prefrontal D1 and D2 Receptors to Risk-Based Decision Making , 2011, The Journal of Neuroscience.

[37]  M. Poo,et al.  Phasic dopamine release in the medial prefrontal cortex enhances stimulus discrimination , 2016, Proceedings of the National Academy of Sciences.

[38]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[39]  T. Sejnowski,et al.  Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. , 2000, Journal of neurophysiology.

[40]  J. Glowinski,et al.  Effect of noxious tail pinch on the discharge rate of mesocortical and mesolimbic dopamine neurons: selective activation of the mesocortical system , 1989, Brain Research.

[41]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[42]  Ethan S. Bromberg-Martin,et al.  Dopamine in Motivational Control: Rewarding, Aversive, and Alerting , 2010, Neuron.

[43]  P. Redgrave,et al.  Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat , 2006, Neuroscience.

[44]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[45]  K. Deisseroth,et al.  Optogenetic Interrogation of Dopaminergic Modulation of the Multiple Phases of Reward-Seeking Behavior , 2011, The Journal of Neuroscience.

[46]  D. Durstewitz,et al.  The ability of the mesocortical dopamine system to operate in distinct temporal modes , 2007, Psychopharmacology.

[47]  Josiah R. Boivin,et al.  A Causal Link Between Prediction Errors, Dopamine Neurons and Learning , 2013, Nature Neuroscience.

[48]  D. Durstewitz,et al.  The Dual-State Theory of Prefrontal Cortex Dopamine Function with Relevance to Catechol-O-Methyltransferase Genotypes and Schizophrenia , 2008, Biological Psychiatry.

[49]  R. Porsolt,et al.  Place Preference Test in Rodents , 2003, Current protocols in neuroscience.

[50]  K. Deisseroth,et al.  Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning , 2009, Science.

[51]  P. Fletcher,et al.  Faculty Opinions recommendation of A selective role for dopamine in stimulus-reward learning. , 2011 .

[52]  J. Seamans,et al.  The glutamatergic component of the mesocortical pathway emanating from different subregions of the ventral midbrain. , 2012, Cerebral cortex.

[53]  Steven S. Vogel,et al.  Concurrent Activation of Striatal Direct and Indirect Pathways During Action Initiation , 2013, Nature.

[54]  E. Miller,et al.  Neural Substrates of Dopamine D2 Receptor Modulated Executive Functions in the Monkey Prefrontal Cortex. , 2015, Cerebral cortex.

[55]  A. Benabid,et al.  Intensity-dependent nociceptive responses from presumed dopaminergic neurons of the substantia nigra, pars compacta in the rat and their modification by lateral habenula inputs , 1990, Brain Research.

[56]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[57]  Geoffrey Schoenbaum,et al.  Double Dissociation of the Effects of Medial and Orbital Prefrontal Cortical Lesions on Attentional and Affective Shifts in Mice , 2008, The Journal of Neuroscience.