Subsecond Dopamine Release in the Nucleus Accumbens Predicts Conditioned Punishment and Its Successful Avoidance

The mesolimbic dopamine system is believed to be a pathway that processes rewarding information. While previous studies have also implicated a general role for dopamine in punishment and its avoidance, the precise nature of subsecond dopamine release during these phenomena remains unknown. Here, we used fast-scan cyclic voltammetry to investigate whether subsecond dopamine release events in the nucleus accumbens encode cues predicting the avoidance of punishment during behavior maintained in a signaled footshock avoidance procedure. In this task, rats could initiate an avoidance response by pressing a lever within a warning period, preventing footshock. Alternatively, once footshocks commenced, animals could initiate an escape response by pressing the lever, terminating footshock. This design allowed us to assess subsecond dopamine release events during the presentation of a warning signal, safety periods, and two distinct behavioral responses. We found that release consistently increased upon presentation of the warning signal in a manner that reliably predicted successful punishment avoidance. We also observed subsecond dopamine release during the safety period, as occurs following the receipt of reward. Conversely, we observed a decrease in release at the warning signal during escape responses. Because of this finding, we next assessed dopamine release in a conditioned fear model. As seen during escape responses, we observed a time-locked decrease in dopamine release upon presentation of a cue conditioned to inescapable footshock. Together, these data show that subsecond fluctuations in mesolimbic dopamine release predict when rats will successfully avoid punishment and differentially encode cues related to aversive outcomes.

[1]  J. Watson.  The place of the conditioned-reflex in psychology. , 1916 .

[2]  O. Mowrer.  Two-factor learning theory: summary and comment. , 1951, Psychological review.

[3]  M. Sidman.  Avoidance conditioning with brief shock and no exteroceptive warning signal. , 1953, Science.

[4]  J A DINSMOOR,et al.  Punishment. I. The avoidance hypothesis. , 1954, Psychological review.

[5]  R. Rescorla,et al.  INHIBITION OF AVOIDANCE BEHAVIOR. , 1965, Journal of comparative and physiological psychology.

[6]  R. Herrnstein.  Method and theory in the study of avoidance. , 1969, Psychological review.

[7]  R. Solomon,et al.  An opponent-process theory of motivation. I. Temporal dynamics of affect. , 1974, Psychological review.

[8]  R. Solomon,et al.  An Opponent-Process Theory of Motivation , 1978 .

[9]  F. Masterson,et al.  Species-specific defense reactions and avoidance learning , 1982, The Pavlovian Journal of Biological Science.

[10]  B. Hoebel,et al.  A conditioned stimulus decreases extracellular dopamine in the nucleus accumbens after the development of a learned taste aversion , 1991, Brain Research.

[11]  C. A. Marsden,et al.  Conditioned dopamine release: Dependence uponN-methyl-d-aspartate receptors , 1995, Neuroscience.

[12]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[13]  J. Gray,et al.  Increased extracellular dopamine in the nucleus accumbens of the rat during associative learning of neutral stimuli , 1998, Neuroscience.

[14]  T. Robbins,et al.  Dissociations in dopamine release in medial prefrontal cortex and ventral striatum during the acquisition and extinction of classical aversive conditioning in the rat , 1998, The European journal of neuroscience.

[15]  S. Ikemoto,et al.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking , 1999, Brain Research Reviews.

[16]  P. Hicks,et al.  The conditioned avoidance response test re-evaluated: is it a sensitive test for the detection of potentially atypical antipsychotics? , 1999, Neuroscience & Biobehavioral Reviews.

[17]  J. Dinsmoor.  Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. , 2001, Journal of the experimental analysis of behavior.

[18]  M. Pezze,et al.  Selective responding of nucleus accumbens core and shell dopamine to aversively conditioned contextual and discrete stimuli , 2001, Neuroscience.

[19]  Garret D Stuber,et al.  Overoxidation of carbon-fiber microelectrodes enhances dopamine adsorption and increases sensitivity. , 2003, The Analyst.

[20]  J. Feldon,et al.  Mesolimbic dopaminergic pathways in fear conditioning , 2004, Progress in Neurobiology.

[21]  R. Wightman.  Probing Cellular Chemistry in Biological Systems with Microelectrodes , 2006, Science.

[22]  R. Wightman,et al.  Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli , 2008, Nature Neuroscience.

[23]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[24]  Joseph E LeDoux,et al.  Extinction-Reconsolidation Boundaries: Key to Persistent Attenuation of Fear Memories , 2009, Science.

[25]  T. Maia.  Two-factor theory, the actor-critic model, and conditioned avoidance , 2010, Learning & behavior.

[26]  Nephi Stella,et al.  Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals , 2009, Nature Methods.

[27]  Rune W. Berg,et al.  Influence of Phasic and Tonic Dopamine Release on Receptor Activation , 2010, The Journal of Neuroscience.

[28]  D. H. Root,et al.  Emerging , Reemerging , and Forgotten Brain Areas of the Reward Circuit : Notes from the 2010 Motivational and Neural Networks Conference , 2012 .

[29]  M. Frank,et al.  From reinforcement learning models to psychiatric and neurological disorders , 2011, Nature Neuroscience.

[30]  C. Lansink,et al.  Endocannabinoids Shape Accumbal Encoding of Cue-Motivated Behavior via CB1 Receptor Activation in the Ventral Tegmentum , 2012, Neuron.

[31]  Anne E Carpenter,et al.  Neuron-type specific signals for reward and punishment in the ventral tegmental area , 2011, Nature.

[32]  G. Quirk,et al.  Deep brain stimulation of the ventral striatum enhances extinction of conditioned fear , 2012, Proceedings of the National Academy of Sciences.

[33]  P. Dayan.  Instrumental vigour in punishment and reward , 2012, The European journal of neuroscience.

[34]  Anatol C. Kreitzer,et al.  Distinct roles for direct and indirect pathway striatal neurons in reinforcement , 2012, Nature Neuroscience.

[35]  G. McNally,et al.  Appetitive-aversive interactions in Pavlovian fear conditioning. , 2012, Behavioral neuroscience.