Delays Conferred by Escalating Costs Modulate Dopamine Release to Rewards But Not Their Predictors

Efficient reward seeking is essential for survival and invariably requires overcoming costs, such as physical effort and delay, which are constantly changing in natural settings. Dopamine transmission has been implicated in decisions weighing the benefits and costs of obtaining a reward, but it is still unclear how dynamically changing effort and delay costs affect dopamine signaling to rewards and related stimuli. Using fast-scan cyclic voltammetry, we examined phasic dopamine release in the nucleus accumbens (NAcc) core and shell during reward-seeking behavior in rats. To manipulate the effort and time needed to earn a reward, we used instrumental tasks in which the response requirements (number of lever presses) were either fixed throughout a behavioral session [fixed ratio (FR)] or systematically increased from trial to trial [progressive ratio (PR)]. Dopamine release evoked by cues denoting reward availability was no different between these conditions, indicating insensitivity to escalating effort or delay costs. In contrast, dopamine release to reward delivery in both the NAcc core and shell increased in PR, but not in FR, sessions. This enhancement of reward-evoked dopamine signaling was also observed in sessions in which the response requirement was fixed but the delay to reward delivery increased, yoked to corresponding trials in PR sessions. These findings suggest that delay, and not effort, was principally responsible for the increased reward-evoked dopamine release in PR sessions. Together, these data demonstrate that NAcc dopamine release to rewards and their predictors are dissociable and differentially regulated by the delays conferred under escalating costs.

[1]  Nephi Stella,et al.  Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals , 2009, Nature Methods.

[2]  M. Walton,et al.  Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine , 2009, Nature Neuroscience.

[3]  M. Roitman,et al.  Regional specificity in the real‐time development of phasic dopamine transmission patterns during acquisition of a cue–cocaine association in rats , 2009, The European journal of neuroscience.

[4]  John A. Dani,et al.  Controls of Tonic and Phasic Dopamine Transmission in the Dorsal and Ventral Striatum , 2009, Molecular Pharmacology.

[5]  Burt P. Kotler,et al.  Look before you leap: is risk of injury a foraging cost? , 2009, Behavioral Ecology and Sociobiology.

[6]  J. Salamone,et al.  Dopamine, Behavioral Economics, and Effort , 2009, Front. Behav. Neurosci..

[7]  Jean-Claude Darcheville,et al.  Preference for rewards that follow greater effort and greater delay , 2008, Learning & behavior.

[8]  R. Joosten,et al.  Reward-Predictive Cues Enhance Excitatory Synaptic Strength onto Midbrain Dopamine Neurons , 2008, Science.

[9]  R. Wightman,et al.  Preferential Enhancement of Dopamine Transmission within the Nucleus Accumbens Shell by Cocaine Is Attributable to a Direct Increase in Phasic Dopamine Release Events , 2008, The Journal of Neuroscience.

[10]  W. Newsome,et al.  The temporal precision of reward prediction in dopamine neurons , 2008, Nature Neuroscience.

[11]  W. Schultz,et al.  Influence of Reward Delays on Responses of Dopamine Neurons , 2008, The Journal of Neuroscience.

[12]  M. Roesch,et al.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards , 2007, Nature Neuroscience.

[13]  R. Wightman,et al.  Dopamine release is heterogeneous within microenvironments of the rat nucleus accumbens , 2007, The European journal of neuroscience.

[14]  K. Berridge The debate over dopamine’s role in reward: the case for incentive salience , 2007, Psychopharmacology.

[15]  M. Walton,et al.  Calculating utility: preclinical evidence for cost–benefit analysis by mesolimbic dopamine , 2007, Psychopharmacology.

[16]  P. Balsam,et al.  Mice with Chronically Elevated Dopamine Exhibit Enhanced Motivation, but not Learning, for a Food Reward , 2006, Neuropsychopharmacology.

[17]  W. Schultz Behavioral theories and the neurophysiology of reward. , 2006, Annual review of psychology.

[18]  R. Wightman,et al.  Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[19]  M. Hauser,et al.  The ecology and evolution of patience in two New World monkeys , 2005, Biology Letters.

[20]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[21]  The sunk cost effect in pigeons and humans. , 2005, Journal of the experimental analysis of behavior.

[22]  T. Zentall,et al.  Pigeons shift their preference toward locations of food that take more effort to obtain , 2004, Behavioural Processes.

[23]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[24]  O. Hikosaka,et al.  A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. , 2004, Journal of neurophysiology.

[25]  R. Wise Dopamine, learning and motivation , 2004, Nature Reviews Neuroscience.

[26]  R. Wightman,et al.  Dopamine Operates as a Subsecond Modulator of Food Seeking , 2004, The Journal of Neuroscience.

[27]  R. Wightman,et al.  Subsecond dopamine release promotes cocaine seeking , 2003, Nature.

[28]  A. Kelley,et al.  Nucleus accumbens opioid, GABaergic, and dopaminergic modulation of palatable food motivation: contrasting effects revealed by a progressive ratio study in the rat. , 2003, Behavioral neuroscience.

[29]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[30]  Garret D Stuber,et al.  Real-time measurements of phasic changes in extracellular dopamine concentration in freely moving rats by fast-scan cyclic voltammetry. , 2003, Methods in molecular medicine.

[31]  J. Salamone,et al.  Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine , 2002, Behavioural Brain Research.

[32]  A. Kacelnik,et al.  Cost can increase preference in starlings , 2002, Animal Behaviour.

[33]  G. Di Chiara Nucleus accumbens shell and core dopamine: differential role in behavior and addiction. , 2002, Behavioural brain research.

[34]  J. Salamone,et al.  D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption , 2001, Pharmacology Biochemistry and Behavior.

[35]  T. Zentall,et al.  “work ethic” in pigeons: Reward value is directly related to the effort or time required to obtain the reward , 2000, Psychonomic bulletin & review.

[36]  J. Salamone,et al.  Nucleus Accumbens Dopamine Depletions and Time-Constrained Progressive Ratio Performance Effects of Different Ratio Requirements , 1999, Pharmacology Biochemistry and Behavior.

[37]  J. Salamone,et al.  Effects of Dopamine Antagonists and Accumbens Dopamine Depletions on Time-Constrained Progressive-Ratio Performance , 1998, Pharmacology Biochemistry and Behavior.

[38]  J. Salamone,et al.  The Role of Accumbens Dopamine in Lever Pressing and Response Allocation: Effects of 6-OHDA Injected into Core and Dorsomedial Shell , 1998, Pharmacology Biochemistry and Behavior.

[39]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[40]  P N Hineline,et al.  Pigeons' choices in situations of diminishing returns: fixed- versus progressive-ratio schedules. , 1988, Journal of the experimental analysis of behavior.

[41]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .