Preference for Immediate over Delayed Rewards Is Associated with Magnitude of Ventral Striatal Activity

Discounting future outcomes as a function of their deferred availability underlies much of human decision making. Discounting, or preference for immediate over delayed rewards of larger value, is often associated with impulsivity and is a risk factor for addictive disorders such as pathological gambling, cigarette smoking, and drug and alcohol abuse. The ventral striatum (VS) is involved in mediating behavioral responses and physiological states associated with reward, and dysregulation of the VS contributes to addiction, perhaps by affecting impulsive decision-making. Behavioral tests of delay discounting (DD), which index preference for smaller immediate over larger delayed rewards, covary with impulsive tendencies in humans. In the current study, we examined the relationship between individual differences in DD, measured in a behavioral assessment, and VS activity measured with blood oxygenation level-dependent functional magnetic resonance imaging, in 45 adult volunteers. VS activity was determined using a task involving positive and negative feedback with monetary reward. Analyses revealed that individual differences in DD correlate positively with magnitude of VS activation in response to both positive and negative feedback, compared with a no-feedback control condition. Variability in DD was also associated with differential VS activation in response to positive, compared with negative, feedback. Collectively, our results suggest that increased preference for smaller immediate over larger delayed rewards reflects both a relatively indiscriminate and hyper-reactive VS circuitry. They also highlight a specific neurocognitive mechanism that may contribute to increased risk for addiction.

[1]  W K Bickel,et al.  Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: drug and monetary rewards. , 1997, Experimental and clinical psychopharmacology.

[2]  R. Vuchinich,et al.  Hyperbolic temporal discounting in social drinkers and problem drinkers. , 1998, Experimental and clinical psychopharmacology.

[3]  W. Bickel,et al.  Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. , 1999, Journal of experimental psychology. General.

[4]  H. de Wit,et al.  Delay or probability discounting in a model of impulsive behavior: effect of alcohol. , 1999, Journal of the experimental analysis of behavior.

[5]  S. Mitchell,et al.  Measures of impulsivity in cigarette smokers and non-smokers , 1999, Psychopharmacology.

[6]  H. Breiter,et al.  Functional Magnetic Resonance Imaging of Brain Reward Circuitry in the Human , 1999, Annals of the New York Academy of Sciences.

[7]  A. Odum,et al.  Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers , 1999, Psychopharmacology.

[8]  R. Vuchinich,et al.  Reliability of a Measure of Temporal Discounting , 2000 .

[9]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[10]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[11]  Warren K Bickel,et al.  Within-subject comparison of real and hypothetical money rewards in delay discounting. , 2002, Journal of the experimental analysis of behavior.

[12]  S. Kapur,et al.  Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli , 2003, Neuron.

[13]  S. M. Alessi,et al.  Pathological gambling severity is associated with impulsivity in a delay discounting procedure , 2003, Behavioural Processes.

[14]  K. Berridge,et al.  Parsing reward , 2003, Trends in Neurosciences.

[15]  G. Madden,et al.  Delay discounting of real and hypothetical rewards. , 2003, Experimental and clinical psychopharmacology.

[16]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[17]  L. Green,et al.  A discounting framework for choice with delayed and probabilistic rewards. , 2004, Psychological bulletin.

[18]  K. Doya,et al.  A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task , 2004, The Journal of Neuroscience.

[19]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[20]  E. Butelman,et al.  Genetic influences on impulsivity, risk taking, stress responsivity and vulnerability to drug abuse and addiction , 2005, Nature Neuroscience.

[21]  G. Glover,et al.  The Role of Ventral Frontostriatal Circuitry in Reward-Based Learning in Humans , 2005, The Journal of Neuroscience.

[22]  N. Volkow,et al.  The neural basis of addiction: a pathology of motivation and choice. , 2005, The American journal of psychiatry.

[23]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[24]  S. Inati,et al.  An fMRI study of reward-related probability learning , 2005, NeuroImage.

[25]  M. McCloskey,et al.  IQ and nonplanning impulsivity are independently associated with delay discounting in middle-aged adults , 2007 .