Behavioral and Neural Evidence of Incentive Bias for Immediate Rewards Relative to Preference-Matched Delayed Rewards

Several theories of self-control [including intertemporal bargaining (Ainslie, 1992) and self-signaling (Bodner and Prelec, 2001)] imply that intertemporal decisions can be more farsighted than would be predicted by the incentive associated with rewards outside a decision context. We examined this hypothesis using behavior and functional neuroimaging. First, subjects expressed preferences between amounts of money delayed by 4 months and smaller amounts available that day. This allowed us to establish “indifference pairs” individualized to each participant: immediate and delayed amounts that were equally preferred. Participants subsequently performed a reaction time functional magnetic resonance imaging task (Knutson et al., 2001a) that provided them with distinct opportunities to win each of the rewards that comprised the indifference pairs. Anatomical region of interest analysis as well as whole-brain analysis indicated greater response recruited by the immediate rewards (relative to the preference-matched delayed rewards) in regions previously implicated as sensitive to incentive value using the same task (including bilateral putamen, bilateral anterior insula, and midbrain). Reaction time to the target was also faster during the immediate relative to delayed reward trials (p < 0.01), and individual differences in reaction time between immediate versus delayed reward trials correlated with variance in magnetic resonance signal in those clusters that responded preferentially to immediate rewards (r = 0.33, p < 0.05). These findings indicate a discrepancy in incentive associated with the immediate versus the preference-matched delayed rewards. This discrepancy may mark the contribution of self-control processes that are recruited during decision-making but that are absent when rewards are individually anticipated.

[1]  Samuel M. McClure,et al.  Time Discounting for Primary Rewards , 2007, The Journal of Neuroscience.

[2]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[3]  A. Logue,et al.  Self-control in adult humans: variation in positive reinforcer amount and delay. , 1986, Journal of the experimental analysis of behavior.

[4]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[5]  R. Passingham,et al.  The left parietal cortex and motor attention , 1997, Neuropsychologia.

[6]  D. Bem Self-Perception Theory , 1972 .

[7]  Alexandra W. Logue,et al.  Independence of reinforcer amount and delay: The generalized matching law and self-control in humans , 1992 .

[8]  M. Umemiya,et al.  A Calcium-Dependent Feedback Mechanism Participates in Shaping Single NMDA Miniature EPSCs , 2001, The Journal of Neuroscience.

[9]  Daniel Read,et al.  Four Score and Seven Years from Now: The Date/Delay Effect in Temporal Discounting , 2005, Manag. Sci..

[10]  JaneR . Taylor,et al.  Impulsivity resulting from frontostriatal dysfunction in drug abuse: implications for the control of behavior by reward-related stimuli , 1999, Psychopharmacology.

[11]  J. Lewin Functional MRI: An introduction to methods , 2003 .

[12]  Heidi Johansen-Berg,et al.  Ventral Striatum/Nucleus Accumbens Activation to Smoking-Related Pictorial Cues in Smokers and Nonsmokers: A Functional Magnetic Resonance Imaging Study , 2005, Biological Psychiatry.

[13]  W. Bickel,et al.  Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. , 1999, Journal of experimental psychology. General.

[14]  J. Monterosso,et al.  Hyperbolic Discounting as a Factor in Addiction , 2003 .

[15]  George Ainslie,et al.  Précis of Breakdown of Will , 2005, Behavioral and Brain Sciences.

[16]  George Ainslie,et al.  Frontoparietal cortical activity of methamphetamine‐dependent and comparison subjects performing a delay discounting task , 2007, Human brain mapping.

[17]  Karl J. Friston,et al.  Encoding of Marginal Utility across Time in the Human Brain , 2009, The Journal of Neuroscience.

[18]  D. Prelec,et al.  Self-signaling and diagnostic utility in everyday decision making1 , 2005 .

[19]  Jean Tirole,et al.  Willpower and Personal Rules , 2002, Journal of Political Economy.

[20]  J. Halperin ADHD and the Nature of Self-Control , 1999 .

[21]  George Ainslie,et al.  The behavioral economics of will in recovery from addiction. , 2007, Drug and alcohol dependence.

[22]  Tor D Wager,et al.  Neuroimaging studies of shifting attention: a meta-analysis , 2004, NeuroImage.

[23]  G. E. Alexander,et al.  Preparation for movement: neural representations of intended direction in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[24]  A. Smit,et al.  Synapse Formation between Central Neurons Requires Postsynaptic Expression of the MEN1 Tumor Suppressor Gene , 2001, The Journal of Neuroscience.

[25]  Keith J. Worsley,et al.  Statistical analysis of activation images , 2001 .

[26]  A. Damasio,et al.  Subcortical and cortical brain activity during the feeling of self-generated emotions , 2000, Nature Neuroscience.

[27]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[28]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[29]  Stephen M. Smith,et al.  General multilevel linear modeling for group analysis in FMRI , 2003, NeuroImage.

[30]  Benedetto De Martino,et al.  How Choice Reveals and Shapes Expected Hedonic Outcome , 2009, The Journal of Neuroscience.

[31]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[32]  Mark W. Woolrich,et al.  Multilevel linear modelling for FMRI group analysis using Bayesian inference , 2004, NeuroImage.

[33]  M. Mesulam,et al.  Insula of the old world monkey. Architectonics in the insulo‐orbito‐temporal component of the paralimbic brain , 1982, The Journal of comparative neurology.

[34]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[35]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[36]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[37]  Colin Camerer,et al.  Self-control in decision-making involves modulation of the vmPFC valuation system , 2009, NeuroImage.

[38]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[39]  Rita Z. Goldstein,et al.  Drug addiction and its underlying neurobiological basis: neuroimaging evidence for the involvement of the frontal cortex. , 2002, The American journal of psychiatry.

[40]  Mark W. Woolrich,et al.  Robust group analysis using outlier inference , 2008, NeuroImage.

[41]  J. Monterosso,et al.  The picoeconomic approach to addictions: Analyzing the conflict of successive motivational states , 2009 .