Separate Neural Systems Value Immediate and Delayed Monetary Rewards

When humans are offered the choice between rewards available at different points in time, the relative values of the options are discounted according to their expected delays until delivery. Using functional magnetic resonance imaging, we examined the neural correlates of time discounting while subjects made a series of choices between monetary reward options that varied by delay to delivery. We demonstrate that two separate systems are involved in such decisions. Parts of the limbic system associated with the midbrain dopamine system, including paralimbic cortex, are preferentially activated by decisions involving immediately available rewards. In contrast, regions of the lateral prefrontal cortex and posterior parietal cortex are engaged uniformly by intertemporal choices irrespective of delay. Furthermore, the relative engagement of the two systems is directly associated with subjects' choices, with greater relative fronto-parietal activity when subjects choose longer term options.

[1]  James L Olds.  Self-Stimulation of the Brain , 1958, Science.

[2]  T. Koopmans,et al.  STATIONARY UTILITY AND TIME PERSPECTIVE1 , 1964 .

[3]  R. Pollak,et al.  SECOND-BEST NATIONAL SAVING AND GAME-EQUILIBRIUM GROWTH , 1980 .

[4]  G. Ainslie.  Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[5]  D. Raphael,et al.  I: The Theory of Moral Sentiments , 1976 .

[6]  J. Elster.  Ulysses and the Sirens: Studies in Rationality and Irrationality , 1985 .

[7]  B. G. Hoebel.  Brain neurotransmitters in food and drug reward. , 1985, The American journal of clinical nutrition.

[8]  Noam Chomsky.  Language and Problems of Knowledge , 1987 .

[9]  R. Thaler,et al.  THE BEHAVIORAL LIFE‐CYCLE HYPOTHESIS , 1988 .

[10]  F. Bloom,et al.  Cellular and molecular mechanisms of drug dependence. , 1988, Science.

[11]  H. Rachlin.  Judgment, Decision, and Choice: A Cognitive/Behavioral Synthesis , 1989 .

[12]  M. Macmillan.  Inhibition and the control of behavior From Gall to Freud via Phineas Gage and the frontal lobes , 1992, Brain and Cognition.

[13]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[14]  J. Kagel,et al.  Economic Choice Theory: An Experimental Analysis of Animal Behavior , 1995 .

[15]  G. Loewenstein.  Out of control: Visceral influences on behavior , 1996 .

[16]  David I. Laibson,et al.  Golden Eggs and Hyperbolic Discounting , 1997 .

[17]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[18]  R. Herrnstein,et al.  The Matching Law Papers in Psychology and Economics , 1997 .

[19]  S. Dehaene,et al.  Abstract representations of numbers in the animal and human brain , 1998, Trends in Neurosciences.

[20]  H. Breiter,et al.  Functional Magnetic Resonance Imaging of Brain Reward Circuitry in the Human , 1999, Annals of the New York Academy of Sciences.

[21]  J. Metcalfe,et al.  A hot/cool-system analysis of delay of gratification: dynamics of willpower. , 1999, Psychological review.

[22]  J. Jonides,et al.  Storage and executive processes in the frontal lobes. , 1999, Science.

[23]  Brian Butterworth,et al.  The Mathematical Brain , 1999 .

[24]  J. Ashby.  References and Notes , 1999 .

[25]  Ted O’Donoghue,et al.  Doing It Now or Later , 1999 .

[26]  H. Rachlin.  The Science of Self-Control , 2004 .

[27]  D. Ariely,et al.  Beautiful Faces Have Variable Reward Value fMRI and Behavioral Evidence , 2001, Neuron.

[28]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[29]  Jonathan D. Cohen,et al.  An fMRI Investigation of Emotional Engagement in Moral Judgment , 2001, Science.

[30]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[31]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[32]  G. Angeletos,et al.  The Hyperbolic Consumption Model: Calibration, Simulation, and Empirical Evaluation , 2022 .

[33]  M. Minami.  How Children Learn the Meanings of Words , 2001 .

[34]  W. Meck,et al.  Dissecting the Brain's Internal Clock: How Frontal–Striatal Circuitry Keeps Time and Shifts Attention , 2002, Brain and Cognition.

[35]  M. Pycia,et al.  Dynamic inconsistency and self-control: a planner-doer interpretation , 2002 .

[36]  George Loewenstein,et al.  Mild opioid deprivation increases the degree that opioid-dependent outpatients discount delayed heroin and money , 2002, Psychopharmacology.

[37]  P. Murphy,et al.  Inhibitory Control in Adults with Attention-Deficit/Hyperactivity Disorder , 2002, Journal of attention disorders.

[38]  G. Loewenstein,et al.  Time Discounting and Time Preference: A Critical Review , 2002 .

[39]  J. Gabrieli,et al.  Rethinking Feelings: An fMRI Study of the Cognitive Regulation of Emotion , 2002, Journal of Cognitive Neuroscience.

[40]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[41]  H. Wiese.  Numbers, language, and the human mind , 2003 .

[42]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[43]  Jonathan D. Cohen,et al.  The Neural Basis of Economic Decision-Making in the Ultimatum Game , 2003, Science.

[44]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[45]  Edward E. Smith,et al.  Placebo-Induced Changes in fMRI in the Anticipation and Experience of Pain , 2004, Science.

[46]  Aspectos da língua mundurukú , 2004 .

[47]  Peter Dayan,et al.  Temporal difference models describe higher-order learning in humans , 2004, Nature.

[48]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]／Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[49]  Jean-Christophe Verstraete.  Language Acquisition and Conceptual Development (review) , 2005 .