Brain activations reflect individual discount rates in intertemporal choice

Humans discount the value of future rewards following a hyperbolic function and thus may prefer a smaller immediate reward over a larger delayed reward. Marked interindividual differences in the steepness of this discounting function can be observed which can be quantified by the parameter k of the discount function. Here, we asked how differences in delay discounting behaviour are reflected by brain activation patterns. Sixteen healthy participants were studied in a slow event-related functional magnetic resonance imaging experiment at 3T. In each trial, participants had to decide between a smaller but immediately available monetary reward (ranging between 14 and 84 Euro) and a larger delayed reward (26 to 89 Euro; delay 5 to 169days) by button press. Participants had the chance to receive the reward corresponding to one of their decisions at the end of the experiment. As expected, participants differed widely with respect to the steepness of their discount function. By contrasting decisions at or near the individual participant's indifference point (as determined by parameter k) with trials either well below or well above this point two different brain networks with opposing activation patterns were revealed: Trials below or above the indifference point were associated with activation in the ventral striatum and ventromedial prefrontal cortex, whereas decisions at the indifference point gave rise to activation in medial prefrontal cortex. The opposite effects in the two systems at individual indifference point were interpreted as a reflection of response conflict.

[1]  J. Gläscher,et al.  Dissociable Systems for Gain- and Loss-Related Value Predictions and Errors of Prediction in the Human Brain , 2006, The Journal of Neuroscience.

[2]  A. Hariri,et al.  Preference for Immediate over Delayed Rewards Is Associated with Magnitude of Ventral Striatal Activity , 2006, The Journal of Neuroscience.

[3]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[4]  Mark D'Esposito,et al.  Impulsive responding in alcoholics. , 2005, Alcoholism, clinical and experimental research.

[5]  Karl J. Friston,et al.  Dynamic causal models of neural system dynamics: current state and future extensions , 2007, Journal of Biosciences.

[6]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[7]  A. Rodríguez-Fornells,et al.  Functional Connectivity of Reward Processing in the Brain , 2008, Front. Hum. Neurosci..

[8]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[9]  W. Bickel,et al.  Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. , 1999, Journal of experimental psychology. General.

[10]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[11]  J. Richards,et al.  Delay discounting and probability discounting as related to cigarette smoking status in adults , 2004, Behavioural Processes.

[12]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[13]  Jan B Engelmann,et al.  Behavioral and Neural Effects of Delays during Intertemporal Choice Are Independent of Probability , 2009, The Journal of Neuroscience.

[14]  N. Petry Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. , 2001, Journal of abnormal psychology.

[15]  Warren K Bickel,et al.  Congruence of BOLD Response across Intertemporal Choice Conditions: Fictive and Real Money Gains and Losses , 2009, The Journal of Neuroscience.

[16]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[17]  Adam Gazzaley,et al.  Functional interactions between prefrontal and visual association cortex contribute to top-down modulation of visual processing. , 2007, Cerebral cortex.

[18]  Daeyeol Lee,et al.  Neural Dissociation of Delay and Uncertainty in Intertemporal Choice , 2008, The Journal of Neuroscience.

[19]  G. Loewenstein,et al.  Time Discounting and Time Preference: A Critical Review , 2002 .

[20]  C. Pennartz,et al.  Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making , 2008, Progress in Neurobiology.

[21]  S. Huettel,et al.  The neural substrates of probabilistic and intertemporal decision making , 2008, Brain Research.

[22]  B. Reynolds A review of delay-discounting research with humans: relations to drug use and gambling , 2006, Behavioural pharmacology.

[23]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[24]  B. Reynolds Do high rates of cigarette consumption increase delay discounting? A cross-sectional comparison of adolescent smokers and young-adult smokers and nonsmokers , 2004, Behavioural Processes.

[25]  Shu Li,et al.  Neural mechanism of intertemporal choice: From discounting future gains to future losses , 2009, Brain Research.

[26]  Karl J. Friston,et al.  Encoding of Marginal Utility across Time in the Human Brain , 2009, The Journal of Neuroscience.

[27]  N. Petry,et al.  Delay discounting of money and alcohol in actively using alcoholics, currently abstinent alcoholics, and controls , 2001, Psychopharmacology.

[28]  K. Arrow,et al.  The New Palgrave Dictionary of Economics , 2020 .

[29]  Jonathan D. Cohen,et al.  Functional Imaging of Decision Conflict , 2008, The Journal of Neuroscience.

[30]  J. E. Mazur Tests of an equivalence rule for fixed and variable reinforcer delays. , 1984 .

[31]  R. H. Strotz Myopia and Inconsistency in Dynamic Utility Maximization , 1955 .

[32]  Samuel M. McClure,et al.  Time Discounting for Primary Rewards , 2007, The Journal of Neuroscience.

[33]  M. Hauser,et al.  The Evolutionary Origins of Human Patience: Temporal Preferences in Chimpanzees, Bonobos, and Human Adults , 2007, Current Biology.

[34]  E. Procyk,et al.  Reward encoding in the monkey anterior cingulate cortex. , 2006, Cerebral cortex.

[35]  T. Kalenscher,et al.  Single Units in the Pigeon Brain Integrate Reward Amount and Time-to-Reward in an Impulsive Choice Task , 2005, Current Biology.

[36]  C. Büchel,et al.  Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making , 2009, The Journal of Neuroscience.

[37]  Adam Gazzaley,et al.  Measuring functional connectivity during distinct stages of a cognitive task , 2004, NeuroImage.

[38]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[39]  Kris N Kirby,et al.  Heroin and cocaine abusers have higher discount rates for delayed rewards than alcoholics or non-drug-using controls. , 2004, Addiction.

[40]  Jennifer M. Mitchell,et al.  Immediate Reward Bias in Humans: Fronto-Parietal Networks and a Role for the Catechol-O-Methyltransferase 158Val/Val Genotype , 2007, The Journal of Neuroscience.