Rationally inattentive intertemporal choice

Discounting of future rewards is traditionally interpreted as evidence for an intrinsic preference in favor of sooner rewards. However, temporal discounting can also arise from internal uncertainty in value representations of future events, if one assumes that noisy mental simulations of the future are rationally combined with prior beliefs. Here, we further develop this idea by considering how simulation noise may be adaptively modulated by task demands, based on principles of rational inattention. We show how the optimal allocation of mental effort can give rise to the magnitude effect in intertemporal choice. In a re-analysis of two prior data sets, and in another experiment, we reveal several behavioral signatures of this theoretical account, tying choice stochasticity to the magnitude effect. We conclude that some aspects of temporal discounting may result from a cognitively plausible adaptive response to the costs of information processing. People are disproportionately more patient when evaluating larger rewards. Here, the authors show how this magnitude effect may reflect an adaptive response to uncertainty in mental representations of future value.

[1]  C. Sims Rate–distortion theory and human perception , 2016, Cognition.

[2]  A. Rapoport,et al.  Discount rates inferred from decisions: an experimental study , 1987 .

[3]  K. Kirby,et al.  Bidding on the Future: Evidence Against Normative Discounting of Delayed Rewards , 1997 .

[4]  Jan Peters,et al.  Episodic Future Thinking Reduces Reward Delay Discounting through an Enhancement of Prefrontal-Mediotemporal Interactions , 2010, Neuron.

[5]  Yaacov Trope,et al.  Temporal construal. , 2003, Psychological review.

[6]  Mathias Pessiglione,et al.  A Critical Role for the Hippocampus in the Valuation of Imagined Outcomes , 2013, PLoS biology.

[7]  H. Rachlin,et al.  The effect of temporal constraints on the value of money and other commodities , 1993 .

[8]  M. Linden,et al.  Phenomenal characteristics associated with projecting oneself back into the past and forward into the future: Influence of valence and temporal distance , 2004, Consciousness and Cognition.

[9]  Jonathan Robinson,et al.  TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences , 2016, Behavior Research Methods.

[10]  R. Thaler Some empirical evidence on dynamic inconsistency , 1981 .

[11]  E. Maskin,et al.  Uncertainty and Hyperbolic Discounting , 2005 .

[12]  W. Bickel,et al.  Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. , 1999, Journal of experimental psychology. General.

[13]  Warren K Bickel,et al.  Within-subject comparison of real and hypothetical money rewards in delay discounting. , 2002, Journal of the experimental analysis of behavior.

[14]  U. Ben-Zion,et al.  Discount rates inferred from decisions: an experimental study , 1989 .

[15]  David I. Laibson,et al.  Golden Eggs and Hyperbolic Discounting , 1997 .

[16]  Peter D. Sozou,et al.  On hyperbolic discounting and uncertain hazard rates , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[17]  Andrew Caplin Measuring and Modeling Attention , 2016 .

[18]  Karl J. Friston,et al.  Bayesian model selection for group studies — Revisited , 2014, NeuroImage.

[19]  L. Green,et al.  Rate of temporal discounting decreases with amount of reward , 1997, Memory & cognition.

[20]  L. Green,et al.  Delay discounting of monetary rewards over a wide range of amounts. , 2013, Journal of the experimental analysis of behavior.

[21]  S. Huettel,et al.  Amount and time exert independent influences on intertemporal choice , 2019, Nature Human Behaviour.

[22]  Jonathan D. Cohen,et al.  The Expected Value of Control: An Integrative Theory of Anterior Cingulate Cortex Function , 2013, Neuron.

[23]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[24]  H. Laborit,et al.  [Experimental study]. , 1958, Bulletin mensuel - Societe de medecine militaire francaise.

[25]  Benjamin T Vincent,et al.  Hierarchical Bayesian estimation and hypothesis testing for delay discounting tasks , 2015, Behavior Research Methods.

[26]  C. Sims Implications of rational inattention , 2003 .

[27]  Michael A. Kuhn,et al.  On Measuring Time Preferences , 2013 .

[28]  Daphna Shohamy,et al.  Dopamine Modulation of Intertemporal Decision-making: Evidence from Parkinson Disease , 2016, Journal of Cognitive Neuroscience.

[29]  Massimo Marinacci,et al.  A note on rational inattention and rate distortion theory , 2020 .

[30]  M. Husain,et al.  Dopamine enhances willingness to exert effort for reward in Parkinson's disease , 2015, Cortex.

[31]  Warren K Bickel,et al.  Congruence of BOLD Response across Intertemporal Choice Conditions: Fictive and Real Money Gains and Losses , 2009, The Journal of Neuroscience.

[32]  G. Loewenstein Anticipation and the Valuation of Delayed Consumption , 1987 .

[33]  Elke U. Weber,et al.  Good or Bad, We Want it Now: Fixed-cost Present Bias for GainsandLosses Explains Magnitude Asymmetries in Intertemporal Choice: Good or Bad, We Want it Now , 2013 .

[34]  D. Schacter,et al.  Deliberating trade-offs with the future , 2020, Nature Human Behaviour.

[35]  Bianca C. Wittmann,et al.  Reward and Novelty Enhance Imagination of Future Events in a Motivational-Episodic Network , 2015, PloS one.

[36]  David J. Hardisty,et al.  Good or Bad, We Want it Now: Fixed-Cost Present Bias for Gains and Losses Explains Magnitude Asymmetries in Intertemporal Choice , 2012 .

[37]  David I. Laibson,et al.  Myopia and Discounting , 2017 .

[38]  G. Loewenstein,et al.  Time Discounting and Time Preference: A Critical Review , 2002 .

[39]  Z. Kurth-Nelson,et al.  A theoretical account of cognitive effects in delay discounting , 2012, The European journal of neuroscience.

[40]  Joshua de Leeuw,et al.  jsPsych: A JavaScript library for creating behavioral experiments in a Web browser , 2014, Behavior Research Methods.

[41]  Eric J. Johnson,et al.  Lateral prefrontal cortex and self-control in intertemporal choice , 2010, Nature Neuroscience.

[42]  R. Benoit,et al.  A Neural Mechanism Mediating the Impact of Episodic Prospection on Farsighted Decisions , 2011, The Journal of Neuroscience.

[43]  Filip Matejka,et al.  Rational Inattention to Discrete Choices: A New Foundation for the Multinomial Logit Model , 2011 .

[44]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[45]  M. Husain,et al.  Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control , 2015, Current Biology.

[46]  Samuel M. McClure,et al.  Causal Evidence for the Dependence of the Magnitude Effect on Dorsolateral Prefrontal Cortex , 2018, Scientific Reports.

[47]  Arturo Bouzas,et al.  Hierarchical Bayesian modeling of intertemporal choice , 2017, Judgment and Decision Making.

[48]  T. Braver,et al.  Dopamine Does Double Duty in Motivating Cognitive Effort , 2016, Neuron.

[49]  C. Aring,et al.  A CRITICAL REVIEW , 1939, Journal of neurology and psychiatry.

[50]  Samuel M. McClure,et al.  More Is Meaningful: The Magnitude Effect in Intertemporal Choice Depends on Self-Control , 2017, Psychological science.

[51]  G. Pezzulo,et al.  The Value of Foresight: How Prospection Affects Decision-Making , 2011, Front. Neurosci..