Temporal Discounting Predicts Risk Sensitivity in Rhesus Macaques

Humans and animals tend both to avoid uncertainty and to prefer immediate over future rewards. The comorbidity of psychiatric disorders such as impulsivity, problem gambling, and addiction suggests that a common mechanism may underlie risk sensitivity and temporal discounting. Nonetheless, the precise relationship between these two traits remains largely unknown. To examine whether risk sensitivity and temporal discounting reflect a common process, we recorded choices made by two rhesus macaques in a visual gambling task while we varied the delay between trials. We found that preference for the risky option declined with increasing delay between sequential choices in the task, even when all other task parameters were held constant. These results were quantitatively predicted by a model that assumed that the subjective expected utility of the risky option is evaluated based on the expected time of the larger payoff. The importance of the larger payoff in this model suggests that the salience of larger payoffs played a critical role in determining the value of risky options. These data suggest that risk sensitivity may be a product of other cognitive processes, and specifically that myopia for the future and the salience of jackpots control the propensity to take a gamble.

[1]  W. Bickel,et al.  Toward a behavioral economic understanding of drug dependence: delay discounting processes. , 2001, Addiction.

[2]  G. Loewenstein,et al.  Decision making over time and under uncertainty: a common approach , 1991 .

[3]  L. Green,et al.  A discounting framework for choice with delayed and probabilistic rewards. , 2004, Psychological bulletin.

[4]  Shanefrederick,et al.  Time Discounting and Time Preference : A Critical Review , 2022 .

[5]  J. C. Crowley,et al.  Saccade Reward Signals in Posterior Cingulate Cortex , 2003, Neuron.

[6]  J. E. Mazur An adjusting procedure for studying delayed reinforcement. , 1987 .

[7]  Charles A. Holt,et al.  Risk Aversion and Incentive Effects , 2002 .

[8]  Joel Myerson,et al.  Exponential Versus Hyperbolic Discounting of Delayed Outcomes: Risk and Waiting Time , 1996 .

[9]  K. Kirby,et al.  Delay-discounting probabilistic rewards: Rates decrease as amounts increase , 1996, Psychonomic bulletin & review.

[10]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[11]  E. Weber,et al.  Predicting Risk-Sensitivity in Humans and Lower Animals: Risk as Variance or Coefficient of Variation , 2004, Psychological review.

[12]  A. Kacelnik,et al.  Risky Theories—The Effects of Variance on Foraging Decisions , 1996 .

[13]  W. Mischel,et al.  Waiting for rewards and punishments: effects of time and probability on choice. , 1967, Journal of personality and social psychology.

[14]  Alex Kacelnik,et al.  Energetic state during learning affects foraging choices in starlings , 2004 .

[15]  D. Cross,et al.  Subjective probability and delay. , 1991, Journal of the experimental analysis of behavior.

[16]  M. Platt,et al.  Risk-sensitive neurons in macaque posterior cingulate cortex , 2005, Nature Neuroscience.

[17]  J. Gibbon,et al.  Cognition and behavior in studies of choice , 1986 .

[18]  P. Glimcher,et al.  Responses of intraparietal neurons to saccadic targets and visual distractors. , 1997, Journal of neurophysiology.

[19]  Camelia M. Kuhnen,et al.  The Neural Basis of Financial Risk Taking , 2005, Neuron.

[20]  D. Meyer,et al.  Neuroeconomics: The Consilience of Brain and Decision , 2004 .

[21]  A Kacelnik,et al.  Risky choice and Weber's Law. , 1998, Journal of theoretical biology.

[22]  P. D. Smallwood An Introduction to Risk Sensitivity: The Use of Jensen's Inequality to Clarify Evolutionary Arguments of Adaptation and Constraint , 1996 .

[23]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[24]  M. Hauser,et al.  The ecology and evolution of patience in two New World monkeys , 2005, Biology Letters.

[25]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[26]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[27]  H. Rachlin The Science of Self-Control , 2004 .

[28]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[29]  E. Charnov Optimal foraging, the marginal value theorem. , 1976, Theoretical population biology.

[30]  A Silberberg,et al.  Choice in the repeated-gambles experiment. , 1988, Journal of the experimental analysis of behavior.