Now for sure or later with a risk? Modeling risky intertemporal choice as accumulated preference.

Research on risky and intertemporal decision-making often focuses on descriptive models of choice. This class of models sometimes lack a psychological process account of how different cognitive processes give rise to choice behavior. Here, we attempt to decompose these processes using sequential accumulator modeling (i.e., the linear ballistic accumulator model). Participants were presented with pairs of gambles that either involve different levels of probability or delay (Experiment 1) or a combination of these dimensions (both probability and delay; Experiment 2). Response times were recorded as a measure of preferential strength. We then combined choice data and response times, and utilized variants of the linear ballistic accumulator to explore different assumptions about how preferences are formed. Specifically, we show that a model that allows for the subjective evaluation of a fixed now/certain option to change as a function of the delayed/risky option with which it is paired provides the best account of the combined choice and response time (RT) data. The work highlights the advantages of using cognitive process models in risky and intertemporal choice, and points toward a common framework for understanding how people evaluate time and probability.

[1]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[2]  I. J. Myung,et al.  When a good fit can be bad , 2002, Trends in Cognitive Sciences.

[3]  Scott D. Brown,et al.  The hare and the tortoise: emphasizing speed can change the evidence used to make decisions. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[4]  Scott D. Brown,et al.  A simple introduction to Markov Chain Monte–Carlo sampling , 2016, Psychonomic bulletin & review.

[5]  Don van Ravenzwaaij,et al.  A confirmatory approach for integrating neural and behavioral data into a single model , 2017 .

[6]  Andrew Heathcote,et al.  Brain and Behavior in Decision-Making , 2014, PLoS Comput. Biol..

[7]  G. Loewenstein,et al.  Decision making over time and under uncertainty: a common approach , 1991 .

[8]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[9]  Adrian Bruhin,et al.  Viewing the future through a warped lens: Why uncertainty generates hyperbolic discounting , 2010 .

[10]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[11]  Brandon M. Turner,et al.  A method for efficiently sampling from distributions with correlated dimensions. , 2013, Psychological methods.

[12]  Manel Baucells,et al.  Common ratio using delay , 2010 .

[13]  G. Loewenstein,et al.  Anomalies in Intertemporal Choice: Evidence and an Interpretation , 1992 .

[14]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[15]  L. Green,et al.  Discounting of monetary rewards that are both delayed and probabilistic: delay and probability combine multiplicatively, not additively. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[16]  D. Goldstein,et al.  Word count: 3998 Corresponding author: , 2022 .

[17]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[18]  R. Ratcliff,et al.  Aging, practice, and perceptual tasks: a diffusion model analysis. , 2006, Psychology and aging.

[19]  L. Green,et al.  A discounting framework for choice with delayed and probabilistic rewards. , 2004, Psychological bulletin.

[20]  W. Bickel,et al.  The combined effects of delay and probability in discounting , 2006, Behavioural Processes.

[21]  Arndt Bröder,et al.  Cognitive processes, models and metaphors in decision research , 2008, Judgment and Decision Making.

[22]  P. Samuelson A Note on Measurement of Utility , 1937 .

[23]  Eric-Jan Wagenmakers,et al.  Does the name-race implicit association test measure racial prejudice? , 2011, Experimental psychology.

[24]  Roger Ratcliff,et al.  Individual differences, aging, and IQ in two-choice tasks , 2010, Cognitive Psychology.

[25]  Peter H. M. P. Roelofsma,et al.  Immediacy and Certainty in Intertemporal Choice , 1995 .

[26]  D. Read,et al.  The Psychology of Intertemporal Tradeoffs , 2009, Psychological review.

[27]  R. Hertwig,et al.  The priority heuristic: making choices without trade-offs. , 2006, Psychological review.

[28]  R. Ratcliff,et al.  A Diffusion Model Account of Criterion Shifts in the Lexical Decision Task. , 2008, Journal of memory and language.

[29]  Andreas Glöckner,et al.  An eye‐tracking study on information processing in risky decisions: Evidence for compensatory strategies based on automatic processes , 2011 .

[30]  C. González-Vallejo Making trade-offs: a probabilistic and context-sensitive model of choice behavior. , 2002, Psychological review.

[31]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[32]  G. Chapman,et al.  The combined effects of risk and time on choice: Does uncertainty eliminate the immediacy effect? Does delay eliminate the certainty effect? , 2005 .

[33]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[34]  David A. Lagnado,et al.  Straight Choices: The Psychology of Decision Making , 2007 .

[35]  M. Allais Le comportement de l'homme rationnel devant le risque : critique des postulats et axiomes de l'ecole americaine , 1953 .

[36]  Anne C. Macaskill,et al.  The effect of reinforcer magnitude on probability and delay discounting of experienced outcomes in a computer game task in humans. , 2015, Journal of the experimental analysis of behavior.

[37]  Richard Gonzalez,et al.  On the Shape of the Probability Weighting Function , 1999, Cognitive Psychology.

[38]  Roger Ratcliff,et al.  A diffusion model account of the lexical decision task. , 2004, Psychological review.

[39]  K. R. Ridderinkhof,et al.  Striatum and pre-SMA facilitate decision-making under time pressure , 2008, Proceedings of the National Academy of Sciences.

[40]  D. Cross,et al.  Subjective probability and delay. , 1991, Journal of the experimental analysis of behavior.

[41]  L. Green,et al.  Discounting of delayed rewards: Models of individual choice. , 1995, Journal of the experimental analysis of behavior.

[42]  S. E. Ahmed,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference , 2008, Technometrics.

[43]  Claudia González-Vallejo,et al.  Attribute-wise vs. alternative-wise mechanism in intertemporal choice: Testing the proportional difference, trade-off, and hyperbolic models. , 2016 .

[44]  Brandon M. Turner,et al.  Intertemporal Choice as Discounted Value Accumulation , 2014, PloS one.

[45]  Daniel Read,et al.  DRIFT: an analysis of outcome framing in intertemporal choice. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[46]  Scott D. Brown,et al.  Cortico-striatal connections predict control over speed and accuracy in perceptual decision making , 2010, Proceedings of the National Academy of Sciences.

[47]  Gordon D. A. Brown,et al.  Decision by sampling , 2006, Cognitive Psychology.

[48]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[49]  David J. Hardisty,et al.  Asymmetric discounting of gains and losses: A query theory account , 2011 .

[50]  Gordon D. A. Brown,et al.  Does the brain calculate value? , 2011, Trends in Cognitive Sciences.

[51]  G. Chapman,et al.  Decision biases in intertemporal choice and choice under uncertainty: Testing a common account , 2006, Memory & cognition.

[52]  Scott D. Brown,et al.  Domain General Mechanisms of Perceptual Decision Making in Human Cortex , 2009, The Journal of Neuroscience.

[53]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[54]  Mark Steyvers,et al.  A generative joint model for spike trains and saccades during perceptual decision-making , 2016, Psychonomic Bulletin & Review.

[55]  J. Busemeyer,et al.  A probabilistic, dynamic, and attribute-wise model of intertemporal choice. , 2014, Journal of experimental psychology. General.

[56]  Jordan J. Louviere,et al.  Integrating Cognitive Process and Descriptive Models of Attitudes and Preferences , 2014, Cogn. Sci..

[57]  Sudeep Bhatia,et al.  The dynamics of deferred decision , 2016, Cognitive Psychology.

[58]  Manel Baucells,et al.  Probability and Time Trade-Off , 2012, Manag. Sci..

[59]  Ben R. Newell,et al.  Exploring the decision dynamics of risky intertemporal choice , 2017, CogSci.

[60]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[61]  Daniel D. Holt,et al.  Discounting delayed and probabilistic rewards: Processes and traits , 2003 .

[62]  Eric-Jan Wagenmakers,et al.  A diffusion model decomposition of the effects of alcohol on perceptual decision making , 2011, Psychopharmacology.

[63]  Andrew Heathcote,et al.  The multiattribute linear ballistic accumulator model of context effects in multialternative choice. , 2014, Psychological review.

[64]  Daniel M. Oppenheimer,et al.  Information processing as a paradigm for decision making. , 2015, Annual review of psychology.

[65]  R. Thaler Some empirical evidence on dynamic inconsistency , 1981 .