Dynamic cognitive models of intertemporal choice

Traditionally, descriptive accounts of intertemporal choice have relied on static and deterministic models that assume alternative-wise processing of the options. Recent research, by contrast, has highlighted the dynamic and probabilistic nature of intertemporal choice and provided support for attribute-wise processing. Currently, dynamic models of intertemporal choice-which account for both the resulting choice and the time course over which the construction of a choice develops-rely exclusively on the framework of evidence accumulation. In this article, we develop and rigorously compare several candidate schemes for dynamic models of intertemporal choice. Specifically, we consider an existing dynamic modeling scheme based on decision field theory and develop two novel modeling schemes-one assuming lexicographic, noncompensatory processing, and the other built on the classical concepts of random utility in economics and discrimination thresholds in psychophysics. We show that all three modeling schemes can accommodate key behavioral regularities in intertemporal choice. When empirical choice and response time data were fit simultaneously, the models built on random utility and discrimination thresholds performed best. The results also indicated substantial individual differences in the dynamics underlying intertemporal choice. Finally, model recovery analyses demonstrated the benefits of including both choice and response time data for more accurate model selection on the individual level. The present work shows how the classical concept of random utility can be extended to incorporate response dynamics in intertemporal choice. Moreover, the results suggest that this approach offers a successful alternative to the dominating evidence accumulation approach when modeling the dynamics of decision making.

[1]  R. Hertwig,et al.  The priority heuristic: making choices without trade-offs. , 2006, Psychological review.

[2]  Adele Diederich,et al.  Survey of decision field theory , 2002, Math. Soc. Sci..

[3]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[4]  A. Rubinstein International Economic Review " Economics and Psychology " ? the Case of Hyperbolic Discounting * , 2003 .

[5]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[6]  L. Green,et al.  A discounting framework for choice with delayed and probabilistic rewards. , 2004, Psychological bulletin.

[7]  L. Green,et al.  A comparison of four models of delay discounting in humans , 2009, Behavioural Processes.

[8]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[9]  H. J. Einhorn The use of nonlinear, noncompensatory models in decision making. , 1970, Psychological bulletin.

[10]  A. Tversky Intransitivity of preferences. , 1969 .

[11]  H. Stott Cumulative prospect theory's functional menagerie , 2006 .

[12]  Thorsten Pachur,et al.  Intuitive judgments of social statistics : How exhaustive does sampling need to be? , 2013 .

[13]  A. Diederich MDFT account of decision making under time pressure , 2003, Psychonomic Bulletin & Review.

[14]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[15]  D. McFadden Conditional logit analysis of qualitative choice behavior , 1972 .

[16]  R. Thaler Some empirical evidence on dynamic inconsistency , 1981 .

[17]  J. Busemeyer,et al.  Extending the Bounds of Rationality: Evidence and Theories of Preferential Choice , 2006 .

[18]  D. Read Is Time-Discounting Hyperbolic or Subadditive? , 2001 .

[19]  Selin A. Malkoc,et al.  Discounting Time and Time Discounting: Subjective Time Perception and Intertemporal Preferences , 2008 .

[20]  Frederick Mosteller,et al.  An Experimental Measurement of Utility , 1951, Journal of Political Economy.

[21]  Lael J. Schooler,et al.  Strategies for memory-based decision making: Modeling behavioral and neural signatures within a cognitive architecture , 2016, Cognition.

[22]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[23]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[24]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[25]  J. Doyle,et al.  Survey of Time Preference, Delay Discounting Models , 2012, Judgment and Decision Making.

[26]  J. Townsend,et al.  Fundamental derivations from decision field theory , 1992 .

[27]  Eric J. Johnson,et al.  Behavioral decision research: A constructive processing perspective. , 1992 .

[28]  J. Marschak,et al.  Experimental Tests of Stochastic Decision Theory , 1957 .

[29]  Taiki Takahashi,et al.  Psychophysics of time perception and valuation in temporal discounting of gain and loss , 2012 .

[30]  Michel Regenwetter,et al.  Choice, preference, and utility: Probabilistic and deterministic representations , 2016 .

[31]  Gretchen B. Chapman,et al.  The magnitude effect: Temporal discount rates and restaurant tips , 1998 .

[32]  I. J. Myung,et al.  Applying Occam’s razor in modeling cognition: A Bayesian approach , 1997 .

[33]  J. Rieskamp The probabilistic nature of preferential choice. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[34]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[35]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[36]  G. Loewenstein,et al.  Time Discounting and Time Preference: A Critical Review , 2002 .

[37]  P. Samuelson A Note on Measurement of Utility , 1937 .

[38]  K. Lancaster A New Approach to Consumer Theory , 1966, Journal of Political Economy.

[39]  R. Ratcliff,et al.  Sequential Sampling Models in Cognitive Neuroscience: Advantages, Applications, and Extensions. , 2016, Annual review of psychology.

[40]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[41]  H. Rachlin Notes on discounting. , 2006, Journal of the experimental analysis of behavior.

[42]  Taiki Takahashi,et al.  Psychophysics of time perception and intertemporal choice models , 2008 .

[43]  Jonathan W. Leland SIMILARITY JUDGMENTS AND ANOMALIES IN INTERTEMPORAL CHOICE , 2002 .

[44]  Daniel Read,et al.  Weighing Outcomes by Time or Against Time? Evaluation Rules in Intertemporal Choice , 2014, Cogn. Sci..

[45]  G. Loewenstein,et al.  Anomalies in Intertemporal Choice: Evidence and an Interpretation , 1992 .

[46]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[47]  Scott D. Brown,et al.  Diffusion Decision Model: Current Issues and History , 2016, Trends in Cognitive Sciences.

[48]  Daniel Read,et al.  Discounting by Intervals: A Generalized Model of Intertemporal Choice , 2006, Manag. Sci..

[49]  Claudia González-Vallejo,et al.  Attribute-wise vs. alternative-wise mechanism in intertemporal choice: Testing the proportional difference, trade-off, and hyperbolic models. , 2016 .

[50]  Peter H. M. P. Roelofsma,et al.  Subadditive versus hyperbolic discounting: A comparison of choice and matching , 2003 .

[51]  J. Townsend,et al.  Multialternative Decision Field Theory: A Dynamic Connectionist Model of Decision Making , 2001 .

[52]  J. Dana,et al.  Transitivity of preferences. , 2011, Psychological review.

[53]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[54]  Andrew Heathcote,et al.  An introduction to good practices in cognitive modeling , 2015 .

[55]  L. Green,et al.  Rate of temporal discounting decreases with amount of reward , 1997, Memory & cognition.

[56]  R. Nosofsky,et al.  A response-time approach to comparing generalized rational and take-the-best models of decision making. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[57]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[58]  K. Kirby,et al.  Delay-discounting probabilistic rewards: Rates decrease as amounts increase , 1996, Psychonomic bulletin & review.

[59]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .

[60]  L. Schooler,et al.  From perception to preference and on to inference: an approach-avoidance analysis of thresholds. , 2014, Psychological review.

[61]  L. Thurstone A law of comparative judgment. , 1994 .

[62]  R. Ratcliff,et al.  Connectionist and diffusion models of reaction time. , 1999, Psychological review.

[63]  Brandon M. Turner,et al.  Intertemporal Choice as Discounted Value Accumulation , 2014, PloS one.

[64]  A. Diederich,et al.  Conflict and the Stochastic-Dominance Principle of Decision Making , 1999 .

[65]  D. Read,et al.  The Psychology of Intertemporal Tradeoffs , 2009, Psychological review.

[66]  W. Gaissmaier,et al.  Sequential processing of cues in memory-based multiattribute decisions , 2007, Psychonomic bulletin & review.

[67]  A. Glöckner,et al.  What is adaptive about adaptive decision making? A parallel constraint satisfaction account , 2014, Cognition.

[68]  Diederich,et al.  Dynamic Stochastic Models for Decision Making under Time Constraints , 1997, Journal of mathematical psychology.

[69]  Jacob Marschak,et al.  Stochastic models of choice behavior , 2007 .

[70]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[71]  Taiki Takahashi Loss of self-control in intertemporal choice may be attributable to logarithmic time-perception. , 2013, Medical hypotheses.

[72]  J. Busemeyer,et al.  A probabilistic, dynamic, and attribute-wise model of intertemporal choice. , 2014, Journal of experimental psychology. General.