Speed, Accuracy, and the Optimal Timing of Choices

We model the joint distribution of choice probabilities and decision times in binary decisions as the solution to a problem of optimal sequential sampling, where the agent is uncertain of the utility of each action and pays a constant cost per unit time for gathering information. We show that choices are more likely to be correct when the agent chooses to decide quickly, provided the agent’s prior beliefs are correct. This better matches the observed correlation between decision time and choice probability than does the classical drift-diffusion model (DDM), where the agent knows the utility difference between the choices. (JEL C41, D11, D12, D83)

[1]  Colin Camerer,et al.  The Attentional Drift-Diffusion Model Extends to Simple Purchasing Decisions , 2012, Front. Psychology.

[2]  J. Andel.  Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[3]  Nigel Harvey,et al.  Blackwell Handbook of Judgment and Decision Making , 2004 .

[4]  J. A. Bather,et al.  Bayes procedures for deciding the Sign of a normal mean , 1962 .

[5]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[6]  Anna Popova,et al.  Experimental evidence on rational inattention , 2011 .

[7]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[8]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[9]  Sydney E. Scott,et al.  Why does the Cognitive Reflection Test (sometimes) predict utilitarian moral judgment (and other things) , 2015 .

[10]  J. Miguel Villas-Boas,et al.  Search for Information on Multiple Products , 2015, Manag. Sci..

[11]  John D. Hey.  Does Repetition Improve Consistency , 2001 .

[12]  John D. Hey,et al.  Experimental Investigations of Errors in Decision Making under Risk Experimental investigations of errors in decision making under risk , 1995 .

[13]  Ernst Fehr,et al.  Rethinking fast and slow based on a critique of reaction-time reverse inference , 2015, Nature Communications.

[14]  Christof Koch,et al.  The drift diffusion model can account for value-based choice response times under high and low time pressure , 2010 .

[15]  R. Nagel,et al.  Search Dynamics in Consumer Choice under Time Pressure: An Eye-Tracking Study , 2011 .

[16]  J. Townsend,et al.  Fundamental derivations from decision field theory , 1992 .

[17]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[18]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[19]  David G. Rand,et al.  Spontaneous giving and calculated greed , 2012, Nature.

[20]  E. Fehr,et al.  Neuroeconomic Foundations of Economic Choice—Recent Advances , 2011 .

[21]  John D. Hey.  Does Repetition Improve Consistency? , 2001 .

[22]  M. A. Girshick,et al.  Bayes and minimax solutions of sequential decision problems , 1949 .

[23]  Michael N. Shadlen,et al.  The Speed and Accuracy of a Simple Perceptual Decision: A Mathematical Primer. , 2007 .

[24]  A. Pouget,et al.  The Cost of Accumulating Evidence in Perceptual Decision Making , 2012, The Journal of Neuroscience.

[25]  M. Yor,et al.  Continuous martingales and Brownian motion , 1990 .

[26]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[27]  Yeon-Koo Che,et al.  Optimal Sequential Decision with Limited Attention∗ , 2016 .

[28]  Rahul Bhui.  A statistical test for the optimality of deliberative time allocation , 2019, Psychonomic Bulletin & Review.

[29]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[30]  Peter I. Frazier,et al.  Sequential Hypothesis Testing under Stochastic Deadlines , 2007, NIPS.

[31]  Paulo Natenzon,et al.  Random Choice and Learning , 2019, Journal of Political Economy.

[32]  Ehtibar N Dzhafarov,et al.  Unfalsifiability and mutual translatability of major modeling schemes for choice reaction time. , 2014, Psychological review.

[33]  Philipp Strack,et al.  Optimal Stopping with Private Information , 2014, J. Econ. Theory.

[34]  Drew Fudenberg,et al.  Stochastic Choice and Revealed Perturbed Utility , 2015 .

[35]  R. Ratcliff,et al.  Multialternative decision field theory: a dynamic connectionist model of decision making. , 2001, Psychological review.

[36]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[37]  P. Moerbeke.  On optimal stopping and free boundary problems , 1973, Advances in Applied Probability.

[38]  S. Frederick.  Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 25–42 Cognitive Reflection and Decision Making , 2022 .

[39]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Normal-Form Games: An Experimental Study , 1998 .

[40]  S. Link,et al.  A sequential theory of psychological discrimination , 1975 .

[41]  D. Vickers,et al.  Evidence for an accumulator model of psychophysical discrimination. , 1970, Ergonomics.

[42]  Thomas L. Griffiths,et al.  One and Done? Optimal Decisions From Very Few Samples , 2014, Cogn. Sci..

[43]  A. Rubinstein.  Instinctive and Cognitive Reasoning: A Study of Response Times , 2006 .

[44]  Jochen Ditterich,et al.  Stochastic models of decisions about motion direction: Behavior and physiology , 2006, Neural Networks.

[45]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[46]  W. Edwards.  Optimal strategies for seeking information: Models for statistics, choice reaction times, and human information processing ☆ , 1965 .

[47]  Antonio Rangel,et al.  Combining Response Times and Choice Data Using A Neuroeconomic Model of the Decision Process Improves Out-of-Sample Predictions ∗ , 2013 .

[48]  R. M. Dudley,et al.  Real Analysis and Probability , 1989 .

[49]  Eric J. Johnson,et al.  Detecting Failures of Backward Induction: Monitoring Information Search in Sequential Bargaining , 2002, J. Econ. Theory.

[50]  Jerome R. Busemeyer,et al.  Computational Models of Decision Making , 2003 .

[51]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Optimal stopping rules , 1977 .

[52]  Michael Woodford,et al.  An Optimizing Neuroeconomic Model of Discrete Choice , 2014 .

[53]  David I. Laibson,et al.  Bounded Rationality and Directed Cognition , 2005 .

[54]  Annie Liang,et al.  Dynamic Information Acquisition from Multiple Sources , 2017, 1703.06367.

[55]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[56]  N. Wilcox,et al.  Decisions, Error and Heterogeneity , 1997 .

[57]  J. Miguel Villas-Boas,et al.  Optimal Learning Before Choice , 2018, J. Econ. Theory.

[58]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[59]  Andrew Caplin,et al.  Search, choice, and revealed preference , 2011 .

[60]  Alexander Kukush,et al.  Statistics of stochastic processes , 2010 .

[61]  M. Stone.  Models for choice-reaction time , 1960 .

[62]  Colin Camerer.  An experimental test of several generalized utility theories , 1989 .

[63]  Wim De Neys,et al.  The Doubting System 1: Evidence for automatic substitution sensitivity. , 2016, Acta psychologica.

[64]  A. Rangel,et al.  Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions , 2011, Proceedings of the National Academy of Sciences.

[65]  Herman Chernoff,et al.  Sequential Tests for the Mean of a Normal Distribution , 1965 .

[66]  Christof Koch,et al.  The Drift Diffusion Model Can Account for the Accuracy and Reaction Time of Value-Based Choices Under High and Low Time Pressure , 2010, Judgment and Decision Making.

[67]  Jörg Rieskamp,et al.  Models of Deferred Decision Making , 2014, CogSci.

[68]  Michael Woodford,et al.  Rational Inattention with Sequential Information Sampling∗ , 2016 .

[69]  Jay Lu,et al.  Random Choice and Private Information , 2014 .

[70]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[71]  Albert N. Shiryaev,et al.  Optimal Stopping Rules , 2011, International Encyclopedia of Statistical Science.

[72]  J. Miguel Villas-Boas,et al.  Optimal Search for Product Information , 2010, Manag. Sci..

[73]  Richard G. Swensson,et al.  The elusive tradeoff: Speed vs accuracy in visual discrimination tasks , 1972 .

[74]  M. Shadlen,et al.  Decision Making as a Window on Cognition , 2013, Neuron.

[75]  Andrew Caplin,et al.  The Dual‐Process Drift Diffusion Model: Evidence from Response Times , 2016 .

[76]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Optimal Stopping and Free-Boundary Problems , 2006 .

[77]  Colin Camerer,et al.  Imperfect Choice or Imperfect Attention? Understanding Strategic Thinking in Private Information Games , 2014 .

[78]  Jay Lu,et al.  Random Choice and Private Information , 2016 .

[79]  Drew Fudenberg,et al.  Stochastic Choice and Optimal Sequential Sampling , 2015, 1505.03342.

[80]  Philipp Strack,et al.  Inverse Optimal Stopping , 2015 .