The (Neural) Dynamics of Stochastic Choice

The standard framework for modeling stochastic choice, the random utility model, is agnostic about the temporal dynamics of the decision process. In contrast, a general class of bounded accumulation models from psychology and neuroscience explicitly relate decision times to stochastic choice behavior. This article demonstrates that a random utility model can be derived from the general class of bounded accumulation models, and characterizes how the resulting distribution of random utility depends on response time. This relationship can bias the estimation of structural preference parameters. The bias can be alleviated via the inclusion of standard observables directly in the econometric specification, or through incorporating novel observables such as response time or neurobiological data. Examples of estimating risk and brand preferences are pursued. This paper was accepted by Matthew Shum, marketing.

[1]  D. Wise,et al.  A CONDITIONAL PROBIT MODEL FOR QUALITATIVE CHOICE: DISCRETE DECISIONS RECOGNIZING INTERDEPENDENCE AND HETEROGENEOUS PREFERENCES' , 1978 .

[2]  M. Shadlen,et al.  Decision Making as a Window on Cognition , 2013, Neuron.

[3]  Jean-Claude Falmagne,et al.  A representation theorem for finite random scale systems , 1978 .

[4]  Jochen Ditterich,et al.  New advances in understanding decisions among multiple alternatives , 2012, Current Opinion in Neurobiology.

[5]  A. Shleifer,et al.  Salience and Consumer Choice , 2012, Journal of Political Economy.

[6]  Paulo Natenzon,et al.  Random Choice and Learning , 2019, Journal of Political Economy.

[7]  Michael C. Dorris,et al.  Modeling the Value of Strategic Actions in the Superior Colliculus , 2009, Front. Behav. Neurosci..

[8]  M. Dorris,et al.  A Neural Model of Stochastic Choice in a Mixed Strategy Game , 2013 .

[9]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[10]  P. Glimcher Indeterminacy in brain and behavior. , 2005, Annual review of psychology.

[11]  Colin Camerer,et al.  Transformation of stimulus value signals into motor commands during simple choice , 2011, Proceedings of the National Academy of Sciences.

[12]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[13]  David E. Buschena,et al.  Generalized expected utility, heteroscedastic error, and path dependence in risky choice , 2008 .

[14]  Hongzhi You,et al.  Trading Speed and Accuracy by Coding Time: A Coupled-circuit Cortical Model , 2013, PLoS Comput. Biol..

[15]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[16]  B. Bernheim On the Potential of Neuroeconomics: A Critical (But Hopeful) Appraisal , 2008 .

[17]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[18]  P. Cisek Integrated Neural Processes for Defining Potential Actions and Deciding between Them: A Computational Model , 2006, The Journal of Neuroscience.

[19]  P. Cisek,et al.  Decisions in Changing Conditions: The Urgency-Gating Model , 2009, The Journal of Neuroscience.

[20]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[21]  Alexandre Pouget,et al.  Probabilistic vs. non-probabilistic approaches to the neurobiology of perceptual decision-making , 2012, Current Opinion in Neurobiology.

[22]  C. Stevens Neurotransmitter Release at Central Synapses , 2003, Neuron.

[23]  Nick Chater,et al.  Economic irrationality is optimal during noisy decision making , 2016, Proceedings of the National Academy of Sciences.

[24]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[25]  G. Harrison,et al.  Risk Aversion in the Laboratory , 2008 .

[26]  Michael N. Shadlen,et al.  The Speed and Accuracy of a Simple Perceptual Decision: A Mathematical Primer. , 2007 .

[27]  J. Yellott The relationship between Luce's Choice Axiom, Thurstone's Theory of Comparative Judgment, and the double exponential distribution , 1977 .

[28]  M. Dean What Can Neuroeconomics Tell Us About Economics (and Vice Versa) , 2013 .

[29]  Steven T. Berry,et al.  Automobile Prices in Market Equilibrium , 1995 .

[30]  John A. Clithero Improving Out-of-Sample Predictions Using Response Times and a Model of the Decision Process , 2018 .

[31]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[32]  E. Fehr,et al.  Benefits of neuroeconomic modeling: New policy interventions and predictors of preference , 2014 .

[33]  Dino J. Levy,et al.  Comparing Apples and Oranges: Using Reward-Specific and Reward-General Subjective Value Representation in the Brain , 2011, The Journal of Neuroscience.

[34]  Hans Colonius,et al.  The “horse race” random utility model for choice probabilities and reaction times, and its competing risks interpretation , 1992 .

[35]  Philip L. Smith,et al.  Stochastic Dynamic Models of Response Time and Accuracy: A Foundational Primer. , 2000, Journal of mathematical psychology.

[36]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[37]  Marius Usher,et al.  Disentangling decision models: from independence to competition. , 2013, Psychological review.

[38]  Denzil G. Fiebig,et al.  The Generalized Multinomial Logit Model: Accounting for Scale and Coefficient Heterogeneity , 2010, Mark. Sci..

[39]  A. Rangel,et al.  Visual fixations and the computation and comparison of value in simple choice. , 2010, Nature neuroscience.

[40]  D. McFadden Revealed stochastic preference: a synthesis , 2005 .

[41]  D. McFadden,et al.  MIXED MNL MODELS FOR DISCRETE RESPONSE , 2000 .

[42]  Thomas V. Wiecki,et al.  HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python , 2013, Front. Neuroinform..

[43]  Robert Sugden,et al.  Incorporating a stochastic element into decision theories , 1995 .

[44]  Richard P. Heitz,et al.  Neural Mechanisms of Speed-Accuracy Tradeoff , 2012, Neuron.

[45]  H. D. Block,et al.  Random Orderings and Stochastic Theories of Responses (1960) , 1959 .

[46]  Anders Ledberg,et al.  Neurobiological Models of Two-Choice Decision Making Can Be Reduced to a One-Dimensional Nonlinear Diffusion Equation , 2008, PLoS Comput. Biol..

[47]  Ryan Webb,et al.  Adaptive neural coding: from biological to behavioral decision-making , 2015, Current Opinion in Behavioral Sciences.

[48]  Xiao-Jing Wang,et al.  Similarity Effect and Optimal Control of Multiple-Choice Decision Making , 2008, Neuron.

[49]  R. Spiegler COMMENTS ON THE POTENTIAL SIGNIFICANCE OF NEUROECONOMICS FOR ECONOMIC THEORY , 2008, Economics and Philosophy.

[50]  M. Shadlen,et al.  Choice Certainty Is Informed by Both Evidence and Decision Time , 2014, Neuron.

[51]  Peter E. Rossi,et al.  Bayesian Statistics and Marketing , 2005 .

[52]  Andrew Caplin,et al.  Revealed Preference, Rational Inattention, and Costly Information Acquisition , 2014 .

[53]  Antonio Rangel,et al.  Neural Activity Reveals Preferences Without Choices , 2013, American economic journal. Microeconomics.

[54]  P. Holmes,et al.  The dynamics of choice among multiple alternatives , 2006 .

[55]  Marius Usher,et al.  Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[56]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[57]  Clintin P Davis-Stober,et al.  Recasting a biologically motivated computational model within a Fechnerian and random utility framework. , 2017, Journal of mathematical psychology.

[58]  Ifat Levy,et al.  Neural Random Utility : Relating Cardinal Neural Observables to Stochastic Choice Behaviour , 2019 .

[59]  Etienne Koechlin,et al.  The Neuro-Computational Architecture of Value-Based Selection in the Human Brain , 2017, Cerebral cortex.

[60]  Jacob Marschak,et al.  Stochastic models of choice behavior , 2007 .

[61]  Timothy D. Hanks,et al.  Bounded Integration in Parietal Cortex Underlies Decisions Even When Viewing Duration Is Dictated by the Environment , 2008, The Journal of Neuroscience.

[62]  R. Batley On Ordinal Utility, Cardinal Utility and Random Utility , 2008 .

[63]  P. Glimcher,et al.  Rationalizing Context-Dependent Preferences: Divisive Normalization and Neurobiological Constraints on Choice , 2016 .

[64]  N. Wilcox Stochastic models for binary discrete choice under risk: a critical primer and econometric comparison , 2008 .

[65]  G. Harrison NEUROECONOMICS: A CRITICAL RECONSIDERATION , 2008, Economics and Philosophy.

[66]  J. Griffiths The Theory of Stochastic Processes , 1967 .

[67]  N. Wilcox Stochastically more risk averse: A contextual theory of stochastic discrete choice under risk , 2011 .

[68]  Christof Koch,et al.  The drift diffusion model can account for value-based choice response times under high and low time pressure , 2010 .

[69]  Vaibhav Srivastava,et al.  A martingale analysis of first passage times of time-dependent Wiener diffusion models. , 2015, Journal of mathematical psychology.

[70]  J. Dagsvik How large is the class of generalized extreme value random utility models , 1995 .

[71]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[72]  M. Woodford Optimal Evidence Accumulation and Stochastic Choice , 2016 .

[73]  M. Dean,et al.  How can neuroscience inform economics? , 2015, Current Opinion in Behavioral Sciences.

[74]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[75]  Jochen Ditterich,et al.  Perceptual Decisions between Multiple Directions of Visual Motion , 2008, The Journal of Neuroscience.

[76]  M. Shadlen,et al.  Decision Making and Sequential Sampling from Memory , 2016, Neuron.

[77]  Timothy L. Mullett,et al.  Implications of Visual Attention Phenomena for Models of Preferential Choice , 2016, Decision.

[78]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[79]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[80]  A. Pouget,et al.  The Cost of Accumulating Evidence in Perceptual Decision Making , 2012, The Journal of Neuroscience.

[81]  Steven Berry,et al.  Identification in Differentiated Products Markets Using Market Level Data , 2010 .

[82]  Philip A. Haile,et al.  On the Empirical Content of Quantal Response Equilibrium , 2003 .

[83]  N. Chater,et al.  Preference reversal in multiattribute choice. , 2010, Psychological review.

[84]  R. Nagel,et al.  Search Dynamics in Consumer Choice under Time Pressure: An Eye-Tracking Study , 2011 .

[85]  Rubén Moreno-Bote,et al.  Decision Confidence and Uncertainty in Diffusion Models with Partially Correlated Neuronal Integrators , 2010, Neural Computation.

[86]  Pietro Ortoleva,et al.  Stochastic Choice and Preferences for Randomization , 2015, Journal of Political Economy.

[87]  Charles A. Holt,et al.  Risk Aversion and Incentive Effects , 2002 .

[88]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[89]  A. Rangel,et al.  Informatic parcellation of the network involved in the computation of subjective value. , 2014, Social cognitive and affective neuroscience.

[90]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[91]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[92]  Xiao-Jing Wang Decision Making in Recurrent Neuronal Circuits , 2008, Neuron.

[93]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[94]  John D. Hey,et al.  Why We Should Not Be Silent About Noise , 2005, Experiments in Economics.

[95]  Timothy D. Hanks,et al.  Elapsed Decision Time Affects the Weighting of Prior Probability in a Perceptual Decision Task , 2011, The Journal of Neuroscience.

[96]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[97]  F. Christian How the Brain Integrates Costs and Benefits During Decision Making , 2010 .

[98]  Marius Usher,et al.  Using Time-Varying Evidence to Test Models of Decision Dynamics: Bounded Diffusion vs. the Leaky Competing Accumulator Model , 2012, Front. Neurosci..

[99]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[100]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[101]  D. McFadden Conditional logit analysis of qualitative choice behavior , 1972 .

[102]  A. Rubinstein Response time and decision making: An experimental study , 2013, Judgment and Decision Making.

[103]  Colin Camerer,et al.  Violations of the betweenness axiom and nonlinearity in probability , 1994 .

[104]  Jochen Ditterich,et al.  A Comparison between Mechanisms of Multi-Alternative Perceptual Decision Making: Ability to Explain Human Behavior, Predictions for Neurophysiology, and Relationship with Decision Theory , 2010, Front. Neurosci..

[105]  Gideon Nave,et al.  Extrapolative Beliefs in Perceptual and Economic Decisions: Evidence of a Common Mechanism , 2016, Manag. Sci..

[106]  J. Hey,et al.  INVESTIGATING GENERALIZATIONS OF EXPECTED UTILITY THEORY USING EXPERIMENTAL DATA , 1994, Experiments in Economics.

[107]  Robert Kohn,et al.  Dissecting the Random Component of Utility , 2002 .

[108]  Graham Loomes,et al.  Modelling the Stochastic Component of Behaviour in Experiments: Some Issues for the Interpretation of Data , 2005 .

[109]  Miguel A. Ballester,et al.  Monotone Stochastic Choice Models: The Case of Risk and Time Preferences , 2015, Journal of Political Economy.

[110]  J. Townsend,et al.  Fundamental derivations from decision field theory , 1992 .

[111]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[112]  Leland S Stone,et al.  Saccadic brightness decisions do not use a difference model. , 2013, Journal of vision.

[113]  Joel Sobel Neuroeconomics: A Comment on Bernheim , 2009 .

[114]  R. McKelvey,et al.  Quantal Response Equilibria for Normal Form Games , 1995 .

[115]  A. Rangel,et al.  Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions , 2011, Proceedings of the National Academy of Sciences.

[116]  John D. Hey,et al.  Experimental Investigations of Errors in Decision Making under Risk Experimental investigations of errors in decision making under risk , 1995 .

[117]  M. Woodford Stochastic Choice: An Optimizing Neuroeconomic Model , 2014 .

[118]  O. Prospero-Garcia,et al.  Reliability of Spike Timing in Neocortical Neurons , 1995 .

[119]  J. Falmagne Elements of psychophysical theory , 1985 .

[120]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[121]  Joseph W. Kable,et al.  The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value , 2013, NeuroImage.