Combining Response Times and Choice Data Using A Neuroeconomic Model of the Decision Process Improves Out-of-Sample Predictions ∗

A basic problem in empirical economics involves using data from one domain to make out-of-sample predictions for a different, but related environment. When the choice data are binary, a canonical method for making these types of predictions is the logistic choice model. We investigate if it is possible to improve out-of-sample predictions by changing two aspects of the canonical approach: 1) Using response times in addition to the choice data, and 2) Combining them using a model from the neuroeconomics literature, called the Drift-Diffusion Model (DDM). We compare the out-of-sample prediction accuracies of both methods using both simulations and real experimental data. In both cases we find that the DDM method outperforms the logistic prediction method. Furthermore, although the improvement in prediction accuracy is small for the case in which items have very similar or very different values, the DDM method improves prediction accuracy substantially for intermediate cases. JEL Classification: C9, D03, D87

[1]  Colin Camerer,et al.  Transformation of stimulus value signals into motor commands during simple choice , 2011, Proceedings of the National Academy of Sciences.

[2]  Colin Camerer,et al.  Dynamic Construction of Stimulus Values in the Ventromedial Prefrontal Cortex , 2011, PloS one.

[3]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[4]  Faruk Gul,et al.  The Case for Mindless Economics , 2005 .

[5]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[6]  Michael Woodford,et al.  Prospect Theory as Efficient Perceptual Distortion , 2012 .

[7]  A. Rangel,et al.  Visual fixations and the computation and comparison of value in simple choice. , 2010, Nature neuroscience.

[8]  P. Glimcher,et al.  MEASURING BELIEFS AND REWARDS: A NEUROECONOMIC APPROACH. , 2010, The quarterly journal of economics.

[9]  Colin Camerer,et al.  The Attentional Drift-Diffusion Model Extends to Simple Purchasing Decisions , 2012, Front. Psychology.

[10]  M. Dean What Can Neuroeconomics Tell Us About Economics (and Vice Versa) , 2013 .

[11]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[12]  N. Wilcox Lottery choice: incentives, complexity and decision time , 1993 .

[13]  James T. Townsend,et al.  Building bridges between neural models and complex decision making behaviour , 2006, Neural Networks.

[14]  C. White,et al.  Perceptual Criteria in the Human Brain , 2012, The Journal of Neuroscience.

[15]  Filip Matejka,et al.  Rational Inattention to Discrete Choices: A New Foundation for the Multinomial Logit Model , 2011 .

[16]  M. Woodford Inattentive Valuation and Reference-Dependent Choice ∗ , 2012 .

[17]  M. Stone Models for choice-reaction time , 1960 .

[18]  Christof Koch,et al.  Consumers can make decisions in as little as a third of a second , 2011, Judgment and Decision Making.

[19]  Antonio Rangel,et al.  The Decision Value Computations in the vmPFC and Striatum Use a Relative Value Code That is Guided by Visual Attention , 2011, The Journal of Neuroscience.

[20]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[21]  Ryan K. Jessup,et al.  Feedback Produces Divergence From Prospect Theory in Descriptive Choice , 2008, Psychological science.

[22]  B. Bernheim On the Potential of Neuroeconomics: A Critical (But Hopeful) Appraisal , 2008 .

[23]  ROBERT S. MOYER,et al.  Time required for Judgements of Numerical Inequality , 1967, Nature.

[24]  D. McFadden Conditional logit analysis of qualitative choice behavior , 1972 .

[25]  A. Rangel,et al.  The Computation of Stimulus Values in Simple Choice , 2014 .

[26]  P. Cisek,et al.  Decisions in Changing Conditions: The Urgency-Gating Model , 2009, The Journal of Neuroscience.

[27]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[28]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[29]  R. Bogacz Optimal decision-making theories: linking neurobiology with behaviour , 2007, Trends in Cognitive Sciences.

[30]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[31]  Colin F. Camerer,et al.  Pinocchio's Pupil: Using Eyetracking and Pupil Dilation To Understand Truth-telling and Deception in Games , 2006 .

[32]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[33]  A. Shleifer,et al.  Salience and Consumer Choice , 2012, Journal of Political Economy.

[34]  E. Fehr,et al.  Neuroeconomic Foundations of Economic Choice—Recent Advances , 2011 .

[35]  F. Christian How the Brain Integrates Costs and Benefits During Decision Making , 2010 .

[36]  S Dehaene,et al.  The psychophysics of numerical comparison: A reexamination of apparently incompatible data , 1989, Perception & psychophysics.

[37]  A. Rubinstein Response time and decision making: An experimental study , 2013, Judgment and Decision Making.

[38]  P. Glimcher,et al.  Choice from Non-Choice: Predicting Consumer Preferences from Blood Oxygenation Level-Dependent Signals Obtained during Passive Viewing , 2011, The Journal of Neuroscience.

[39]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[40]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[41]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[42]  A. Rustichini Is There a Method of Neuroeconomics , 2009 .

[43]  A. Rubinstein Instinctive and Cognitive Reasoning: A Study of Response Times , 2006 .

[44]  J. Ditterich Evidence for time‐variant decision making , 2006, The European journal of neuroscience.

[45]  M. Shadlen,et al.  The effect of stimulus strength on the speed and accuracy of a perceptual decision. , 2005, Journal of vision.

[46]  David S. Ahn,et al.  Preference for Flexibility and Random Choice , 2013 .

[47]  R. Nagel,et al.  Search Dynamics in Consumer Choice under Time Pressure: An Eye-Tracking Study , 2011 .

[48]  Isabelle Brocas,et al.  Information processing and decision-making: Evidence from the brain sciences and implications for economics☆ , 2012 .

[49]  J. Haynes,et al.  Neural Responses to Unattended Products Predict Later Consumer Choices , 2010, The Journal of Neuroscience.

[50]  Marius Usher,et al.  Disentangling decision models: from independence to competition. , 2013, Psychological review.

[51]  D. McFadden MEASUREMENT OF URBAN TRAVEL DEMAND , 1974 .

[52]  A. Rangel,et al.  Informatic parcellation of the network involved in the computation of subjective value. , 2014, Social cognitive and affective neuroscience.

[53]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[54]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[55]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[56]  J. Busemeyer,et al.  Extending the Bounds of Rationality: Evidence and Theories of Preferential Choice , 2006 .

[57]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[59]  Antonio Rangel,et al.  Neural Activity Reveals Preferences Without Choices , 2013, American economic journal. Microeconomics.

[60]  D. Fudenberg,et al.  Recursive Stochastic Choice , 2013 .

[61]  Andrew Caplin,et al.  A Testable Theory of Imperfect Perception , 2011 .

[62]  P. Glimcher Foundations of Neuroeconomic Analysis , 2010 .

[63]  Christof Koch,et al.  Fast saccades toward numbers: simple number comparisons can be made in as little as 230 ms. , 2011, Journal of vision.

[64]  Faruk Gul,et al.  Random Choice as Behavioral Optimization , 2014 .

[65]  Andrew Caplin,et al.  Naive play and the process of choice in guessing games , 2015 .

[66]  A. Schotter,et al.  Is response time predictive of choice? An experimental study of threshold strategies , 2020 .

[67]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[68]  A. Rangel,et al.  Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions , 2011, Proceedings of the National Academy of Sciences.

[69]  R. Ratcliff,et al.  Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability , 2002, Psychonomic bulletin & review.

[70]  Christof Koch,et al.  The Drift Diffusion Model Can Account for the Accuracy and Reaction Time of Value-Based Choices Under High and Low Time Pressure , 2010, Judgment and Decision Making.

[71]  J. Rieskamp,et al.  Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain , 2012, The Journal of Neuroscience.

[72]  P. Glimcher,et al.  The Neurobiology of Decision: Consensus and Controversy , 2009, Neuron.

[73]  Colin Camerer Goals, Methods, and Progress in Neuroeconomics , 2013 .

[74]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[75]  A. Rangel,et al.  Biasing simple choices by manipulating relative visual attention , 2008, Judgment and Decision Making.

[76]  Michael N. Shadlen,et al.  The Speed and Accuracy of a Simple Perceptual Decision: A Mathematical Primer. , 2007 .

[77]  David G. Rand,et al.  Spontaneous giving and calculated greed , 2012, Nature.

[78]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[79]  C. Chabris,et al.  Measuring Intertemporal Preferences Using Response Times , 2008 .

[80]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[81]  Ayala Arad,et al.  Multi-dimensional iterative reasoning in action: The case of the Colonel Blotto game , 2012 .

[82]  Scott A. Huettel,et al.  Translating upwards: linking the neural and social sciences via neuroeconomics , 2012, Nature Reviews Neuroscience.

[83]  Thomas V. Wiecki,et al.  Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold , 2011, Nature Neuroscience.

[84]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[85]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .