The dual accumulator model of strategic deliberation and decision making.

What are the mental operations involved in game theoretic decision making? How do players deliberate (intelligently, but perhaps imperfectly) about strategic interdependencies and ultimately decide on a strategy? We address these questions using an evidence accumulation model, with bidirectional connections between preferences for the strategies available to the decision maker and beliefs regarding the opponent's choices. Our dual accumulator model accounts for a variety of behavioral patterns, including limited iterated reasoning, payoff sensitivity, consideration of risk-reward tradeoffs, and salient label effects, and it provides a good quantitative fit to existing behavioral data. In a comparison with other popular behavioral game theoretic models fit at the individual subject level to choices across a set of games, the dual accumulator model makes the most accurate out-of-sample predictions. Additionally, as a cognitive-process model, it can also be used to make predictions about response time patterns, time pressure effects, and attention during deliberation. Stochastic sampling and dynamic accumulation, cognitive mechanisms foundational to decision making, play a critical role in explaining well-known behavioral patterns as well as in generating novel predictions. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

[1]  Nick Chater,et al.  Virtual bargaining: a theory of social decision-making , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  P. V. Lange,et al.  The pursuit of joint outcomes and equality in outcomes: An integrative model of social value orientation. , 1999 .

[3]  Luca Polonio,et al.  Strategic sophistication and attention in games: An eye-tracking study , 2015, Games Econ. Behav..

[4]  D. Levine Modeling Altruism and Spitefulness in Experiments , 1998 .

[5]  Russell Golman Why learning doesn’t add up: equilibrium selection with a composition of learning rules , 2011, Int. J. Game Theory.

[6]  Giovanna Devetag,et al.  An eye-tracking study of feature-based choice in one-shot games , 2016 .

[7]  Arndt Bröder,et al.  Cognitive processes, models and metaphors in decision research , 2008, Judgment and Decision Making.

[8]  T. Plutchak,et al.  One, two, three.... , 2001, Bulletin of the Medical Library Association.

[9]  Florian Lindner,et al.  Decision time and steps of reasoning in a competitive market entry game , 2013 .

[10]  Jeffrey Paul Carpenter,et al.  Cognitive ability and strategic sophistication , 2013, Games Econ. Behav..

[11]  Kevin Leyton-Brown,et al.  Models of Level-0 Behavior for Predicting Human Behavior in Games , 2016, ArXiv.

[12]  Roberto A. Weber,et al.  The effects of payoff magnitude and heterogeneity on behavior in 2 x 2 games with unique mixed strategy equilibria , 2000 .

[13]  Miguel A. Costa-Gomes,et al.  Comparing Models of Strategic Thinking in Van Huyck, Battalio, and Beil’s Coordination Games , 2009 .

[14]  Andrew Schotter,et al.  Beliefs and Endogenous Cognitive Levels: An Experimental Study , 2012, Games Econ. Behav..

[15]  Ariel Rubinstein,et al.  Naive Strategies in Competitive Games , 1997 .

[16]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[17]  David M. Kreps,et al.  Learning Mixed Equilibria , 1993 .

[18]  Elinor Ostrom,et al.  Playing safe in coordination games: : the roles of risk dominance, payoff dominance, and history of play , 2003, Games Econ. Behav..

[19]  Charles A. Holt,et al.  Regular Quantal Response Equilibrium , 2005 .

[20]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[21]  Briony D. Pulford,et al.  Explaining Strategic Coordination: Cognitive Hierarchy Theory, Strong Stackelberg Reasoning, and Team Reasoning , 2014 .

[22]  Matthias Sutter,et al.  Level-k reasoning and time pressure in the 11-20 money request game , 2013 .

[23]  Takao Noguchi,et al.  Multialternative Decision by Sampling: A Model of Decision Making Constrained by Process Data , 2018, Psychological review.

[24]  Robert L. Goldstone,et al.  Cyclic Game Dynamics Driven by Iterated Reasoning , 2013, PloS one.

[25]  A. Rangel,et al.  Visual fixations and the computation and comparison of value in simple choice. , 2010, Nature neuroscience.

[26]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[27]  V. Crawford,et al.  Fatal Attraction: Focality, Naivete, and Sophistication in Experimental "Hide-and-Seek" Games , 2007 .

[28]  Stefan P. Penczynski,et al.  Out of your mind: Eliciting individual reasoning in one shot games , 2014, Games Econ. Behav..

[29]  A. Rubinstein,et al.  The 11-20 Money Request Game: A Level-k Reasoning Study , 2012 .

[30]  R. Sugden,et al.  The Nature of Salience: An Experimental Investigation of Pure Coordination Games , 1994 .

[31]  Yves Breitmoser,et al.  Strategic reasoning in p-beauty contests , 2012, Games Econ. Behav..

[32]  Jacob K. Goeree,et al.  An experimental study of costly coordination , 2005, Games Econ. Behav..

[33]  John H. Miller,et al.  Polya’s bees: A model of decentralized decision-making , 2015, Science Advances.

[34]  R. McKelvey,et al.  Quantal Response Equilibria for Normal Form Games , 1995 .

[35]  Michael Bacharach,et al.  Beyond Individual Choice: Teams and Frames in Game Theory , 2006 .

[36]  ปิยดา สมบัติวัฒนา Behavioral Game Theory: Experiments in Strategic Interaction , 2013 .

[37]  Sudeep Bhatia Sequential sampling and paradoxes of risky choice , 2014, Psychonomic Bulletin & Review.

[38]  Jonathan Evans Hypothetical Thinking: Dual Processes in Reasoning and Judgement , 2007 .

[39]  Colin Camerer Behavioural studies of strategic thinking in games , 2003, Trends in Cognitive Sciences.

[40]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Normal-Form Games: An Experimental Study , 1998 .

[41]  J. Taylor,et al.  Playing safe? , 1989, Nursing times.

[42]  D. Marchiori,et al.  Predicting Human Interactive Learning by Regret-Driven Neural Networks , 2008, Science.

[43]  R. Selten,et al.  Stationary Concepts for Experimental 2x2 Games , 2008 .

[44]  D. Stahl,et al.  Level-n bounded rationality and dominated strategies in normal-form games , 2008 .

[45]  Colin Camerer,et al.  Iterated Dominance and Iterated Best-Response in Experimental P-Beauty Contests , 1998 .

[46]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[47]  R. McKelvey,et al.  An experimental study of the centipede game , 1992 .

[48]  J. Townsend,et al.  Multialternative Decision Field Theory: A Dynamic Connectionist Model of Decision Making , 2001 .

[49]  Howard Raiffa,et al.  Games and Decisions: Introduction and Critical Survey. , 1958 .

[50]  Sudeep Bhatia,et al.  Associations and the accumulation of preference. , 2013, Psychological review.

[51]  Russell Golman,et al.  Bidirectional constraint satisfaction in rational strategic decision making , 2019, Journal of Mathematical Psychology.

[52]  Jacob K. Goeree,et al.  Minimum-Effort Coordination Games: Stochastic Potential and Logit Equilibrium , 2001, Games Econ. Behav..

[53]  Robert Forsythe,et al.  COMMUNICATION IN THE BATTLE OF THE SEXES GAME , 1989 .

[54]  K. Holyoak,et al.  Bidirectional reasoning in decision making by constraint satisfaction , 1999 .

[55]  Keith J. Holyoak,et al.  PSYCHOLOGICAL SCIENCE Research Article Construction of Preferences by Constraint Satisfaction , 2022 .

[56]  Colin Camerer,et al.  Cognitive Hierarchies and Emotions in Behavioral Game Theory , 2012 .

[57]  J. Krueger,et al.  Evidential reasoning in the prisoner's dilemma. , 2005, The American journal of psychology.

[58]  J. Krueger From social projection to social behaviour , 2007 .

[59]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[60]  Diana L. Young,et al.  Levels of theory-of-mind reasoning in competitive games , 2012 .

[61]  D. Sgroi,et al.  Learning to play 3×3 games: Neural networks as bounded-rational players , 2009 .

[62]  A. Rubinstein Instinctive and Cognitive Reasoning: A Study of Response Times , 2006 .

[63]  Jacob K. Goeree,et al.  Rent Seeking with Bounded Rationality: An Analysis of the All‐Pay Auction , 1998, Journal of Political Economy.

[64]  Jerome R. Busemeyer,et al.  Computational Models of Decision Making , 2003 .

[65]  John C. Harsanyi,et al.  Общая теория выбора равновесия в играх / A General Theory of Equilibrium Selection in Games , 1989 .

[66]  Andrew Heathcote,et al.  The multiattribute linear ballistic accumulator model of context effects in multialternative choice. , 2014, Psychological review.

[67]  Jun Zhang,et al.  Perspective-Taking and Depth of Theory-of-Mind Reasoning in Sequential-Move Games , 2012, Cogn. Sci..

[68]  Roger Ratcliff,et al.  A diffusion model account of the lexical decision task. , 2004, Psychological review.

[69]  Matthias Sutter,et al.  Time is Money - Time Pressure, Incentives, and the Quality of Decision-Making , 2004 .

[70]  Robert Sugden,et al.  How Portable Is Level-0 Behavior? A Test of Level-k Theory in Games With Non-Neutral Frames , 2014 .

[71]  Timothy L. Mullett,et al.  Eye Movements in Strategic Choice , 2015, Journal of behavioral decision making.

[72]  Kaushik Basu,et al.  The traveler's dilemma: Paradoxes of rationality in game theory , 1994 .

[73]  Magnus Johannesson,et al.  Higher cognitive ability is associated with lower entries in a p-beauty contest , 2009 .

[74]  Robert Forsythe,et al.  Forward Induction in the Battle-of-the-Sexes Games , 1993 .

[75]  Rajiv Sethi,et al.  Nash Equilibrium , 2016, Encyclopedia of Systems and Control.

[76]  Thomas R. Palfrey,et al.  Heterogeneous quantal response equilibrium and cognitive hierarchies , 2006, J. Econ. Theory.

[77]  Konstantinos Tsetsos,et al.  Competing Theories of Multialternative, Multiattribute Preferential Choice , 2017, Psychological review.

[78]  M. Bacharach,et al.  PAYOFF DOMINANCE AND THE STACKELBERG HEURISTIC , 1997 .

[79]  David Gill,et al.  Cognitive Ability, Character Skills, and Learning to Play Equilibrium: A Level-k Analysis , 2014, Journal of Political Economy.

[80]  Joel A. C. Baum,et al.  What Do You Think I Think You Think about It , 2014 .

[81]  T. Schelling,et al.  The Strategy of Conflict. , 1961 .

[82]  R. Hertwig,et al.  The priority heuristic: making choices without trade-offs. , 2006, Psychological review.

[83]  Miguel A. Costa-Gomes,et al.  Structural Models of Nonequilibrium Strategic Thinking: Theory, Evidence, and Applications , 2013 .

[84]  Charles A. Holt,et al.  Ten Little Treasures of Game Theory and Ten Intuitive Contradictions , 2001 .

[85]  Colin F. Camerer,et al.  Behavioral Game Theory and the Neural Basis of Strategic Choice , 2009 .

[86]  Paul G. Straub Risk dominance and coordination failures in static games , 1995 .

[87]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[88]  Roberto A. Weber,et al.  On the Persistence of Strategic Sophistication , 2014, J. Econ. Theory.

[89]  Rosemarie Nagel,et al.  One, Two, (Three), Infinity: Newspaper and Lab Beauty-Contest Experiments , 2000 .

[90]  T. Hedden,et al.  What do you think I think you think?: Strategic reasoning in matrix games , 2002, Cognition.

[91]  Graham Loomes,et al.  Variability, Noise, and Error in Decision Making Under Risk , 2015 .

[92]  M. Rabin,et al.  Understanding Social Preference with Simple Tests , 2001 .

[93]  Colin Camerer,et al.  Cognition and framing in sequential bargaining for gains and losses , 1993 .

[94]  J. Huyck,et al.  Tacit Coordination Games, Strategic Uncertainty, and Coordination Failure , 1990 .

[95]  Sergiu Hart,et al.  Games in extensive and strategic forms , 1992 .

[96]  A. Rangel,et al.  Value normalization in decision making: theory and evidence , 2012, Current Opinion in Neurobiology.

[97]  Dale O. Stahl,et al.  Level-n bounded rationality in two-player two-stage games , 2008 .

[98]  Drew Fudenberg,et al.  Speed, Accuracy, and the Optimal Timing of Choices , 2018, American Economic Review.

[99]  A. Colman Cooperation, psychological game theory, and limitations of rationality in social interaction , 2003, Behavioral and Brain Sciences.

[100]  Gideon Nave,et al.  Extrapolative Beliefs in Perceptual and Economic Decisions: Evidence of a Common Mechanism , 2016, Manag. Sci..

[101]  A. Terracol,et al.  Beliefs and (in)stability in normal-form games , 2013, Experimental Economics.

[102]  Brit Grosskopf,et al.  The two-person beauty contest , 2008, Games Econ. Behav..

[103]  Jörg Rieskamp,et al.  Perspectives of probabilistic inferences: Reinforcement learning and an adaptive network compared. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[104]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[105]  Ronald M. Harstad,et al.  Information Impact and Allocation Rules in Auctions with Affiliated Private Values: A Laboratory Study , 1987 .

[106]  D. Stahl,et al.  Experimental evidence on players' models of other players , 1994 .

[107]  R. Nosofsky,et al.  An exemplar-based random walk model of speeded classification. , 1997, Psychological review.

[108]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[109]  D. Stahl,et al.  On Players' Models of Other Players: Theory and Experimental Evidence , 1995 .

[110]  Colin Camerer,et al.  Imperfect Choice or Imperfect Attention? Understanding Strategic Thinking in Private Information Games , 2014 .

[111]  John A. Clithero Improving Out-of-Sample Predictions Using Response Times and a Model of the Decision Process , 2018 .

[112]  Charles A. Holt,et al.  Anomalous Behavior in a Traveler's Dilemma? , 1999 .

[113]  Maya Bar-Hillel,et al.  Position Effects in Choice From Simultaneous Displays , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[114]  J. Busemeyer,et al.  A probabilistic, dynamic, and attribute-wise model of intertemporal choice. , 2014, Journal of experimental psychology. General.

[115]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[116]  Sudeep Bhatia,et al.  The dynamics of deferred decision , 2016, Cognitive Psychology.

[117]  Sudeep Bhatia The dynamics of bidirectional thought , 2016 .

[118]  Russell Golman Homogeneity bias in models of discrete choice with bounded rationality , 2012 .

[119]  R. Aumann,et al.  Unraveling in Guessing Games : An Experimental Study , 2007 .

[120]  T. Schelling The Strategy of Conflict , 1963 .

[121]  Theresa E. DiDonato,et al.  Social Projection Can Solve Social Dilemmas , 2012 .

[122]  D. Stahl,et al.  Equilibrium selection and bounded rationality in symmetric normal-form games , 2007 .

[123]  J K Goeree,et al.  Stochastic game theory: for playing games, not just for doing theory. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[124]  Jerome R. Busemeyer,et al.  DFT-D: a cognitive-dynamical model of dynamic decision making , 2012, Synthese.

[125]  Andrew Caplin,et al.  Naive play and the process of choice in guessing games , 2015 .

[126]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Two-Person Guessing Games: An Experimental Study , 2003 .

[127]  Eric J. Johnson,et al.  Detecting Failures of Backward Induction: Monitoring Information Search in Sequential Bargaining , 2002, J. Econ. Theory.

[128]  Colin Camerer,et al.  Using Visual Salience in Empirical Game Theory , 2019, SSRN Electronic Journal.

[129]  Jacob K. Goeree,et al.  A model of noisy introspection , 2004, Games Econ. Behav..

[130]  V. Crawford,et al.  The Power of Focal Points Is Limited: Even Minute Payoff Asymmetry May Yield Large Coordination Failures , 2008 .

[131]  Ryan Webb,et al.  The (Neural) Dynamics of Stochastic Choice , 2019, Manag. Sci..

[132]  Nick Chater,et al.  Salience driven value integration explains decision biases and preference reversal , 2012, Proceedings of the National Academy of Sciences.

[133]  Cleotilde Gonzalez,et al.  A Cognitive Model of Dynamic Cooperation With Varied Interdependency Information , 2015, Cogn. Sci..

[134]  N. Chater,et al.  Unwritten rules: virtual bargaining underpins social interaction, culture, and society , 2014, Trends in Cognitive Sciences.

[135]  Daniel M. Oppenheimer,et al.  Information processing as a paradigm for decision making. , 2015, Annual review of psychology.

[136]  Sudeep Bhatia Choice Rules and Accumulator Networks , 2015, Decision.

[137]  Colin Camerer,et al.  Experience‐weighted Attraction Learning in Normal Form Games , 1999 .

[138]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[139]  A. Rubinstein,et al.  Games with Procedurally Rational Players , 1997 .

[140]  Gary E. Bolton,et al.  ERC: A Theory of Equity, Reciprocity, and Competition , 2000 .

[141]  Gerd Gigerenzer,et al.  Fast and frugal heuristics: The adaptive toolbox. , 1999 .

[142]  Colin F. Camerer,et al.  Pinocchio's Pupil: Using Eyetracking and Pupil Dilation To Understand Truth-telling and Deception in Games , 2006 .

[143]  E. Fehr A Theory of Fairness, Competition and Cooperation , 1998 .

[144]  Colin Camerer,et al.  A Cognitive Hierarchy Model of Games , 2004 .

[145]  Daniel M. Bartels,et al.  Connecting cognition and consumer choice , 2015, Cognition.

[146]  A. Glöckner,et al.  What is adaptive about adaptive decision making? A parallel constraint satisfaction account , 2014, Cognition.

[147]  Diederich,et al.  Dynamic Stochastic Models for Decision Making under Time Constraints , 1997, Journal of mathematical psychology.

[148]  R. Ratcliff,et al.  Multialternative decision field theory: a dynamic connectionist model of decision making. , 2001, Psychological review.

[149]  H. Wimmer,et al.  Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deception , 1983, Cognition.

[150]  Colin Camerer,et al.  Stationary Concepts for Experimental 2 X 2 Games: Comment , 2011 .

[151]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[152]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[153]  James L. McClelland,et al.  Loss aversion and inhibition in dynamical models of multialternative choice. , 2004, Psychological review.