A Cognitive Hierarchy Model Applied to the Lemonade Game

One of the challenges of multiagent decision making is that the behavior needed to maximize utility can depend on what other agents choose to do: sometimes there is no "right" answer in the absence of knowledge of how opponents will act. The Nash equilibrium is a sensible choice of behavior because it represents a mutual best response. But, even when there is a unique equilibrium, other players are under no obligation to take part in it. This observation has been forcefully illustrated in the behavioral economics community where repeated experiments have shown individuals playing Nash equilibria and performing badly as a result. In this paper, we show how to apply a tool from behavioral economics called the Cognitive Hierarchy (CH) to the design of agents in general sum games. We attack the recently introduced "Lemonade Game" and show how the results of an open competition are well explained by CH. We believe this game, and perhaps many other similar games, boils down to predicting how deeply other agents in the game will be reasoning. An agent that does not reason enough risks being exploited by its opponents, while an agent that reasons too much may not be able to interact productively with its opponents. We demonstrate these ideas by presenting empirical results using agents from the competition and idealizations arising from a CH analysis.

[1]  J. Keynes,et al.  The General Theory of Employment, Interest and Money. , 1936 .

[2]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Normal-Form Games: An Experimental Study , 1998 .

[3]  Dan Egnor,et al.  Iocaine powder , 2000, J. Int. Comput. Games Assoc..

[4]  Ya'akov Gal,et al.  Reasoning about rationality and beliefs , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[5]  Colin Camerer,et al.  A Cognitive Hierarchy Model of Games , 2004 .

[6]  Colin Camerer Behavioral Game Theory: Experiments in Strategic Interaction , 2003 .

[7]  Colin Camerer,et al.  Iterated Dominance and Iterated Best-Response in Experimental P-Beauty Contests , 1998 .

[8]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[9]  H. Barger The General Theory of Employment, Interest and Money , 1936, Nature.

[10]  Edmund H. Durfee,et al.  Recursive Agent Modeling Using Limited Rationality , 1995, ICMAS.

[11]  J. Keynes The General Theory of Employment , 1937 .

[12]  Peter McBurney,et al.  An Analysis of Entries in the First TAC Market Design Competition , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[13]  Darse Billings,et al.  The First International RoShamBo Programming Competition , 2000, J. Int. Comput. Games Assoc..

[14]  Colin Camerer,et al.  Pinocchio's Pupil: Using Eyetracking and Pupil Dilation to Understand Truth-Telling and Deception in Sender-Receiver Game , 2009 .

[15]  BowlingMichael,et al.  The lemonade stand game competition , 2011 .