Modeling Human Ad Hoc Coordination

Whether in groups of humans or groups of computer agents, collaboration is most effective between individuals who have the ability to coordinate on a joint strategy for collective action. However, in general a rational actor will only intend to coordinate if that actor believes the other group members have the same intention. This circular dependence makes rational coordination difficult in uncertain environments if communication between actors is unreliable and no prior agreements have been made. An important normative question with regard to coordination in these ad hoc settings is therefore how one can come to believe that other actors will coordinate, and with regard to systems involving humans, an important empirical question is how humans arrive at these expectations. We introduce an exact algorithm for computing the infinitely recursive hierarchy of graded beliefs required for rational coordination in uncertain environments, and we introduce a novel mechanism for multiagent coordination that uses it. Our algorithm is valid in any environment with a finite state space, and extensions to certain countably infinite state spaces are likely possible. We test our mechanism for multiagent coordination as a model for human decisions in a simple coordination game using existing experimental data. We then explore via simulations whether modeling humans in this way may improve human-agent collaboration.

[1]  Nir Vulkan An Economist's Perspective on Probability Matching , 2000 .

[2]  Seif Haridi,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[3]  Raymond J. Dolan,et al.  Game Theory of Mind , 2008, PLoS Comput. Biol..

[4]  Sarit Kraus,et al.  Agent-Human Coordination with Communication Costs Under Uncertainty , 2012, AAAI.

[5]  Sarit Kraus,et al.  Ad Hoc Autonomous Agent Teams: Collaboration without Pre-Coordination , 2010, AAAI.

[6]  D. Monderer,et al.  Approximating common knowledge with common beliefs , 1989 .

[7]  Ya'akov Gal,et al.  Networks of Influence Diagrams: A Formalism for Representing Agents' Beliefs and Decision-Making Processes , 2008, J. Artif. Intell. Res..

[8]  Joseph Y. Halpern,et al.  Knowledge and common knowledge in a distributed environment , 1984, JACM.

[9]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[10]  A. Rubinstein The Electronic Mail Game: Strategic Behavior Under "Almost Common Knowledge" , 1989 .

[11]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[12]  Nicholas R. Jennings,et al.  Human-agent collectives , 2014, CACM.

[13]  Stephen Morris,et al.  Approximate Common Knowledge and Co-ordination: Recent Lessons from Game Theory , 1997, J. Log. Lang. Inf..

[14]  Ramamohan Paturi,et al.  Common Knowledge and State-Dependent Equilibria , 2012, SAGT.

[15]  Steven Pinker,et al.  The psychology of coordination and common knowledge. , 2014, Journal of personality and social psychology.

[16]  Edmund H. Durfee,et al.  Decision-theoretic recursive modeling and the coordinated attack problem , 1992 .

[17]  Thomas L. Griffiths,et al.  One and Done? Optimal Decisions From Very Few Samples , 2014, Cogn. Sci..

[18]  Giacomo Mauro DAriano The Journal of Personality and Social Psychology. , 2002 .