An adversarial environment model for bounded rational agents in zero-sum interactions

Multiagent environments are often not cooperative nor collaborative; in many cases, agents have conflicting interests, leading to adversarial interactions. This paper presents a formal Adversarial Environment model for bounded rational agents operating in a zero-sum environment. In such environments, attempts to use classical utility-based search methods can raise a variety of difficulties (e.g., implicitly modeling the opponent as an omniscient utility maximizer, rather than leveraging a more nuanced, explicit opponent model). We define an Adversarial Environment by describing the mental states of an agent in such an environment. We then present behavioral axioms that are intended to serve as design principles for building such adversarial agents. We explore the application of our approach by analyzing log files of completed Connect-Four games, and present an empirical analysis of the axioms' appropriateness.

[1]  L. Victor Allis,et al.  A Knowledge-Based Approach of Connect-Four , 1988, J. Int. Comput. Games Assoc..

[2]  Alan Bundy,et al.  An Adversarial Planning Approach to Go , 1998, Computers and Games.

[3]  Shaul Markovitch,et al.  Learning and Exploiting Relative Weaknesses of Opponent Agents , 2005, Autonomous Agents and Multi-Agent Systems.

[4]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[5]  Paul Thagard,et al.  Adversarial Problem Solving: Modeling an Oponent Using Explanatory Coherence , 1992, Cogn. Sci..

[6]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[7]  Hector J. Levesque,et al.  On Acting Together , 1990, AAAI.

[8]  Sarit Kraus,et al.  Supporting Collaborative Activity , 2005, AAAI.

[9]  David Carmel,et al.  Incorporating Opponent Models into Adversary Search , 1996, AAAI/IAAI, Vol. 1.

[10]  Ronald W. Toseland,et al.  An Introduction to Group Work Practice , 1984 .

[11]  David Carmel,et al.  Opponent Modeling in Multi-Agent Systems , 1995, Adaption and Learning in Multi-Agent Systems.

[12]  Sarit Kraus,et al.  DESIGNING AND BUILDING A NEGOTIATING AUTOMATED AGENT , 1995, Comput. Intell..