The adversarial activity model for bounded rational agents

Multiagent research provides an extensive literature on formal Beliefs-Desires-Intentions (BDI) based models describing the notion of teamwork and cooperation. However, multiagent environments are often not cooperative nor collaborative; in many cases, agents have conflicting interests, leading to adversarial interactions. This form of interaction has not yet been formally defined in terms of the agents mental states, beliefs, desires and intentions. This paper presents the Adversarial Activity model, a formal Beliefs-Desires-Intentions (BDI) based model for bounded rational agents operating in a zero-sum environment. In complex environments, attempts to use classical utility-based search methods with bounded rational agents can raise a variety of difficulties (e.g. implicitly modeling the opponent as an omniscient utility maximizer, rather than leveraging a more nuanced, explicit opponent model). We define the Adversarial Activity by describing the mental states of an agent situated in such environment. We then present behavioral axioms that are intended to serve as design principles for building such adversarial agents. We illustrate the advantages of using the model as an architectural guideline by building agents for two adversarial environments: the Connect Four game and the Risk strategic board game. In addition, we explore the application of our approach by analyzing log files of completed Connect Four games, and gain additional insights on the axioms’ appropriateness.

[1]  Marek J. Sergot,et al.  A logic-based calculus of events , 1989, New Generation Computing.

[2]  Learning the risk board game with classifier systems , 2002, SAC '02.

[3]  R. Tuomela We Will Do It: An Analysis of Group-Intentions , 1991 .

[4]  Paul Thagard,et al.  Adversarial Problem Solving: Modeling an Oponent Using Explanatory Coherence , 1992, Cogn. Sci..

[5]  L. Victor Allis,et al.  A Knowledge-Based Approach of Connect-Four , 1988, J. Int. Comput. Games Assoc..

[6]  Alan Bundy,et al.  An Adversarial Planning Approach to Go , 1998, Computers and Games.

[7]  Colin Camerer Progress in Behavioral Game Theory , 1997 .

[8]  Rafael H. Bordini,et al.  Multi-Agent Programming: Languages, Platforms and Applications , 2005, Multi-Agent Programming.

[9]  Jürgen Dix,et al.  Multi-Agent Programming , 2009, Springer US.

[10]  Hector J. Levesque,et al.  Intention is Choice with Commitment , 1990, Artif. Intell..

[11]  Michael Wooldridge,et al.  Programming Multi-Agent Systems in AgentSpeak using Jason (Wiley Series in Agent Technology) , 2007 .

[12]  Michael P. Georgeff,et al.  Decision-Making in an Embedded Reasoning System , 1989, IJCAI.

[13]  Bruce D. Burns,et al.  Modeling the adversary and success in competition , 1998 .

[14]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[15]  J. Searle Consciousness and Language: Collective Intentions and Actions , 2002 .

[16]  Michael Luck,et al.  Formalising the Contract Net as a Goal-Directed System , 1996, MAAMAW.

[17]  Michal Pechoucek,et al.  Multi-Agent Systems and Applications IV, 4th International Central and Eastern European Conference on Multi-Agent Systems, CEEMAS 2005, Budapest, Hungary, September 15-17, 2005, Proceedings , 2005, CEEMAS.

[18]  Colin Camerer,et al.  “Economic man” in cross-cultural perspective: Behavioral experiments in 15 small-scale societies , 2005, Behavioral and Brain Sciences.

[19]  Damminda Alahakoon,et al.  Collaborative neuro-BDI agents in container terminals , 2004, 18th International Conference on Advanced Information Networking and Applications, 2004. AINA 2004..

[20]  Nicholas R. Jennings,et al.  The Cooperative Problem-solving Process , 1999, J. Log. Comput..

[21]  Amy L. Lansky,et al.  Reactive Reasoning and Planning , 1987, AAAI.

[22]  Artur S. d'Avila Garcez,et al.  We Will Show Them! Essays in Honour of Dov Gabbay, Volume One , 2005, We Will Show Them!.

[23]  Sarit Kraus,et al.  An adversarial environment model for bounded rational agents in zero-sum interactions , 2007, AAMAS '07.

[24]  Shaul Markovitch,et al.  Learning and Exploiting Relative Weaknesses of Opponent Agents , 2005, Autonomous Agents and Multi-Agent Systems.

[25]  Koen V. Hindriks,et al.  Agent Programming in 3APL , 1999, Autonomous Agents and Multi-Agent Systems.

[26]  Jeffrey S. Rosenschein,et al.  Deals Among Rational Agents , 1985, IJCAI.

[27]  Donald E. Knuth,et al.  The Solution for the Branching Factor of the Alpha-Beta Pruning Algorithm , 1981, ICALP.

[28]  Victor R. Lesser,et al.  The Distributed Vehicle Monitoring Testbed: A Tool for Investigating Distributed Problem Solving Networks , 1983, AI Mag..

[29]  Dov M. Gabbay,et al.  Temporal logic (vol. 1): mathematical foundations and computational aspects , 1994 .

[30]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[31]  Munindar P. Singh The Intentions of Teams: Team Structure, Endodeixis, and Exodeixis , 1998, ECAI.

[32]  Michal Pechoucek,et al.  Adversarial Behavior in Multi-Agent Systems , 2005, EUMAS.

[33]  Nathan R. Sturtevant,et al.  Prob-Maxn: Playing N-Player Games with Opponent Models , 2006, AAAI.

[34]  Hector J. Levesque,et al.  On Acting Together , 1990, AAAI.

[35]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[36]  Nicholas R. Jennings,et al.  Controlling Cooperative Problem Solving in Industrial Multi-Agent Systems Using Joint Intentions , 1995, Artif. Intell..

[37]  Sarit Kraus,et al.  Formal Approaches to Teamwork , 2005, We Will Show Them!.

[38]  Sarit Kraus,et al.  Supporting Collaborative Activity , 2005, AAAI.

[39]  Jonathan Schaeffer,et al.  Computers and Games: Third International Conference, CG 2002, Edmonton, Canada, July 25-27, 2002, Revised Papers , 2004 .

[40]  Fredrik Olsson,et al.  Using Multi-Agent System Technologies in Risk Bots , 2006, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[41]  Robert Stalnaker Extensive and strategic forms: Games and models for games , 1999 .

[42]  Philip R. Cohen,et al.  Plans as Complex Mental Attitudes , 2003 .

[43]  Michael Thielscher,et al.  From Situation Calculus to Fluent Calculus: State Update Axioms as a Solution to the Inferential Frame Problem , 1999, Artif. Intell..

[44]  David Carmel,et al.  Opponent Modeling in Multi-Agent Systems , 1995, Adaption and Learning in Multi-Agent Systems.

[45]  A. S. Roa,et al.  AgentSpeak(L): BDI agents speak out in a logical computable language , 1996 .

[46]  Milind Tambe,et al.  Agent Architectures for Flexible, Practical Teamwork , 1997, AAAI/IAAI.

[47]  M. Dufwenberg Game theory. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[48]  J. Benthem Games in dynamic epistemic logic , 2001 .

[49]  Sarit Kraus,et al.  Mixing search strategies for multi-player games , 2009, IJCAI 2009.

[50]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[51]  Sarit Kraus,et al.  Knowledge, Belief and Time , 1986, Theor. Comput. Sci..

[52]  Sarit Kraus,et al.  Providing a Recommended Trading Agent to a Population: A Novel Approach , 2007, IJCAI.

[53]  Zongmin Ma,et al.  Computers and Games , 2008, Lecture Notes in Computer Science.

[54]  Johan van Benthem,et al.  Open Problems in Logic and Games , 2005, We Will Show Them!.

[55]  Michael E. Bratman,et al.  Shared Cooperative Activity , 1991 .

[56]  Anand S. Rao,et al.  Decision Procedures for BDI Logics , 1998, J. Log. Comput..

[57]  Jürgen Dix,et al.  Multi-Agent Programming: Languages, Tools and Applications , 2009 .

[58]  Marcus J. Huber JAM: a BDI-theoretic mobile agent architecture , 1999, AGENTS '99.

[59]  Matthias Jarke,et al.  Logic Programming and Databases , 1984, Expert Database Workshop.

[60]  Sarit Kraus,et al.  A logic-based model of intention formation and action for multi-agent subcontracting , 2005, Artif. Intell..

[61]  Keki B. Irani,et al.  An Algorithmic Solution of N-Person Games , 1986, AAAI.

[62]  S. Stich Dennett on Intentional Systems , 1981 .

[63]  Sarit Kraus,et al.  An Empirical Investigation of the Adversarial Activity Model , 2008, ECAI.

[64]  Philip R. Cohen,et al.  Collective Intentions and Actions , 2003 .

[65]  Anand S. Rao,et al.  Modeling Rational Agents within a BDI-Architecture , 1997, KR.

[66]  Daniel Moldt,et al.  Goal Representation for BDI Agent Systems , 2004, PROMAS.

[67]  Peter Norvig,et al.  Artificial intelligence - a modern approach, 2nd Edition , 2003, Prentice Hall series in artificial intelligence.

[68]  Hector J. Levesque,et al.  GOLOG: A Logic Programming Language for Dynamic Domains , 1997, J. Log. Program..

[69]  Ronald W. Toseland,et al.  An Introduction to Group Work Practice , 1984 .

[70]  Richard E. Korf,et al.  On Pruning Techniques for Multi-Player Games , 2000, AAAI/IAAI.

[71]  Sarit Kraus,et al.  The Evolution of Sharedplans , 1999 .

[72]  Gil Tidhar,et al.  Planned Team Activity , 1992, MAAMAW.

[73]  Michael E. Bratman,et al.  Intention, Plans, and Practical Reason , 1991 .

[74]  Gerhard Weiß,et al.  Adaptation and Learning in Multi-Agent Systems: Some Remarks and a Bibliography , 1995, Adaption and Learning in Multi-Agent Systems.

[75]  Michael Fisher,et al.  A Survey of Concurrent METATEM - the Language and its Applications , 1994, ICTL.

[76]  Fredrik Olsson,et al.  Using Multi-Agent System Technology in Risk Bots , 2006, AIIDE.

[77]  Barbara Dunin-Keplicz,et al.  Collective Intentions , 2002, Fundam. Informaticae.

[78]  Roger B. Myerson,et al.  On the Value of Game Theory in Social Science , 1992 .