A role-oriented BDI framework for real-time multiagent teaming

Multi-agent teaming is an active research field of multi-agent systems. Flexible multi-agent decision making requires effective reaction and adaption to dynamic changes under time pressure, especially in real-time and dynamic systems. The joint intension and sharedplan are two most popular theories for the teamwork of multi-agent systems. However, there is no clear guidance for designing and implementing agents' teaming. BDI (Belief, Desire, and Intension) architecture has been widely used to design multi-agent systems. In this paper, a role-based BDI framework is presented to facilitate the team level optimization problems such as competitive, cooperation and coordination problems. This BDI framework is extended on the commercial agent software development environment known as JACK Teams. The layered architecture has been used to group the agents' competitive and cooperative behaviors. In addition, we present the reinforcement learning techniques to learn different behaviors through experience. These issues have been specified and investigated within a real-time 2D simulation environment known as soccerBots.

[1]  Yu Zhang,et al.  Modeling Role-Based Agent Team , 2007, Canadian Conference on AI.

[2]  Lakhmi C. Jain,et al.  Building a decision making framework using agent teams , 2007, Intell. Decis. Technol..

[3]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[4]  Jacques Ferber,et al.  From Agents to Organizations: An Organizational View of Multi-agent Systems , 2003, AOSE.

[5]  Shimon Whiteson,et al.  Concurrent layered learning , 2003, AAMAS '03.

[6]  R. Bellman.  Dynamic programming. , 1957, Science.

[7]  Peter Stone,et al.  Layered learning in multiagent systems - a winning approach to robotic soccer , 2000, Intelligent robotics and autonomous agents.

[8]  R. Bellman.  A Markovian Decision Process , 1957 .

[9]  Samuel Pierre,et al.  Mobile agents in distributed meeting scheduling: A case study for distributed applications , 2007, Intell. Decis. Technol..

[10]  Manuela M. Veloso,et al.  Task Decomposition, Dynamic Role Assignment, and Low-Bandwidth Communication for Real-Time Strategic Teamwork , 1999, Artif. Intell..

[11]  Martyn Fletcher,et al.  Implementing Industrial Multi-agent Systems Using JACK , 2003, PROMAS.

[12]  Lakhmi C. Jain,et al.  Reinforcement Learning of Competitive Skills with Soccer Agents , 2007, KES.

[13]  John Yen,et al.  CAST: Collaborative Agents for Simulating Teamwork , 2001, IJCAI.

[14]  Nicholas R. Jennings,et al.  A Roadmap of Agent Research and Development , 2004, Autonomous Agents and Multi-Agent Systems.

[15]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[16]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[17]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[18]  Peter Stone,et al.  Keepaway Soccer: From Machine Learning Testbed to Benchmark , 2005, RoboCup.

[19]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[20]  Nicholas R. Jennings,et al.  On agent-based software engineering , 2000, Artif. Intell..

[21]  Peter Stone,et al.  Reinforcement Learning for RoboCup Soccer Keepaway , 2005, Adapt. Behav..

[22]  Gerhard Weiss,et al.  Multiagent Systems , 1999 .

[23]  Winfried Lamersdorf,et al.  Jadex: Implementing a BDI-Infrastructure for JADE Agents , 2003 .

[24]  Lakhmi C. Jain,et al.  Simulation and reinforcement learning with soccer agents , 2008, Multiagent Grid Syst..

[25]  Jacques Ferber,et al.  Integrating tools and infrastructures for generic multi-agent systems , 2001, AGENTS '01.

[26]  Adam Cheyer,et al.  The Open Agent Architecture , 1997, Autonomous Agents and Multi-Agent Systems.

[27]  Albert J. N. van Breemen,et al.  Integrating Agents in Software Applications , 2002, Agent Technologies, Infrastructures, Tools, and Applications for E-Services.

[28]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[29]  Maarten Sierhuis,et al.  Policy-based coordination in joint human-agent activity , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[30]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .