Environment as a first class abstraction in multiagent systems

The current practice in multiagent systems typically associates the environment with resources that are external to agents and their communication infrastructure. Advanced uses of the environment include infrastructures for indirect coordination, such as digital pheromones, or support for governed interaction in electronic institutions. Yet, in general, the notion of environment is not well defined. Functionalities of the environment are often dealt with implicitly or in an ad hoc manner. This is not only poor engineering practice, it also hinders engineers to exploit the full potential of the environment in multiagent systems. In this paper, we put forward the environment as an explicit part of multiagent systems.We give a definition stating that the environment in a multiagent system is a first-class abstraction with dual roles: (1) the environment provides the surrounding conditions for agents to exist, which implies that the environment is an essential part of every multiagent system, and (2) the environment provides an exploitable design abstraction for building multiagent system applications. We discuss the responsibilities of such an environment in multiagent systems and we present a reference model for the environment that can serve as a basis for environment engineering. To illustrate the power of the environment as a design abstraction, we show how the environment is successfully exploited in a real world application. Considering the environment as a first-class abstraction in multiagent systems opens up new horizons for research and development in multiagent systems.

[1]  Danny Weyns,et al.  A Formal Model for Situated Multi-Agent Systems , 2004, Fundam. Informaticae.

[2]  Franco Zambonelli,et al.  MARS: A Programmable Coordination Architecture for Mobile Agents , 2000, IEEE Internet Comput..

[3]  Paul Valckenaers,et al.  Holonic Manufacturing Execution Systems , 2005 .

[4]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[5]  Franco Zambonelli,et al.  Co-Fields: A Physically Inspired Approach to Motion Coordination , 2004, IEEE Pervasive Comput..

[6]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[7]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[8]  Agostino Poggi,et al.  Jade - a fipa-compliant agent framework , 1999 .

[9]  Andrea Omicini,et al.  Coordination artifacts: environment-based coordination for intelligent agents , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[10]  Rodney A. Brooks,et al.  Achieving Artificial Intelligence through Building Robots , 1986 .

[11]  Ken Arnold,et al.  JavaSpaces¿ Principles, Patterns, and Practice , 1999 .

[12]  Shinichi Honiden,et al.  Tag Interactions in MultiAgent Systems: Environment Support , 2006, EUMAS.

[13]  Andrea Omicini,et al.  SODA: Societies and Infrastructures in the Analysis and Design of Agent-Based Systems , 2000, AOSE.

[14]  Franco Zambonelli,et al.  From design to intention: signs of a revolution , 2002, AAMAS '02.

[15]  Franco Zambonelli,et al.  Field-Based Coordination for Pervasive Multiagent Systems (Springer Series on Agent Technology) , 2005 .

[16]  Marc Esteva,et al.  AMELI: an agent-based middleware for electronic institutions , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[17]  Daniel D. Corkill,et al.  Collaborating software: Blackboard and multi-agent systems & the future , 2003 .

[18]  Pattie Maes,et al.  Situated agents can have goals , 1990, Robotics Auton. Syst..

[19]  M. Georgeff,et al.  Social Plans: A Preliminary Report , 1992 .

[20]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[21]  Fabien Michel,et al.  Environments for Multi-Agent Systems III, Third International Workshop, E4MAS 2006, Hakodate, Japan, May 8, 2006, Selected Revised and Invited Papers , 2007, E4MAS.

[22]  Fabien Michel,et al.  Environments for Multi-Agent Systems II: Second International Workshop, E4MAS 2005, Utrecht, The Netherlands, July 25, 2005, Selected Revised and Invited ... / Lecture Notes in Artificial Intelligence) , 2006 .

[23]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[24]  H. Van Dyke Parunak,et al.  Digital Pheromones for Coordination of Unmanned Vehicles , 2004, E4MAS.

[25]  Carlos José Pereira de Lucena,et al.  Aspectizing Multi-agent Systems: From Architecture to Implementation , 2004, SELMAS.

[26]  Milind Tambe,et al.  Hybrid BDI-POMDP Framework for Multiagent Teaming , 2011, J. Artif. Intell. Res..

[27]  Danny Weyns,et al.  Gradient field-based task assignment in an AGV transportation system , 2006, AAMAS '06.

[28]  P.-P. Grasse.  La reconstruction du nid et les coordinations interindividuelles chezBellicositermes natalensis etCubitermes sp. la théorie de la stigmergie: Essai d'interprétation du comportement des termites constructeurs , 1959, Insectes Sociaux.

[29]  H. P Nii,et al.  Blackboard Systems , 1986 .

[30]  H. Van Dyke Parunak,et al.  "Go to the ant": Engineering principles from natural multi-agent systems , 1997, Ann. Oper. Res..

[31]  Michael Schumacher.  Objective Coordination in Multi-Agent System Engineering: Design and Implementation , 2001 .

[32]  J. K. Rosenblatt,et al.  A fine-grained alternative to the subsumption architecture for mobile robot control , 1989, International 1989 Joint Conference on Neural Networks.

[33]  AGRE: Integrating Environments with Organizations , 2004, E4MAS.

[34]  Pablo Noriega,et al.  Electronic Institutions: Future Trends and Challenges , 2002, CIA.

[35]  F. Zambonelli,et al.  Co-Fields : A Physically Inspired Approach to Distributed Motion Coordination , 2004 .

[36]  Franco Zambonelli,et al.  Methodologies and software engineering for agent systems : the agent-oriented software engineering handbook , 2004 .

[37]  Guido Boella,et al.  Attributing mental attitudes to normative systems , 2003, AAMAS '03.

[38]  Yves Demazeau,et al.  Multi-agent Systems Methodology , 1999, CEEMAS.

[39]  Guillermo Ricardo Simari,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 2000 .

[40]  H. Van Dyke Parunak,et al.  Temporal Aspects of Dynamic Role Assignment , 2003, AOSE.

[41]  Franco Zambonelli,et al.  Tuples on the air: a middleware for context-aware computing in dynamic networks , 2003, 23rd International Conference on Distributed Computing Systems Workshops, 2003. Proceedings..

[42]  Les Gasser,et al.  Perspectives on Organizations in Multi-agent Systems , 2001, EASSS.

[43]  Amy L. Murphy,et al.  LIME: a middleware for physical and logical mobility , 2001, Proceedings 21st International Conference on Distributed Computing Systems.

[44]  Michael Schumacher,et al.  Objective Coordination in Multi-Agent System Engineering , 2001, Lecture Notes in Computer Science.

[45]  Tim Smithers,et al.  Symbol grounding via a hybrid architecture in an autonomous assembly system , 1990, Robotics Auton. Syst..

[46]  Frank Dignum,et al.  Deliberative Normative Agents: Principles and Architecture , 1999, ATAL.

[47]  FOUNDATION FOR INTELLIGENT PHYSICAL AGENTS 2 3 4 FIPA Abstract Architecture Specification , .

[48]  Tom Holvoet,et al.  The Environment: An Essential Abstraction for Managing Complexity in MAS-Based Manufacturing Control , 2005, E4MAS.

[49]  Stefania Bandini,et al.  Dealing with space in multi--agent systems: a model for situated MAS , 2002, AAMAS '02.

[50]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[51]  D. Corkill.  Blackboard Systems , 1991 .

[52]  Franco Zambonelli,et al.  Developing multiagent systems: The Gaia methodology , 2003, TSEM.

[53]  Danny Weyns,et al.  A Reference Architecture for Situated Multiagent Systems , 2006, E4MAS.

[54]  Franco Zambonelli,et al.  Field-based coordination for pervasive multiagent systems , 2010, Springer series on agent technology.

[55]  Katia P. Sycara,et al.  The RETSINA MAS Infrastructure , 2003, Autonomous Agents and Multi-Agent Systems.

[56]  Ronald C. Arkin,et al.  Integrating behavioral, perceptual, and world knowledge in reactive navigation , 1990, Robotics Auton. Syst..

[57]  Danny Weyns,et al.  Middleware for protocol-based coordination in dynamic networks , 2005, MPAC '05.

[58]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[59]  Danny Weyns,et al.  Environments in multiagent systems , 2005, The Knowledge Engineering Review.

[60]  Andrea Omicini,et al.  Coordination Infrastructures in the Engineering of Multiagent Systems , 2004 .

[61]  Gerhard Weiss,et al.  Multiagent Systems and Societies of Agents , 2000 .

[62]  Fabien Michel,et al.  Environments for multi-agent systems II : Second International Workshop, E4MAS 2005, Utrecht, The Netherlands, July 25, 2005 : selected revised and invited papers , 2006 .

[63]  Jacques Ferber,et al.  Environments for Multiagent Systems State-of-the-Art and Research Challenges , 2004, E4MAS.

[64]  Jacques Ferber,et al.  From Agents to Organizations: An Organizational View of Multi-agent Systems , 2003, AOSE.

[65]  Danny Weyns,et al.  Protocol-based communication for situated multi-agent systems , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[66]  Luc Steels,et al.  Exploiting analogical representations , 1990, Robotics Auton. Syst..

[67]  Guy Theraulaz,et al.  Routing in Telecommunications Networks with Ant-Like Agents , 1999, IATA.

[68]  Mary Shaw,et al.  Software architecture - perspectives on an emerging discipline , 1996 .

[69]  Danny Weyns,et al.  Decentralized control of E'GV transportation systems , 2005, AAMAS '05.

[70]  Danny Weyns,et al.  TOWARDS ACTIVE PERCEPTION IN SITUATED MULTI-AGENT SYSTEMS , 2004, Appl. Artif. Intell..

[71]  Von-Wun Soo,et al.  From Reality to Mind: A Cognitive Middle Layer of Environment Concepts for Believable Agents , 2004, E4MAS.

[72]  Nicholas Carriero,et al.  Coordination languages and their significance , 1992, CACM.

[73]  Franco Zambonelli,et al.  Coordination for Internet Application Development , 1999, Autonomous Agents and Multi-Agent Systems.

[74]  Leslie Pack Kaelbling,et al.  The Synthesis of Digital Machines With Provable Epistemic Properties , 1986, TARK.

[75]  N. Gilbert,et al.  Artificial Societies: The Computer Simulation of Social Life , 1995 .

[76]  Nicholas R. Jennings,et al.  On agent-based software engineering , 2000, Artif. Intell..

[77]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[78]  Victoria Ungureanu,et al.  Law-governed interaction: a coordination and control mechanism for heterogeneous distributed systems , 2000, TSEM.

[79]  Danny Weyns,et al.  A Design Process for Adaptive Behavior of Situated Agents , 2004, AOSE.

[80]  Tom Holvoet,et al.  Views: customizable abstraction for context-aware applications in MANETs , 2005 .

[81]  Tom Holvoet,et al.  Views: customizable abstractions for contextaware applications in MANETs , 2005, ACM SIGSOFT Softw. Eng. Notes.

[82]  R JenningsNicholas,et al.  Developing multiagent systems , 2003 .

[83]  H. Van Dyke Parunak,et al.  Modeling Agents and Their Environment , 2002, AOSE.

[84]  David Hales,et al.  Group Reputation Supports Beneficent Norms , 2002, J. Artif. Soc. Soc. Simul..

[85]  Andrea Omicini,et al.  Objective versus Subjective Coordination in the Engineering of Agent Systems , 2003, AgentLink.

[86]  Maja J. Matarić,et al.  Leaning to behave socially , 1994 .

[87]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[88]  Wamberto Weber Vasconcelos,et al.  Logic-Based Electronic Institutions , 2003, DALT.

[89]  Paul Clements,et al.  Software architecture in practice , 1999, SEI series in software engineering.

[90]  Danny Weyns,et al.  Exploiting a Virtual Environment in a Real-World Application , 2005, E4MAS.

[91]  Andrea Omicini,et al.  Activity Theory as a Framework for MAS Coordination , 2002, ESAW.

[92]  David Kotz,et al.  Mobile agents and the future of the internet , 1999, OPSR.

[93]  Andrea Omicini,et al.  "Exhibitionists" and "Voyeurs" Do It Better: A Shared Environment for Flexible Coordination with Tacit Messages , 2004, E4MAS.

[94]  Shinichi Honiden,et al.  Oversensing with a softbody in the environment - Another dimension of observation , 2005 .

[95]  J. Ferber,et al.  Influences and Reaction : a Model of Situated Multiagent Systems , 2001 .

[96]  Fabien Michel,et al.  Environments for Multi-Agent Systems, First International Workshop, E4MAS 2004, New York, NY, USA, July 19, 2004, Revised Selected Papers , 2005, E4MAS.

[97]  Sven A. Brueckner,et al.  RETURN FROM THE ANT SYNTHETIC ECOSYSTEMS FOR MANUFACTURING CONTROL , 2000 .