An Approach to Model Based Testing of Multiagent Systems

Autonomous agents perform on behalf of the user to achieve defined goals or objectives. They are situated in dynamic environment and are able to operate autonomously to achieve their goals. In a multiagent system, agents cooperate with each other to achieve a common goal. Testing of multiagent systems is a challenging task due to the autonomous and proactive behavior of agents. However, testing is required to build confidence into the working of a multiagent system. Prometheus methodology is a commonly used approach to design multiagents systems. Systematic and thorough testing of each interaction is necessary. This paper proposes a novel approach to testing of multiagent systems based on Prometheus design artifacts. In the proposed approach, different interactions between the agent and actors are considered to test the multiagent system. These interactions include percepts and actions along with messages between the agents which can be modeled in a protocol diagram. The protocol diagram is converted into a protocol graph, on which different coverage criteria are applied to generate test paths that cover interactions between the agents. A prototype tool has been developed to generate test paths from protocol graph according to the specified coverage criterion.

[1]  George A. Vouros,et al.  Survey and Evaluation of Agent-Oriented Software Engineering Main Approaches , 2010 .

[2]  Michael Winikoff,et al.  Developing intelligent agent systems - a practical guide , 2004, Wiley series in agent technology.

[3]  Aamer Nadeem,et al.  AgentSpeak (L) Based Testing of Autonomous Agents , 2011, FGIT-ASEA/DRBC/EL.

[4]  Michael Winikoff,et al.  Prometheus design tool , 2005, AAMAS '05.

[5]  Vangalur S. Alagar,et al.  Conformance testing of BDI properties in agent-based software , 2005, 12th Asia-Pacific Software Engineering Conference (APSEC'05).

[6]  Lin Padgham,et al.  Model based testing for agent systems , 2009, AAMAS.

[7]  Michael Winikoff,et al.  Prometheus: a methodology for developing intelligent agents , 2002, AAMAS '02.

[8]  Michael Winikoff,et al.  On the testability of BDI agents , 2010 .

[9]  Anna Perini,et al.  Automated Continuous Testing of Multi-Agent Systems , 2007 .

[10]  Khanh Hoa Dam,et al.  Evaluating and Comparing Agent-Oriented Software Engineering Methodologies , 2003 .

[11]  Michael Luck,et al.  Crossing the agent technology chasm: Lessons, experiences and challenges in commercial applications of agents , 2006, The Knowledge Engineering Review.

[12]  Marc-Philippe Huget,et al.  Representing agent interaction protocols with agent UML , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[13]  Lin Padgham,et al.  Test Coverage Criteria for Agent Interaction Testing , 2010, AOSE.

[14]  Andrea Omicini,et al.  SODA: Societies and Infrastructures in the Analysis and Design of Agent-Based Systems , 2000, AOSE.

[15]  Nicholas R. Jennings,et al.  The Gaia Methodology for Agent-Oriented Analysis and Design , 2000, Autonomous Agents and Multi-Agent Systems.

[16]  Jens Woch,et al.  Intelligent Agents IV Agent Theories, Architectures, and Languages , 1997, Lecture Notes in Computer Science.

[17]  Scott A. DeLoach,et al.  Multiagent Systems Engineering , 2001, Int. J. Softw. Eng. Knowl. Eng..

[18]  Andreas Spillner,et al.  Test criteria and coverage measures for software integration testing , 1995, Software Quality Journal.

[19]  Nicholas R. Jennings,et al.  DESIRE: Modelling Multi-Agent Systems in a Compositional Formal Framework , 1997, Int. J. Cooperative Inf. Syst..

[20]  Tsong Yueh Chen,et al.  Automated Test Case Generation for BDI Agents , 1999, Autonomous Agents and Multi-Agent Systems.

[21]  Scott A. DeLoach,et al.  Multiagent Systems Engineering: A Methodology and Language for Designing Agent Systems , 1999 .

[22]  Michael Luck,et al.  Evolutionary testing of autonomous software agents , 2009, Autonomous Agents and Multi-Agent Systems.

[23]  Mercedes Garijo Ayestaran,et al.  Analysis and Design of Multiagent Systems Using MAS-Common KADS , 1997, ATAL.

[24]  A. S. Roa,et al.  AgentSpeak(L): BDI agents speak out in a logical computable language , 1996 .

[25]  Jorge J. Gómez-Sanz,et al.  Agent Oriented Analysis Using Message/UML , 2001, AOSE.

[26]  Carlos Angel Iglesias,et al.  Analysis and Design of Multiagent Systems Using MAS-Common KADS , 1997, ATAL.

[27]  Fausto Giunchiglia,et al.  Tropos: An Agent-Oriented Software Development Methodology , 2004, Autonomous Agents and Multi-Agent Systems.

[28]  Michael Winikoff,et al.  The Prometheus Design Tool - A Conference Management System Case Study , 2007, AOSE.