Beast methodology: An agile testing methodology for multi-agent systems based on behaviour driven development

This paper presents a testing methodology to apply Behaviour Driven Development (BDD) techniques while developing Multi-Agent Systems (MASs), termed BEhavioural Agent Simple Testing (BEAST) Methodology. This methodology is supported by the open source framework (BEAST Tool) which automatically generates test cases skeletons from BDD scenarios specifications. The developed framework allows the testing of MASs based on JADE or JADEX platforms. In addition, this framework offers a set of configurable Mock Agents with the aim of being able to execute tests while the MAS is under development. The BEAST Methodology presents transparent traceability from user requirements to test cases. Thus, the stakeholders can be aware of the project status. The methodology and the associated tool have been validated in the development of a MAS for fault diagnosis in FTTH (Fiber To The Home) networks. The results have been measured in quantifiable way obtaining a reduction of the tests implementation time.

[1]  Winfried Lamersdorf,et al.  Jadex: A BDI-Agent System Combining Middleware and Reasoning , 2005 .

[2]  Gojko Adzic.  Specification by Example: How Successful Teams Deliver the Right Software , 2011 .

[3]  Geir Kjetil Hanssen,et al.  Automated Acceptance Testing: A Literature Review and an Industrial Case Study , 2008, Agile 2008 Conference.

[4]  Jeff Sutherland,et al.  The Scrum Guide , 2012 .

[5]  John Thangarajah,et al.  Testing in Multi-Agent Systems , 2009, AOSE.

[6]  Xiaofeng Wang,et al.  A Study of the Characteristics of Behaviour Driven Development , 2011, 2011 37th EUROMICRO Conference on Software Engineering and Advanced Applications.

[7]  Riza Cenk Erdur,et al.  SUNIT: A Unit Testing Framework for Test Driven Development of Multi-Agent Systems , 2006, AOSE.

[8]  Rem W. Collier,et al.  SADAAM: Software Agent Development An Agile Methodology , 2007 .

[9]  Jorge J. Gómez-Sanz,et al.  Agent-Oriented Software Engineering IX, 9th International Workshop, AOSE 2008, Estoril, Portugal, May 12-13, 2008, Revised Selected Papers , 2009, AOSE.

[10]  Jorge J. Gómez-Sanz,et al.  The INGENIAS Methodology and Tools , 2005 .

[11]  Riza Cenk Erdur,et al.  SEAGENT: a platform for developing semantic web based multi agent systems , 2005, AAMAS '05.

[12]  Grigori Melnik,et al.  Tests and Requirements, Requirements and Tests: A Möbius Strip , 2008, IEEE Software.

[13]  Evans,et al.  Domain-driven design , 2003 .

[14]  Maria-Eugenia Iacob,et al.  Requirements traceability in model-driven development: Applying model and transformation conformance , 2007, Inf. Syst. Frontiers.

[15]  Jorge J. Gómez-Sanz,et al.  INGENIAS-SCRUM Development Process for Multi-Agent Development , 2008, DCAI.

[16]  Rick Mugridge,et al.  Fit for Developing Software: Framework for Integrated Tests (Robert C. Martin) , 2005 .

[17]  Anna Perini,et al.  Goal-oriented testing for MASs , 2010, Int. J. Agent Oriented Softw. Eng..

[18]  Lin Padgham,et al.  Automated Testing for Intelligent Agent Systems , 2009, AOSE.

[19]  Zina Houhamdi,et al.  Multi-Agent System Testing: A Survey , 2011 .

[20]  Michael Winikoff,et al.  Prometheus: a methodology for developing intelligent agents , 2002, AAMAS '02.

[21]  Agostino Poggi,et al.  Developing Multi-agent Systems with JADE , 2007, ATAL.

[22]  Lin Padgham,et al.  Agent-Oriented Software Engineering VIII, 8th International Workshop, AOSE 2007, Honolulu, HI, USA, May 14, 2007, Revised Selected Papers , 2008, AOSE.

[23]  Duy Cu Nguyen.  Testing Techniques for Software Agents , 2009 .

[24]  Mario Piattini,et al.  Capturing data quality requirements for web applications by means of DQ_WebRE , 2013, Inf. Syst. Frontiers.

[25]  Anna Perini,et al.  A Goal-Oriented Software Testing Methodology , 2007, AOSE.

[26]  Sean Luke,et al.  MASON: A Multiagent Simulation Environment , 2005, Simul..

[27]  Urvashi Rathod,et al.  Defining ‘success’ for software projects: An exploratory revelation , 2006 .

[28]  Carlos Angel Iglesias,et al.  Analysis and Design of Multiagent Systems Using MAS-Common KADS , 1997, ATAL.

[29]  Jorge J. Gómez-Sanz,et al.  Agent-Oriented Software Engineering X - 10th International Workshop, AOSE 2009, Budapest, Hungary, May 11-12, 2009, Revised Selected Papers , 2011, AOSE.

[30]  Leon Pretorius,et al.  A perspective on human factors contributing to quality requirements: A cross-case analysis , 2011, 2011 IEEE International Conference on Industrial Engineering and Engineering Management.

[31]  Fausto Giunchiglia,et al.  Agent-Oriented Software Engineering III , 2003, Lecture Notes in Computer Science.

[32]  Uirá Kulesza,et al.  Unit testing in multi-agent systems using mock agents and aspects , 2006, SELMAS '06.

[33]  Fausto Giunchiglia.  International Doctorate School in Information and Communication Technologies , 2011 .

[34]  Lin Padgham,et al.  Scenarios for system requirements traceability and testing , 2011, AAMAS.

[35]  Gojko Adzic.  Bridging the Communication Gap: Specification by Example and Agile Acceptance Testing , 2009 .

[36]  Nicholas R. Jennings,et al.  The Gaia Methodology for Agent-Oriented Analysis and Design , 2000, Autonomous Agents and Multi-Agent Systems.

[37]  Matthias Klusch,et al.  Software agent-based applications, platforms and development kits , 2005 .

[38]  Fabio Bellifemine,et al.  Developing Multi-Agent Systems with JADE (Wiley Series in Agent Technology) , 2007 .

[39]  Michael Wooldridge,et al.  Programming Multi-Agent Systems in AgentSpeak using Jason (Wiley Series in Agent Technology) , 2007 .

[40]  Cristiano Castelfranchi,et al.  Proceedings of the 7th International Workshop on Intelligent Agents VII. Agent Theories Architectures and Languages , 2000 .

[41]  Franco Zambonelli,et al.  Agent-Oriented Software Engineering VII, 7th International Workshop, AOSE 2006, Hakodate, Japan, May 8, 2006, Revised and Invited Papers , 2007, AOSE.

[42]  Danny Weyns,et al.  Multi-Agent Systems , 2009 .

[43]  Lily Sun,et al.  An ontological modelling of user requirements for personalised information provision , 2010, Inf. Syst. Frontiers.

[44]  José Carlos González,et al.  Analysis and Design of multiagent systems using MAS-CommonKADS , 1998 .

[45]  Jorge J. Gómez-Sanz,et al.  Testing and Debugging of MAS Interactions with INGENIAS , 2009, AOSE.