Test Agents: The Next Generation of Test Cases

Growth of software size, lack of resources to perform regression testing, and failure to detect bugs faster have seen increased reliance on continuous integration and test automation. Even with greater hardware and software resources dedicated to test automation, software testing is faced with enormous challenges, resulting in increased dependence on centralized and complex mechanisms for automated test case selection as part of continuous integration. These mechanisms are currently using static entities called test cases that are concretely realized as executable scripts. Our key vision is to provide test cases with more reasoning, adaptive behavior and learning capabilities by using the concepts of software agents. We refer to such test cases as test agents. The model that underlie a test agent is capable of flexible and autonomous actions in order to meet overall testing objectives. Our goal is to increase the decentralization of regression testing by letting test agents to know for themselves when they should be executing, how they should update their purpose, and when they should interact with each other. In this paper, we envision test agents that display such adaptive autonomous behavior. Existing and emerging developments and challenges regarding the use of test agents are explored—in particular, new research that seeks to use adaptive autonomous agents in software testing.

[1]  Yunzhan Gong,et al.  Design of intelligent agents for collaborative testing of service-based systems , 2011, AST '11.

[2]  Jia Zhang,et al.  A Mobile Agent-Supported Web Services Testing Platform , 2008, 2008 IEEE/IFIP International Conference on Embedded and Ubiquitous Computing.

[3]  Cristiano Castelfranchi,et al.  Founding Agents' "Autonomy" on Dependence Theory , 2000, ECAI.

[4]  Luciano Baresi,et al.  An Introduction to Software Testing , 2006, FoVMT.

[5]  Elaine J. Weyuker,et al.  Automated System-Level Regression Test Prioritization in a Nutshell , 2017, IEEE Software.

[6]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[7]  Michael A. Goodrich,et al.  On using mixed-initiative control: A perspective for managing large-scale robotic teams , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Jingfan Tang.  Towards Automation in Software Test Life Cycle Based on Multi-Agent , 2010, 2010 International Conference on Computational Intelligence and Software Engineering.

[9]  C. Malz,et al.  Agent-based test management for software system test , 2010, 2010 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR).

[10]  G. V. Uma,et al.  Multi-agent Based Integrated Framework for Intra-class Testing of Object-Oriented Software , 2003, ISCIS.

[11]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[12]  Michael Wooldridge,et al.  Applications of intelligent agents , 1998 .

[13]  Jörg P. Müller,et al.  Application Impact of Multi-agent Systems and Technologies: A Survey , 2014, Agent-Oriented Software Engineering.

[14]  Maarten Sierhuis,et al.  The Fundamental Principle of Coactive Design: Interdependence Must Shape Autonomy , 2010, COIN@AAMAS&MALLOW.

[15]  Kalliopi Kravari,et al.  A Survey of Agent Platforms , 2015, J. Artif. Soc. Soc. Simul..

[16]  Reid G. Simmons,et al.  Preliminary results in sliding autonomy for assembly by coordinated teams , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[17]  Frank Dignum,et al.  Autonomy and Coordination: Controlling External Influences on Decision Making , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[18]  Sigrid Eldh,et al.  On Test Design , 2011 .

[19]  Baran Çürüklü,et al.  Analysis of Perceived Helpfulness in Adaptive Autonomous Agent Populations , 2018, Trans. Comput. Collect. Intell..

[20]  John Micco,et al.  Taming Google-Scale Continuous Testing , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP).

[21]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[22]  Hong Zhu.  Cooperative agent approach to quality assurance and testing Web software , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[23]  G. V. Uma,et al.  A new approach in development of distributed framework for automated software testing using agents , 2006, Knowl. Based Syst..

[24]  Charles E. Thorpe,et al.  Collaborative control: a robot-centric model for vehicle teleoperation , 2001 .