The AutoBlackTest Tool: Automating System Testing of GUI-based Applications

Automatic test case generation is a key ingredient of efficient and cost-effective software verification processes. The problem is attracting a lot of attention, and the research in the field has produced many interesting results opening new research directions. In this paper we present AutoBlackTest, a technique to automatically generate system test cases for GUI-based interactive applications. AutoBlackTest explores the behaviors of the application under test using reinforcement learning to learn how to interact with the application under test and stimulate its functionalities. The interaction with the elements that compose the GUI of the application under test is implemented as an extension of the Eclipse IDE, in particular of the IBM Rational Functional Tester tool. Early empirical results show that the tool has the potential of automatically discovering bugs and generating useful system and regression test

[1]  Reda Alhajj,et al.  Multiagent reinforcement learning using function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[2]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[3]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[4]  Lee J. White,et al.  Generating test cases for GUI responsibilities using complete interaction sequences , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.

[5]  Markus Schneider,et al.  The Teaching-Box: A universal robot learning framework , 2009, 2009 International Conference on Advanced Robotics.

[6]  Long-Ji Lin,et al.  Reinforcement learning for robots using neural networks , 1992 .

[7]  Mauro Pezzè,et al.  Software testing and analysis - process, principles and techniques , 2007 .

[8]  Gregg Rothermel,et al.  Prioritizing test cases for regression testing , 2000, ISSTA '00.

[9]  Mary Lou Soffa,et al.  Coverage criteria for GUI testing , 2001, ESEC/FSE-9.

[10]  Myra B. Cohen,et al.  GUI Interaction Testing: Incorporating Event Context , 2011, IEEE Transactions on Software Engineering.

[11]  Atif M. Memon,et al.  Generating Event Sequence-Based Test Cases Using GUI Runtime State Feedback , 2010, IEEE Transactions on Software Engineering.

[12]  Atif M. Memon,et al.  Studying the fault-detection effectiveness of GUI test cases for rapidly evolving software , 2005, IEEE Transactions on Software Engineering.