Plan Generation for GUI Testing

Graphical user interfaces (GUIs) have become nearly ubiquitous as a moans of interacting with software systems. GUIs are typically highly complex pieces of software, and testing their correctness poses a large challenge. In this paper, we present a new approach to automatic testing of GUIs that builds on AI planning techniques. The motivating idea is that GUI test designers will often find it easier to specify typical goals that users of their software might have than to specify sequences of GUI actions that users might perform to achieve those goals. Thus we cast GUI test-case generation as an instance of plan generation: given a specification of initial and goal states for a GUI, a planner is used to generate sequences of GUI actions that lead from the initial state to the goal state. We describe our GUI testing system, PATHS (Planning Assisted Tester for graphical user interface Systems), and we report on experiments using PATHS lo generate test cafes for Microsoft's WordPad.

[1]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[2]  Mary Lou Soffa,et al.  Comparing Causal-Link and Propositional Planners : Tradeoffs between Plan Length and Domain Size , 2022 .

[3]  David J. Kasik,et al.  Toward automatic generation of novice user test scripts , 1996, CHI.

[4]  Jim Clarke.  Automated test generation from a behavioral model , 1998 .

[5]  Muneo Kitajima,et al.  A comprehension-based model of correct performance and errors in skilled, display-based, human-computer interaction , 1995, Int. J. Hum. Comput. Stud..

[6]  Daniel P. Siewiorek,et al.  A method to automate user interface testing using variable finite state machines , 1997, Proceedings of IEEE 27th International Symposium on Fault Tolerant Computing.

[7]  Mary Lou Soffa,et al.  Using a goal-driven approach to generate test cases for GUIs , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[8]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[9]  Philip J. Bernhard,et al.  A reduced test suite for protocol conformance testing , 1994, TSEM.

[10]  Jeffrey J. Hendrickson,et al.  Integrated data capture and analysis tools for research and testing on graphical user interfaces , 1992, CHI.

[11]  Bernhard Nebel,et al.  Extending Planning Graphs to an ADL Subset , 1997, ECP.

[12]  Lee J. White.  Regression testing of GUI event interactions , 1996, 1996 Proceedings of International Conference on Software Maintenance.

[13]  Brad A. Myers,et al.  Why are Human-Computer interfaces Difficult to Design and Implement? , 1993 .

[14]  Fabio Somenzi,et al.  Redundancy identification/removal and test generation for sequential circuits using implicit state enumeration , 1993, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[15]  Muneo Kitajima,et al.  A computational model of skilled use of a graphical user interface , 1992, CHI.

[16]  Theodore G. Lewis,et al.  Integrating the MVC Paradigm into an Object-Oriented Framework to Accelerate GUI Application Development , 1991 .