A UML-based approach to system testing

Abstract.This article describes an approach for automatically generating and executing system tests, which can be used to improve the validation of an application. Tests are automatically generated from behavioural models of the application using the unified modelling language (UML) and then executed using a suitable test execution environment. For this paper, we demonstrate our approach by means of an application that interacts with its users via a graphical user interface. Thus, we discuss the test- execution phase with respect to a commercial user interface (UI) or capture–replay tool.In this article, we show how, in the first step, a test designer manually annotates the UML models, which may have been semiautomatically extracted from existing, textual-use case documentation, with test requirements. In the second step, the test- generation tool automatically creates a set of textual test procedures (test cases) or executable test scripts. In the third step, a test executor runs these against the system under test using a commercial UI testing tool.The goal of the article is to illustrate the benefits of an automated, model-based approach for improving system test design, generation and execution. Details regarding the different tools are given.

[1]  Thomas J. Ostrand,et al.  A visual test development environment for GUI systems , 1998, ISSTA.

[2]  Thomas J. Ostrand,et al.  Automatic Generation of Test Scripts from Formal Test Specifications , 1989, Symposium on Testing, Analysis, and Verification.

[3]  Lionel C. Briand,et al.  A UML-Based Approach to System Testing , 2001, UML.

[4]  A. Jefferson Offutt,et al.  Using UML Collaboration Diagrams for Static Checking and Test Generation , 2000, UML.

[5]  Antonia Bertolino,et al.  Use case-based testing of product lines , 2003, ESEC/FSE-11.

[6]  Mary Lou Soffa,et al.  A comprehensive framework for testing graphical user interfaces , 2001 .

[7]  Peter Fröhlich,et al.  Automated Test Case Generation from Dynamic Models , 2000, ECOOP.

[8]  Jean Hartmann,et al.  UML-Based integration testing , 2000, ISSTA '00.

[9]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[10]  David Lugato,et al.  Validation and automatic test generation on UML models: the AGATHA approach , 2002, Electron. Notes Theor. Comput. Sci..

[11]  Jeff Offutt,et al.  Generating Test Cases from UML Specifications , 1999 .

[12]  Atif M. Memon GUI Testing: Pitfalls and Process , 2002, Computer.

[13]  Christian Stary,et al.  IDATG: an open tool for automated testing of interactive software , 1998, Proceedings. The Twenty-Second Annual International Computer Software and Applications Conference (Compsac '98) (Cat. No.98CB 36241).

[14]  Thomas J. Ostrand,et al.  Automatic generation of test scripts from formal test specifications , 1989 .