Test templates: a specification-based testing framework

Test templates and a test template framework are introduced as useful concepts in specification-based testing. The framework can be defined using any model-based specification notation and used to derive tests from model-based specifications. It is demonstrated using the Z notation. The framework formally defines test data sets and their relation to the operations in a specification and other test data sets, providing structure to the testing process. Flexibility is also preserved, so that many testing strategies can be used. Important application areas of the framework are discussed, including refinement of test data, regression testing, and test oracles.<<ETX>>

[1]  Jim Woodcock,et al.  Software engineering mathematics , 1988 .

[2]  David Carrington,et al.  Deriving Software Test Cases from Formal Specifications , 1991 .

[3]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[4]  Brad J. Cox,et al.  Planning the software industrial revolution , 1990, IEEE Software.

[5]  William E. Howden,et al.  A functional approach to program testing and analysis , 1986, IEEE Transactions on Software Engineering.

[6]  David A. Carrington,et al.  Test template framework: a specification-based testing case study , 1993, ISSTA '93.

[7]  Lee J. White,et al.  A Domain Strategy for Computer Program Testing , 1980, IEEE Transactions on Software Engineering.

[8]  Ian J. Hayes,et al.  Specification directed module testing , 1986, IEEE Transactions on Software Engineering.

[9]  Cliff B. Jones,et al.  Systematic software development using VDM , 1986, Prentice Hall International Series in Computer Science.

[10]  Daniel Hoffman,et al.  Module test case generation , 1989 .

[11]  Ian J. Hayes,et al.  Specification case studies , 1987 .

[12]  Jim Woodcock,et al.  Software engineering mathematics : formal methods demystified , 1988 .

[13]  J. Michael Spivey,et al.  The Z notation - a reference manual , 1992, Prentice Hall International Series in Computer Science.

[14]  Lori A. Clarke,et al.  A Close Look at Domain Testing , 1982, IEEE Transactions on Software Engineering.

[15]  Marie-Claude Gaudel,et al.  Software testing based on formal specifications: a theory and a tool , 1991, Softw. Eng. J..

[16]  Boris Beizer,et al.  Software testing techniques (2. ed.) , 1990 .

[17]  Elaine J. Weyuker,et al.  Some observations on partition testing , 1989, TAV3.

[18]  Debra J. Richardson,et al.  Specification-based test oracles for reactive systems , 1992, International Conference on Software Engineering.

[19]  Juha Kuusela,et al.  Supporting testing of specifications and implementations , 1990 .

[20]  Roy S. Freedman,et al.  Testability of Software Components , 1991, IEEE Trans. Software Eng..

[21]  Elaine J. Weyuker,et al.  Some observations on partition testing , 1989 .

[22]  Elaine J. Weyuker,et al.  Theories of Program Testing and the Application of Revealing Subdomains , 1980, IEEE Transactions on Software Engineering.