Automated Black-Box Testing with Abstract VDM Oracles

In this paper the possibilities to automate black-box testing through formal requirement specifications are explored. More precisely, the formal method VDM (Vienna Development Method) serves to demonstrate that abstract requirement models can be used as test oracles for concrete software. The automation of the resulting testing frame-work is based on modern CASE-tools that support a light-weight approach to formal methods. The specification language used is VDMSL, but the results are easily transferred into similar model oriented methods such as B, Z or RAISE.

[1]  Philip Alan Stocks,et al.  Applying formal methods to software testing , 1993 .

[2]  Bernhard K. Aichernig,et al.  A Proof Obligation Generator for VDM-SL , 1997, FME.

[3]  Michael R. Donat.  Automating Formal Speci cation-Based Testing To Appear: TAPSOFT '97 , 1997 .

[4]  Lionel Van Aertryck.  Une methode et un outil pour l'aide a la generation de jeux de tests de logiciels , 1998 .

[5]  Peter Gorm Larsen,et al.  Combining VDM-SL Specifications with C++ Code , 1996, FME.

[6]  Bernhard K. Aichernig,et al.  Formal Specification of a Voice Communication System Used in Air Traffic Control , 1999, World Congress on Formal Methods.

[7]  Jeremy Dick,et al.  Automating the Generation and Sequencing of Test Cases from Model-Based Specifications , 1993, FME.

[8]  Cliff B. Jones,et al.  Formal methods light , 1996, CSUR.

[9]  Janusz W. Laski.  Data flow testing in STAD , 1990, J. Syst. Softw..

[10]  Jean-Raymond Abrial,et al.  The B-book - assigning programs to meanings , 1996 .

[11]  Peter Gorm Larsen,et al.  Modelling Systems: Practical Tools and Techniques in Software Development , 1998 .

[12]  Boris Beizer,et al.  Software testing techniques (2. ed.) , 1990 .

[13]  Robin E. Bloomfield,et al.  The application of formal methods to the assessment of high integrity software , 1986, IEEE Transactions on Software Engineering.

[14]  Jim Woodcock,et al.  FME '93: Industrial-Strength Formal Methods , 1993, Lecture Notes in Computer Science.

[15]  Thomas Santen,et al.  Automating Test Case Generation from Z Specifications with Isabelle , 1997, ZUM.

[16]  Boris Beizer,et al.  Software Testing Techniques , 1983 .

[17]  Cliff B. Jones,et al.  Systematic software development using VDM , 1986, Prentice Hall International Series in Computer Science.

[18]  Jan Peleska,et al.  Test automation of safety-critical reactive systems , 1997 .

[19]  Michael R. Donat.  Automating Formal Specification-Based Testing , 1997, TAPSOFT.

[20]  Bernhard K. Aichernig.  Automated requirements testing with abstract oracles , 1998 .

[21]  Cliff B. Jones,et al.  A Rigorous Approach to Formal Methods , 1996 .

[22]  Stuart Anderson,et al.  Diagrams and Programming Languages for Programmable Controllers , 1997, FME.

[23]  Sten Agerholm,et al.  Formal specification and validation at work: a case study using VDM-SL , 1998, FMSP '98.

[24]  Michael Z. Spivey,et al.  The Z notation , 1989 .

[25]  Steve A. Schneider,et al.  Test Case Preparation Using a Prototype , 1998, B.

[26]  Bo Stig Hansen,et al.  Information technology - Programming languages, their environments and system software interfaces: Vienna DevelopmentMethod - Specification Language - Part 1: Base language , 1996 .