Approaches to specification-based testing

Current software testing practices focus, almost exclusively, on the implementation, despite widely acknowledged benefits of testing based on software specifications. We propose approaches to specification-based testing by extending a wide variety of implementation-based testing techniques to be applicable to formal specification languages. We demonstrate these approaches for the Anna and Larch specification languages.

[1]  Jeannette M. Wing.  A TWO-TIERED APPROACH TO SPECIFYING PROGRAMS , 1983 .

[2]  Elaine J. Weyuker,et al.  Theories of Program Testing and the Application of Revealing Subdomains , 1980, IEEE Transactions on Software Engineering.

[3]  Olaf Owe,et al.  ANNA A Language for Annotating Ada Programs , 1987, Lecture Notes in Computer Science.

[4]  Lori A. Clarke,et al.  TEAM: a support environment for testing, evaluation, and analysis , 1988, SDE 3.

[5]  John S. Gourlay.  A Mathematical Framework for the Investigation of Testing , 1983, IEEE Transactions on Software Engineering.

[6]  Lori A. Clarke,et al.  A partition analysis method to increase program reliability , 1981, ICSE '81.

[7]  J. Laski.  Testing in top-down program development , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[8]  Laurent Fribourg,et al.  Test sets generation from algebraic specifications using logic programming , 1986, J. Syst. Softw..

[9]  Richard G. Hamlet,et al.  Data Abstraction, Implementation, Specification, and Testing , 1981, TOPL.

[10]  John B. Goodenough,et al.  Toward a theory of test data selection , 1975 .

[11]  James J. Horning,et al.  The Larch Family of Specification Languages , 1985, IEEE Software.

[12]  Lee J. White,et al.  A Domain Strategy for Computer Program Testing , 1980, IEEE Transactions on Software Engineering.

[13]  Lori A. Clarke,et al.  Partition Analysis: A Method Combining Testing and Verification , 1985, IEEE Transactions on Software Engineering.

[14]  Timothy A. Budd,et al.  Program Testing by Specification Mutation , 1985, Comput. Lang..

[15]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[16]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[17]  B GoodenoughJohn,et al.  Toward a theory of test data selection , 1975 .

[18]  Debra J. Richardson,et al.  A New Model for Error Detection , 1986 .

[19]  Lori A. Clarke,et al.  Testing techniques based on symbolic evaluation , 1986 .

[20]  Richard G. Hamlet,et al.  Testing Programs with the Aid of a Compiler , 1977, IEEE Transactions on Software Engineering.

[21]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[22]  Harlan D. Mills,et al.  Theory of Modules , 1987, IEEE Transactions on Software Engineering.

[23]  Richard A. Kemmerer,et al.  Testing Formal Specifications to Detect Design Errors , 1985, IEEE Transactions on Software Engineering.

[24]  William E. Howden,et al.  A functional approach to program testing and analysis , 1986, IEEE Transactions on Software Engineering.

[25]  Flavio R. Dias Velasco.  A method for test data selection , 1987, J. Syst. Softw..

[26]  David C. Luckham,et al.  An Overview of Anna, a Specification Language for Ada , 1985, IEEE Software.

[27]  Lori A. Clarke,et al.  A Formal Evaluation of Data Flow Path Selection Criteria , 1989, IEEE Trans. Software Eng..