Fault classes and error detection capability of specification-based testing

Some varieties of specification-based testing rely upon methods for generating test cases from predicates in a software specification. These methods derive various test conditions from logic expressions, with the aim of detecting different types of faults. Some authors have presented empirical results on the ability of specification-based test generation methods to detect failures. This article describes a method for cokmputing the conditions that must be covered by a test set for the test set to guarantee detection of the particular fault class. It is shown that there is a coverage hierarchy to fault classes that is consistent with, and may therefore explain, experimental results on fault-based testing. The method is also shown to be effective for computing MCDC-adequate tests.

[1]  L. J. Morell.  Theoretical insights into fault-based testing , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[2]  HeitmeyerConstance,et al.  Using model checking to generate tests from requirements specifications , 1999 .

[3]  Melvin A. Breuer,et al.  Digital systems testing and testable design , 1990 .

[4]  Paul Ammann,et al.  Using model checking to generate tests from specifications , 1998, Proceedings Second International Conference on Formal Engineering Methods (Cat.No.98EX241).

[5]  Irving S. Reed,et al.  A class of multiple-error-correcting codes and the decoding scheme , 1954, Trans. IRE Prof. Group Inf. Theory.

[6]  Mladen A. Vouk,et al.  Empirical studies of predicate-based software testing , 1994, Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering.

[7]  Hoyt Lougee,et al.  SOFTWARE CONSIDERATIONS IN AIRBORNE SYSTEMS AND EQUIPMENT CERTIFICATION , 2001 .

[8]  Frank M. Brown,et al.  Boolean reasoning - the logic of boolean equations , 1990 .

[9]  Elaine J. Weyuker,et al.  Automatically Generating Test Data from a Boolean Specification , 1994, IEEE Trans. Software Eng..

[10]  Steven P. Miller,et al.  Applicability of modified condition/decision coverage to software testing , 1994, Softw. Eng. J..

[11]  Debra J. Richardson,et al.  The RELAY model of error detection and its application , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[12]  D. Richard Kuhn.  A Technique for Analyzing the Effects of Changes in Formal Specifications , 1992, Comput. J..

[13]  David A. Carrington,et al.  A Framework for Specification-Based Testing , 1996, IEEE Trans. Software Eng..

[14]  Shaoying Liu,et al.  Generating test data from SOFL specifications , 1999, J. Syst. Softw..

[15]  Debra J. Richardson,et al.  An Analysis of Test Data Selection Criteria Using the RELAY Model of Fault Detection , 1993, IEEE Trans. Software Eng..

[16]  Mladen A. Vouk,et al.  Automatic test-generation for predicates [software testing] , 1996, IEEE Trans. Reliab..

[17]  Jr. Sheldon B. Akers,et al.  On a Theory of Boolean Functions , 1959 .

[18]  K. A. Foster,et al.  Sensitive test data for logic expressions , 1984, SOEN.

[19]  Mladen A. Vouk,et al.  Automatic test generation for predicates , 1996, Proceedings of ISSRE '96: 7th International Symposium on Software Reliability Engineering.

[20]  Kuo-Chung Tai,et al.  Test generation for Boolean expressions , 1995, Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95.