Axiomatizing software test data adequacy

A test data adequacy criterion is a set of rules used to determine whether or not sufficient testing has been performed. A general axiomatic theory of test data adequacy is developed, and five previously proposed adequacy criteria are examined to see which of the axioms are satisfied. It is shown that the axioms are consistent, but that only two of the criteria satisfy all of the axioms.

[1]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[2]  Richard G. Hamlet,et al.  Testing Programs with the Aid of a Compiler , 1977, IEEE Transactions on Software Engineering.

[3]  Maurice H. Halstead,et al.  Elements of software science , 1977 .

[4]  Richard J. Lipton,et al.  Theoretical and empirical studies on using program mutation to test the functional correctness of programs , 1980, POPL '80.

[5]  Elaine J. Weyuker,et al.  A Formal Notion of Program-Based Test Data Adequacy , 1983, Inf. Control..

[6]  Martin R. Woodward,et al.  A Measure of Control Flow Complexity in Program Text , 1979, IEEE Transactions on Software Engineering.

[7]  Elaine J. Weyuker,et al.  Selecting Software Test Data Using Data Flow Information , 1985, IEEE Transactions on Software Engineering.

[8]  NED CHAPIN.  A measure of software complexity , 1979, 1979 International Workshop on Managing Requirements Knowledge (MARK).

[9]  Janusz W. Laski,et al.  A Data Flow Oriented Program Testing Strategy , 1983, IEEE Transactions on Software Engineering.

[10]  Maurice H. Halstead,et al.  Toward a theoretical basis for estimating programming effort , 1975, ACM '75.

[11]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[12]  J. C. Huang,et al.  An Approach to Program Testing , 1975, CSUR.

[13]  Simeon C. Ntafos,et al.  On Required Element Testing , 1984, IEEE Transactions on Software Engineering.

[14]  Elaine J. Weyuker,et al.  Data flow analysis techniques for test data selection , 2015, ICSE '82.

[15]  Michael Marcotty,et al.  On the use of the cyclomatic number to measure program complexity , 1978, SIGP.

[16]  Lawrence Yelowitz,et al.  Observations of Fallibility in Applications of Modern Programming Methodologies , 1976, IEEE Transactions on Software Engineering.

[17]  James L. Elshoff,et al.  An investigation into the effects of the counting method used on software science measurements , 1978, SIGP.

[18]  Glenford J. Myers,et al.  An extension to the cyclomatic measure of program complexity , 1977, SIGP.

[19]  Elaine J. Weyuker,et al.  A data flow testing tool , 1985 .

[20]  Wilfred J. Hansen,et al.  Measurement of program complexity by the pair: (Cyclomatic Number, Operator Count) , 1978, SIGP.