An Engineering Approach to Software Test Data Design

A systematic approach to test data design is presented based on both practical translation of theory and organization of professional lore. The approach is organized around five domains and achieving coverage (exercise) of them by the test data. The domains are processing functions, input, output, interaction among functions, and the code itself. Checklists are used to generate data for processing functions. Separate checklists have been constructed for eight common business data processing functions such as editing, updating, sorting, and reporting. Checklists or specific concrete directions also exist for input, output, interaction, and code coverage. Two global heuristics concerning all test data are also used. A limited discussion on documenting test input data, expected results, and actual results is included.

[1]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[2]  Kuo-Chung Tai On program testing criteria , 1979, COMPSAC.

[3]  Edward F. Miller Some statistics from the software testing service , 1979, SOEN.

[4]  B GoodenoughJohn,et al.  Toward a theory of test data selection , 1975 .

[5]  William Atkins,et al.  Managing the Systems Development Process , 1980 .

[6]  John B. Bowen Standard error classification to support software reliability assessment , 1980, AFIPS '80.

[7]  Kenneth A. Foster Error Sensitive Test Cases Analysis (ESTCA) , 1980, IEEE Transactions on Software Engineering.

[8]  Lee J. White,et al.  A Domain Strategy for Computer Program Testing , 1980, IEEE Transactions on Software Engineering.

[9]  E. Bersoff,et al.  Software Configuration Management , 1978, SIGMETRICS Perform. Evaluation Rev..

[10]  S. L. Gerhart,et al.  Toward a theory of test data selection , 1975, IEEE Transactions on Software Engineering.

[11]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[12]  Edward Yourdon,et al.  Managing the structured techniques , 1980 .

[13]  William E. Howden,et al.  Reliability of the Path Analysis Testing Strategy , 1976, IEEE Transactions on Software Engineering.

[14]  Chris Gane,et al.  Structured Systems Analysis: Tools and Techniques , 1977 .

[15]  William E. Howden Completeness criteria for testing elementary program functions , 1981, ICSE '81.

[16]  Alfred Sorkowitz Certification Testing: A Procedure to Improve the Quality of Software Testing , 1979, Computer.