The Way Forward for Unifying Dynamic Test Case Generation: The Optimisation-based Approach

One of the major costs in a software project is the construction of test-data. This paper outlines a generalised test-case data generation framework based on optimisation techniques. The framework can incorporate a number of testing criteria, for both functional and non-functional properties. Application of the optimisation framework to testing specification failures and exception conditions is illustrated. The results of a number of small case studies are presented and show the efficiency and effectiveness of this dynamic optimisation-base approach to generating test-data.

[1]  Victor J. Rayward-Smith,et al.  Modern Heuristic Search Methods , 1996 .

[2]  C. Reeves.  Modern heuristic techniques for combinatorial problems , 1993 .

[3]  Bogdan Korel,et al.  Automated test data generation for programs with procedures , 1996, ISSTA '96.

[4]  Karl N. Levitt,et al.  SELECT—a formal system for testing and debugging programs by symbolic execution , 1975 .

[5]  Martyn A. Ould,et al.  Testing-a challenge to method and tool developers , 1991, Softw. Eng. J..

[6]  Bogdan Korel,et al.  The chaining approach for software test data generation , 1996, TSEM.

[7]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[8]  Said Salhi,et al.  Heuristic Search Methods , 1998 .

[9]  Lori A. Clarke,et al.  A System to Generate Test Data and Symbolically Execute Programs , 1976, IEEE Transactions on Software Engineering.

[10]  Boris Beizer,et al.  Software Testing Techniques , 1983 .

[11]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[12]  Eugene H. Spafford,et al.  Extending mutation testing to find environmental bugs , 1990, Softw. Pract. Exp..

[13]  A. Jefferson Offutt,et al.  The dynamic domain reduction procedure for test data generation , 1999, Softw. Pract. Exp..

[14]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..

[15]  F. Glover,et al.  In Modern Heuristic Techniques for Combinatorial Problems , 1993 .

[16]  Darrel C. Ince,et al.  The Automatic Generation of Test Data , 1987, Comput. J..

[17]  John Barnes,et al.  High Integrity Ada: The Spark Approach , 1997 .

[18]  Bogdan Korel,et al.  Automated Software Test Data Generation , 1990, IEEE Trans. Software Eng..

[19]  James C. King,et al.  Symbolic execution and program testing , 1976, CACM.

[20]  David L. Spooner,et al.  Automatic Generation of Floating-Point Test Data , 1976, IEEE Transactions on Software Engineering.

[21]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[22]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[23]  Bryan F. Jones,et al.  Automatic structural testing using genetic algorithms , 1996, Softw. Eng. J..