Integrating approximation methods with the generalised proportional sampling strategy

Previous studies have shown that partition testing strategies can be very effective in detecting faults, but they can also be less effective than random testing under unfavourable circumstances. When test cases are allocated in proportion to the size of subdomains, partition testing strategies are provably better than random testing, in the sense of having a higher or equal probability of detecting at least one failure (the P-measure). Recently, the Generalised Proportional Sampling (GPS) strategy, which is always satisfiable, was proposed to relax the proportionality condition. The paper studies the use of approximation methods to generate test distributions satisfying the GPS strategy, and evaluates this proposal empirically. Our results are very encouraging, showing that on average about 98.72% to almost 100% of the test distributions obtained in this way are better than random testing in terms of the P-measure.

[1]  Tsong Yueh Chen,et al.  On the Relationship Between Partition and Random Testing , 1994, IEEE Trans. Software Eng..

[2]  Tsong Yueh Chen,et al.  On the Expected Number of Failures Detected by Subdomain Testing and Random Testing , 1996, IEEE Trans. Software Eng..

[3]  Tsong Yueh Chen,et al.  On the criteria of allocating test cases under uncertainty , 1997, Proceedings of Joint 4th International Computer Science Conference and 4th Asia Pacific Software Engineering Conference.

[4]  Tsong Yueh Chen,et al.  Proportional sampling strategy: guidelines for software testing practitioners , 1996, Inf. Softw. Technol..

[5]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[6]  Simeon C. Ntafos,et al.  An Evaluation of Random Testing , 1984, IEEE Transactions on Software Engineering.

[7]  Elaine J. Weyuker,et al.  Analyzing Partition Testing Strategies , 1991, IEEE Trans. Software Eng..

[8]  Richard G. Hamlet,et al.  Partition Testing Does Not Inspire Confidence , 1990, IEEE Trans. Software Eng..

[9]  Ps Loo,et al.  Random testing revisited , 1988 .

[10]  Jeffrey M. Voas,et al.  Estimating the Probability of Failure When Testing Reveals No Failures , 1992, IEEE Trans. Software Eng..