Fast antirandom (FAR) test generation

Anti-random testing has proved useful in a series of empirical evaluations. The basic premise of anti-random testing is to choose new test vectors that are as far away from existing test inputs as possible. The distance measure is the Hamming or Cartesian distance. Unfortunately, this method essentially requires emuneration of the input space and computation of each input vector when used on an arbitrary set of existing test data. This prevents scale-up to a large test sets and/or long input vectors. We present and empirically evaluate a technique to generate anti-random vectors that is computationally feasible for large input vectors and long sequences of tests. We also show how this fast anti-random test generation (FAR) can consider retained state (i.e. effects of subsequent inputs on each other). We evaluate effectiveness using branch coverage as the testing criterion.

[1]  Steven J. Leon Linear Algebra With Applications , 1980 .

[2]  R. Taylor,et al.  Partition testing does not inspire confidence , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[3]  Simeon C. Ntafos,et al.  On some reliability estimation problems in random and partition testing , 1991, Proceedings. 1991 International Symposium on Software Reliability Engineering.

[4]  Simeon C. Ntafos,et al.  On Some Reliability Estimation Problems in Random and Partition Testing , 1993, IEEE Trans. Software Eng..

[5]  Yashwant K. Malaiya,et al.  Antirandom testing: getting the most out of black-box testing , 1995, Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95.

[6]  Rohit Kapur,et al.  A weighted random pattern test generation system , 1996, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[7]  T. Bai,et al.  Multi-dimensional sphere model and instantaneous vegetation trend analysis , 1997 .

[8]  William E. Howden,et al.  Systems testing and statistical test data coverage , 1997, Proceedings Twenty-First Annual International Computer Software and Applications Conference (COMPSAC'97).

[9]  Yashwant K. Malaiya,et al.  Automatic test generation using checkpoint encoding and antirandom testing , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.