Iterative Antirandom Testing

Antirandom testing is a variation of pure random testing, which is the process of generating random patterns and applying it to a system under test (both software systems and hardware systems). However, research studies have shown that pure random testing is relatively less effective at fault detection than other testing techniques. Antirandom testing improves the fault-detection capability of random testing by employing the location information of previously executed test cases. In antirandom testing we select test case such that it is as different as possible from all the previous executed test cases. Unfortunately, this method essentially requires enumeration of the input space and computation of each input pattern when used on an arbitrary set of existing test data. This avoids scale-up to large test sets and (or) long input vectors. The objective of this paper is to find a more efficient method of the test generation which does not need any computation. The key idea of proposed approach is an iterative application of the short antirandom tests where the first test vector in each iteration is generated randomly. Moreover, we propose a new metric the Maximal Minimal Hamming Distance (MMHD) which allows us to define an optimal antirandom test with restricted number of patterns. Experimental results are given to evaluate the performance of the new approach.

[1]  Alan Hartman,et al.  Problems and algorithms for covering arrays , 2004, Discret. Math..

[2]  Pradip K. Srimani,et al.  An Examination of Fault Exposure Ratio , 1993, IEEE Trans. Software Eng..

[3]  James Miller,et al.  A Novel Evolutionary Approach for Adaptive Random Testing , 2009, IEEE Transactions on Reliability.

[4]  Shiyi Xu,et al.  Orderly Random Testing for Both Hardware and Software , 2008, 2008 14th IEEE Pacific Rim International Symposium on Dependable Computing.

[5]  Anneliese Amschler Andrews,et al.  Fast antirandom (FAR) test generation , 1998, Proceedings Third IEEE International High-Assurance Systems Engineering Symposium (Cat. No.98EX231).

[6]  Anura P. Jayasumana,et al.  Antirandom Testing: A Distance-Based Approach , 2008, VLSI Design.

[7]  Janusz Rajski,et al.  Arithmetic Additive Generators of Pseudo-Exhaustive Test Patterns , 1996, IEEE Trans. Computers.

[8]  Edward J. McCluskey,et al.  Pseudorandom Testing , 1987, IEEE Transactions on Computers.

[9]  Shiyi Xu,et al.  Maximum distance testing , 2002, Proceedings of the 11th Asian Test Symposium, 2002. (ATS '02)..

[10]  Mark G. Karpovsky,et al.  Pseudo-exhaustive word-oriented DRAM testing , 1995, Proceedings the European Design and Test Conference. ED&TC 1995.

[11]  Anura P. Jayasumana,et al.  Antirandom vs. pseudorandom testing , 1998, Proceedings International Conference on Computer Design. VLSI in Computers and Processors (Cat. No.98CB36273).

[12]  Tsong Yueh Chen,et al.  Adaptive Random Testing: The ART of test case diversity , 2010, J. Syst. Softw..

[13]  Vishwani D. Agrawal,et al.  A Statistical Theory of Digital Circuit Testability , 1990, IEEE Trans. Computers.

[14]  Abu Khari Bin A'ain,et al.  Scalable test pattern generation (STPG) , 2010, 2010 IEEE Symposium on Industrial Electronics and Applications (ISIEA).

[15]  Janusz Sosnowski Experimental evaluation of pseudorandom test effectiveness , 1998, Proceedings. 24th EUROMICRO Conference (Cat. No.98EX204).

[16]  Mark G. Karpovsky,et al.  Transparent random access memory testing for pattern sensitive faults , 1996, J. Electron. Test..

[17]  H. Wunderlich,et al.  Bit-flipping BIST , 1996, ICCAD 1996.

[18]  Zhi Quan Zhou Using Coverage Information to Guide Test Case Selection in Adaptive Random Testing , 2010, 2010 IEEE 34th Annual Computer Software and Applications Conference Workshops.

[19]  K. Furuya A Probabilistic Approach to Locally Exhaustive Testing , 1989 .

[20]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[21]  Yashwant K. Malaiya,et al.  Antirandom testing: getting the most out of black-box testing , 1995, Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95.

[22]  Arnold L. Rosenberg,et al.  Exhaustive Generation of Bit Patterns with Applications to VLSI Self-Testing , 1983, IEEE Transactions on Computers.

[23]  Huai Liu,et al.  Adaptive Random Testing by Exclusion through Test Profile , 2010, 2010 10th International Conference on Quality Software.

[24]  Günter Kemnitz Synthesis of locally exhaustive test pattern generators , 1995, Proceedings 13th IEEE VLSI Test Symposium.

[25]  Eric Lindbloom,et al.  The Weighted Random Test-Pattern Generator , 1975, IEEE Transactions on Computers.

[26]  Ireneusz Mrozek,et al.  Multi Background Memory Testing , 2007, MIXDES 2007.

[27]  Ireneusz Mrozek,et al.  Multi Background Memory Testing , 2007, 2007 14th International Conference on Mixed Design of Integrated Circuits and Systems.

[28]  Jiongmin Zhang,et al.  A new method to solve the “Boundary Effect” of Adaptive random testing , 2010, 2010 International Conference on Educational and Information Technology.

[29]  James D. McCaffrey An Empirical Study of the Effectiveness of Partial Antirandom Testing , 2009, SEDE.

[30]  A. Jefferson Offutt,et al.  Combination testing strategies: a survey , 2005, Softw. Test. Verification Reliab..

[31]  Hans-Joachim Wunderlich Multiple distributions for biased random test patterns , 1990, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[32]  I. K. Mak,et al.  Adaptive Random Testing , 2004, ASIAN.

[33]  Donald T. Tang,et al.  Exhaustive Test Pattern Generation with Constant Weight Vectors , 1983, IEEE Transactions on Computers.

[34]  Yashwant K. Malaiya,et al.  The Coverage Problem for Random Testing , 1984, ITC.