Optimal Controlled Random Tests

Controlled random tests, methods of their generation, main criteria used for their synthesis, such as the Hamming distance and the Euclidean distance, as well as their application to the testing of both hardware and software systems are discussed. Available evidences suggest that high computational complexity is one of the main drawbacks of these methods. Therefore we propose a technique to overcome this problem. In the paper we propose the algorithm for optimal controlled random tests generation. Both experimental and analytical investigation clearly show the high efficiency of proposed solution especially for the multi-run tests with small number of iterations. The given tests can be applied for hardware and software testing but it seems they may be particularly interesting from the perspective of the effective detection of pattern sensitive faults in RAMs.

[1]  Simeon C. Ntafos,et al.  An Evaluation of Random Testing , 1984, IEEE Transactions on Software Engineering.

[2]  Bo Fu,et al.  An Energy-Efficient Multiwire Error Control Scheme for Reliable On-Chip Interconnects Using Hamming Product Codes , 2008, VLSI Design.

[3]  Shiyi Xu,et al.  Orderly Random Testing for Both Hardware and Software , 2008, 2008 14th IEEE Pacific Rim International Symposium on Dependable Computing.

[4]  Stuart Reid,et al.  An empirical analysis of equivalence partitioning, boundary value analysis and random testing , 1997, Proceedings Fourth International Software Metrics Symposium.

[5]  Janusz Sosnowski.  Experimental evaluation of pseudorandom test effectiveness , 1998, Proceedings. 24th EUROMICRO Conference (Cat. No.98EX204).

[6]  Ireneusz Mrozek,et al.  Iterative Antirandom Testing , 2012, J. Electron. Test..

[7]  K. Furuya.  A Probabilistic Approach to Locally Exhaustive Testing , 1989 .

[8]  D. Richard Kuhn,et al.  Pseudo-Exhaustive Testing for Software , 2006, 2006 30th Annual IEEE/NASA Software Engineering Workshop.

[9]  David Clark,et al.  Test Set Diameter: Quantifying the Diversity of Sets of Test Cases , 2015, 2016 IEEE International Conference on Software Testing, Verification and Validation (ICST).

[10]  Vishwani D. Agrawal,et al.  Failures Guide Probabilistic Search for a Hard-to-Find Test , 2016, 2016 IEEE 25th North Atlantic Test Workshop (NATW).

[11]  Anura P. Jayasumana,et al.  Antirandom Testing: A Distance-Based Approach , 2008, VLSI Design.

[12]  Shiyi Xu,et al.  Maximum distance testing , 2002, Proceedings of the 11th Asian Test Symposium, 2002. (ATS '02)..

[13]  Ireneusz Mrozek,et al.  Controlled method of random test synthesis , 2015, Automatic Control and Computer Sciences.

[14]  Donald T. Tang,et al.  Exhaustive Test Pattern Generation with Constant Weight Vectors , 1983, IEEE Transactions on Computers.

[15]  Zhi Quan Zhou.  Using Coverage Information to Guide Test Case Selection in Adaptive Random Testing , 2010, 2010 IEEE 34th Annual Computer Software and Applications Conference Workshops.

[16]  Hideo Fujiwara,et al.  The Complexity of Fault Detection Problems for Combinational Logic Circuits , 1982, IEEE Transactions on Computers.

[17]  Ireneusz Mrozek,et al.  Antirandom Test Vectors for BIST in Hardware/Software Systems , 2012, Fundam. Informaticae.

[18]  Donald E. Knuth,et al.  The Art of Computer Programming: Volume 3: Sorting and Searching , 1998 .

[19]  Anneliese Amschler Andrews,et al.  Fast antirandom (FAR) test generation , 1998, Proceedings Third IEEE International High-Assurance Systems Engineering Symposium (Cat. No.98EX231).

[20]  Tsong Yueh Chen,et al.  Adaptive Random Testing: The ART of test case diversity , 2010, J. Syst. Softw..

[21]  Vishwani D. Agrawal,et al.  A Statistical Theory of Digital Circuit Testability , 1990, IEEE Trans. Computers.

[22]  Abu Khari Bin A'ain,et al.  Scalable test pattern generation (STPG) , 2010, 2010 IEEE Symposium on Industrial Electronics and Applications (ISIEA).

[23]  Yashwant K. Malaiya,et al.  Antirandom testing: getting the most out of black-box testing , 1995, Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95.

[24]  Vishwani D. Agrawal,et al.  A New Test Vector Search Algorithm for a Single Stuck-at Fault Using Probabilistic Correlation , 2014, 2014 IEEE 23rd North Atlantic Test Workshop.

[25]  Osamu Mizuno,et al.  Distance-Integrated Combinatorial Testing , 2016, 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE).

[26]  Mark G. Karpovsky,et al.  Exhaustive and Near-Exhaustive Memory Testing Techniques and their BIST Implementations , 1997, J. Electron. Test..

[27]  Ireneusz Mrozek,et al.  Methods of Synthesis of Controlled Random Tests , 2016, CISIM.

[28]  Ireneusz Mrozek,et al.  Analysis of multibackground memory testing techniques , 2010, Int. J. Appl. Math. Comput. Sci..