A new method to solve the “Boundary Effect” of Adaptive random testing

Compare to random testing, Adaptive random testing generates test cases evenly in the input domain so that it can detect the first failure of the program using fewer test cases. But It is found that adaptive random testing will be more inclined to generate test cases on the boundary in the input domain, which is called “Boundary Effect”. The “Boundary Effect” will affect the performance of the adaptive random testing in certain situations, such as in multi-dimensional input domain. This paper presents an effective way to solve the “Boundary Effect” of adaptive random testing in order to enhance the performance in high-dimensional input domain.

[1]  Tsong Yueh Chen,et al.  On Adaptive Random Testing Through Iterative Partitioning , 2006, J. Inf. Sci. Eng..

[2]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[3]  Dave Towey,et al.  Restricted Random Testing: Adaptive Random Testing by Exclusion , 2006, Int. J. Softw. Eng. Knowl. Eng..

[4]  Zongyuan Yang,et al.  An Innovative Approach to Tackling the Boundary Effect in Adaptive Random Testing , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[5]  Tsong Yueh Chen,et al.  Adaptive Random Testing , 2004, ASIAN.

[6]  G. B. Finelli,et al.  NASA Software failure characterization experiments , 1991 .

[7]  Tsong Yueh Chen,et al.  Adaptive random testing by localization , 2004, 11th Asia-Pacific Software Engineering Conference.

[8]  Takahide Yoshikawa,et al.  Random program generator for Java JIT compiler test system , 2003, Third International Conference on Quality Software, 2003. Proceedings..

[9]  Harlan D. Mills,et al.  Engineering software under statistical quality control , 1990, IEEE Software.

[10]  Peter G. Bishop,et al.  The variation of software survival time for different operational input profiles (or why you can wait a long time for a big bug to fail) , 1993, FTCS-23 The Twenty-Third International Symposium on Fault-Tolerant Computing.

[11]  T. Megyeri,et al.  Automatic testing of graphical user interfaces , 2003, Proceedings of the 20th IEEE Instrumentation Technology Conference (Cat. No.03CH37412).

[12]  Fei-Ching Kuo.  On adaptive random testing , 2006 .

[13]  Tsong Yueh Chen,et al.  Proportional sampling strategy: guidelines for software testing practitioners , 1996, Inf. Softw. Technol..

[14]  Donald R. Slutz,et al.  Massive Stochastic Testing of SQL , 1998, VLDB.

[15]  Tsong Yueh Chen,et al.  Test case selection with and without replacement , 2000, Inf. Sci..

[16]  Dave Towey,et al.  Restricted Random Testing , 2002, ECSQ.

[17]  Dave Towey,et al.  A revisit of adaptive random testing by restriction , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[18]  Barton P. Miller,et al.  An empirical study of the robustness of Windows NT applications using random testing , 2000 .

[19]  Huai Liu,et al.  Enhancing Adaptive Random Testing through Partitioning by Edge and Centre , 2007, 2007 Australian Software Engineering Conference (ASWEC'07).

[20]  John J. Marciniak,et al.  Encyclopedia of Software Engineering , 1994, Encyclopedia of Software Engineering.

[21]  Tsong Yueh Chen,et al.  Adaptive random testing through dynamic partitioning , 2004, Fourth International Conference onQuality Software, 2004. QSIC 2004. Proceedings..

[22]  Barton P. Miller,et al.  An empirical study of the reliability of UNIX utilities , 1990, Commun. ACM.

[23]  Barton P. Miller,et al.  Fuzz Revisited: A Re-examination of the Reliability of UNIX Utilities and Services , 1995 .

[24]  R. Hamlet.  RANDOM TESTING , 1994 .

[25]  Ps Loo,et al.  Random testing revisited , 1988 .

[26]  Dave Towey,et al.  Normalized Restricted Random Testing , 2003, Ada-Europe.