On Favourable Conditions for Adaptive Random Testing

Recently, adaptive random testing (ART) has been developed to enhance the fault-detection effectiveness of random testing (RT). It has been known in general that the fault-detection effectiveness of ART depends on the distribution of failure-causing inputs, yet this understanding is in coarse terms without precise details. In this paper, we conduct an in-depth investigation into the factors related to the distribution of failure-causing inputs that have an impact on the fault-detection effectiveness of ART. This paper gives a comprehensive analysis of the favourable conditions for ART. Our study contributes to the knowledge of ART and provides useful information for testers to decide when it is more cost-effective to use ART.

[1]  Fei-Ching Kuo.  On adaptive random testing , 2006 .

[2]  Paul Ammann,et al.  Data Diversity: An Approach to Software Fault Tolerance , 1988, IEEE Trans. Computers.

[3]  H. Young.  Measuring the Compactness of Legislative Districts , 1988 .

[4]  Donald R. Slutz,et al.  Massive Stochastic Testing of SQL , 1998, VLDB.

[5]  Koushik Sen.  DART: Directed Automated Random Testing , 2009, Haifa Verification Conference.

[6]  T. Megyeri,et al.  Automatic testing of graphical user interfaces , 2003, Proceedings of the 20th IEEE Instrumentation Technology Conference (Cat. No.03CH37412).

[7]  Nicolae Varachiu,et al.  A fuzzy paradigm approach for the cognitive process of categorization , 2002, Proceedings First IEEE International Conference on Cognitive Informatics.

[8]  Carlos Urias Munoz,et al.  Automatic Generation of Random Self-Checking Test Cases , 1983, IBM Syst. J..

[9]  Tsong Yueh Chen,et al.  Proportional sampling strategy: guidelines for software testing practitioners , 1996, Inf. Softw. Technol..

[10]  Barton P. Miller,et al.  An empirical study of the reliability of UNIX utilities , 1990, Commun. ACM.

[11]  Takahide Yoshikawa,et al.  Random program generator for Java JIT compiler test system , 2003, Third International Conference on Quality Software, 2003. Proceedings..

[12]  Tsong Yueh Chen,et al.  Mirror adaptive random testing , 2004, Inf. Softw. Technol..

[13]  Barton P. Miller,et al.  An empirical study of the robustness of Windows NT applications using random testing , 2000 .

[14]  I. K. Mak,et al.  Adaptive Random Testing , 2004, ASIAN.

[15]  Barton P. Miller,et al.  Fuzz Revisited: A Re-examination of the Reliability of UNIX Utilities and Services , 1995 .

[16]  G. B. Finelli,et al.  NASA Software failure characterization experiments , 1991 .

[17]  Tsong Yueh Chen,et al.  Adaptive random testing through dynamic partitioning , 2004 .

[18]  Harlan D. Mills,et al.  Engineering software under statistical quality control , 1990, IEEE Software.

[19]  Tsong Yueh Chen,et al.  On the Relationships between the Distribution of Failure-Causing Inputs and Effectiveness of Adaptive Random Testing , 2005, SEKE.