Simulated Annealing for Constructing Mixed Covering Arrays

Combinatorial testing is a method that can reduce costs and increase the effectiveness of software testing for many applications. It is based on constructing test-suites of economical size, which provide coverage of the most prevalent configurations of parameters. Mixed Covering Arrays (MCAs) are combinatorial structures which can be used to represent these test-suites. This paper presents a new Simulated Annealing (SA) algorithm for Constructing MCAs. This algorithm incorporates several distinguishing features including an efficient heuristic to generate good quality initial solutions, a compound neighborhood function which carefully combines two designed neighborhoods and a fine-tuned cooling schedule. The experimental evidence showed that our SA algorithm improves the obtained results by other approaches reported in the literature, finding the optimal solution in some of the solved cases.

[1]  José Torres-Jiménez,et al.  Construction of Mixed Covering Arrays of Variable Strength Using a Tabu Search Approach , 2010, COCOA.

[2]  Dennis Shasha,et al.  Products of mixed covering arrays of strength two , 2006 .

[3]  Alan W. Williams,et al.  Determination of Test Configurations for Pair-Wise Interaction Coverage , 2000, TestCom.

[4]  Robert L. Probert,et al.  A practical strategy for testing pair-wise coverage of network interfaces , 1996, Proceedings of ISSRE '96: 7th International Symposium on Software Reliability Engineering.

[5]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[6]  D.M. Cohen,et al.  The Combinatorial Design Approach to Automatic Test Generation , 1996, IEEE Softw..

[7]  Binhai Zhu,et al.  Combinatorial Optimization and Applications , 2014, Lecture Notes in Computer Science.

[8]  Charles J. Colbourn,et al.  The density algorithm for pairwise interaction testing , 2007, Softw. Test. Verification Reliab..

[9]  Tatsuhiro Tsuchiya,et al.  Using artificial life techniques to generate test cases for combinatorial testing , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[10]  Jeff Yu Lei,et al.  IPOG: A General Strategy for T-Way Software Testing , 2007, 14th Annual IEEE International Conference and Workshops on the Engineering of Computer-Based Systems (ECBS'07).

[11]  B. Stevens,et al.  Covering arrays with mixed alphabet sizes , 2003 .

[12]  Yu-Wen Tung,et al.  Automating test case generation for the new generation mission software system , 2000, 2000 IEEE Aerospace Conference. Proceedings (Cat. No.00TH8484).

[13]  Myra B. Cohen,et al.  Augmenting simulated annealing to build interaction test suites , 2003, 14th International Symposium on Software Reliability Engineering, 2003. ISSRE 2003..

[14]  George B. Sherwood Optimal and near-optimal mixed covering arrays by column expansion , 2008, Discret. Math..

[15]  José Torres-Jiménez,et al.  New bounds for binary covering arrays using simulated annealing , 2012, Inf. Sci..