A Distributed T-Way Test Suite Generation Using "One-Parameter-at-a-Time" Approach

This paper presents a new distributed test suite generation for t-way testing, called TS_OP, using Map and Reduce software framework based on tuple space technology environment. TS_OP takes a oneparameter-at-a-time strategy and is capable of supporting high interaction strength (i.e. t>5). Internally, TS_OP coordinates and distributes the test case generation workload amongst participating workstations. An encouraging result is obtained from experimentation on the optimality of test suite size generated and on the speedup gain in multiple machine environments. Benchmarking studies in term of size of generated test suite against existing parameter based strategies (i.e.IPOG, MIPOG, IPOG-D, IPOG-F and IPOG-F2) indicate that TS_OP gives competitive results.

[1]  Jeff Yu Lei,et al.  Combinatorial Testing of ACTS: A Case Study , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[2]  Kamal Z. Zamli,et al.  MC‐MIPOG: A Parallel t‐Way Test Generation Strategy for Multicore Systems , 2010 .

[3]  Yu Lei,et al.  IPOG-IPOG-D: efficient test generation for multi-way combinatorial testing , 2008 .

[4]  Kamal Z. Zamli,et al.  ITTW: T-way minimization strategy based on intersection of tuples , 2009, 2009 IEEE Symposium on Industrial Electronics & Applications.

[5]  Yu Lei,et al.  Refining the In-Parameter-Order Strategy for Constructing Covering Arrays , 2008, Journal of research of the National Institute of Standards and Technology.

[6]  Jeff Yu Lei,et al.  IPOG: A General Strategy for T-Way Software Testing , 2007, 14th Annual IEEE International Conference and Workshops on the Engineering of Computer-Based Systems (ECBS'07).

[7]  Jeff Yu Lei,et al.  Applying Combinatorial Testing to the Siemens Suite , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops.

[8]  Yu-Wen Tung,et al.  Automating test case generation for the new generation mission software system , 2000, 2000 IEEE Aerospace Conference. Proceedings (Cat. No.00TH8484).

[9]  J. Czerwonka Pairwise Testing in Real World Practical Extensions to Test Case Generators , 2006 .