Analyzing the Applicability of a Combinatorial Testing Tool in an Industrial Environment

Numerous combinatorial testing tools are available for generating test cases. However, many of them are never used in practice. One of the reasons is the lack of empirical studies that involve human subjects applying testing techniques. This paper aims to investigate the applicability of a combinatorial testing tool in the company SOFTEAM. A case study is designed and conducted within the development team responsible for a new product. The participants consist of 3 practitioners from the company. The applicability of the tool has been examined in terms of efficiency, effectiveness and learning effort.

[1]  Tanja E. J. Vos,et al.  Combinatorial Testing Tool Learnability in an Industrial Environment , 2013, 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement.

[2]  Lionel C. Briand,et al.  Empirical studies of software testing techniques: challenges, practical strategies, and future research , 2004, SOEN.

[3]  Matthias Grochtmann,et al.  Classification trees for partition testing , 1993, Softw. Test. Verification Reliab..

[4]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[5]  Jeff Yu Lei,et al.  Applying Combinatorial Testing to the Siemens Suite , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops.

[6]  Beatriz Marín,et al.  A Methodological Framework for Evaluating Software Testing Techniques and Tools , 2012, 2012 12th International Conference on Quality Software.

[7]  K. Burr,et al.  Combinatorial Test Techniques : Table-based Automation , Test Generation and Code Coverage , 1998 .

[8]  Jeff Yu Lei,et al.  Combinatorial Software Testing , 2009, Computer.

[9]  J. Wegener,et al.  Test Case Design by Means of the CTE XL , 2000 .

[10]  Hareton K. N. Leung,et al.  A survey of combinatorial testing , 2011, CSUR.

[11]  Tanja E. J. Vos,et al.  The OMG UML Testing Profile in Use--An Industrial Case Study for the Future Internet Testing , 2013, 2013 17th European Conference on Software Maintenance and Reengineering.