Automating test case design within the classification tree editor

This paper describes how the proven test design technique of the classification tree method is extended within the classification tree editor in order to contribute to current test design matters. The classification tree editor not only provides the tooling to use the method but also to apply new and helpful features in the test design process. This includes the automatic generation of test cases and test sequences according to desired test depth and focus, automated boundary value analysis, various tool couplings to integrate in each individual test process and supporting features like test evaluation or test coverage analysis amongst others.

[1]  Tanja E. J. Vos,et al.  Assessing the Applicability of a Combinatorial Testing tool within an Industrial Environment , 2014, CIbSE.

[2]  Hareton K. N. Leung,et al.  A survey of combinatorial testing , 2011, CSUR.

[3]  Myra B. Cohen,et al.  Testing across configurations: implications for combinatorial testing , 2006, SOEN.

[4]  Hareton K. N. Leung,et al.  The Minimal Failure-Causing Schema of Combinatorial Testing , 2011, TSEM.

[5]  Charles J. Colbourn,et al.  Prioritized interaction testing for pair-wise coverage with seeding and constraints , 2006, Inf. Softw. Technol..

[6]  Myra B. Cohen,et al.  Interaction Coverage Meets Path Coverage by SMT Constraint Solving , 2009, TestCom/FATES.

[7]  Theodorich Kopetzky,et al.  Combinatorial Test Design in the TOSCA Testsuite: Lessons Learned and Practical Implications , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[8]  Soumen Maity,et al.  Improved test generation algorithms for pair-wise testing , 2005, 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05).

[9]  Dewayne E. Perry,et al.  A case study in root cause defect analysis , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[10]  Yu Lei,et al.  In-parameter-order: a test generation strategy for pairwise testing , 1998, Proceedings Third IEEE International High-Assurance Systems Engineering Symposium (Cat. No.98EX231).

[11]  Andreas Zeller,et al.  Finding Failure Causes through Automated Testing , 2000, AADEBUG.

[12]  Joachim Wegener,et al.  Test Sequence Generation from Classification Trees , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[13]  Tanja E. J. Vos,et al.  Combinatorial Testing Tool Learnability in an Industrial Environment , 2013, 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement.

[14]  D. Richard Kuhn,et al.  Software fault interactions and implications for software testing , 2004, IEEE Transactions on Software Engineering.

[15]  Nelly Condori-Fernández,et al.  Analyzing the Applicability of a Combinatorial Testing Tool in an Industrial Environment , 2014 .

[16]  Angelo Gargantini,et al.  A Formal Logic Approach to Constrained Combinatorial Testing , 2010, Journal of Automated Reasoning.

[17]  Charles J. Colbourn,et al.  The density algorithm for pairwise interaction testing: Research Articles , 2007 .

[18]  Jurriaan Hage,et al.  Logging to Facilitate Combinatorial System Testing , 2013, FITTEST@ICTSS.

[19]  J. Czerwonka.  Pairwise Testing in Real World Practical Extensions to Test Case Generators , 2006 .

[20]  Hareton K. N. Leung,et al.  Adaptive Combinatorial Testing , 2013, 2013 13th International Conference on Quality Software.

[21]  Peter M. Kruse,et al.  Automated Test Case Generation Using Classification Trees , 2010 .

[22]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[23]  Raghu Kacker,et al.  Identifying Failure-Inducing Combinations in a Combinatorial Test Set , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[24]  J. Wegener,et al.  Test Case Design by Means of the CTE XL , 2000 .

[25]  James J. Rooney,et al.  Root cause analysis for beginners , 2004 .

[26]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[27]  A. Jefferson Offutt,et al.  Combination testing strategies: a survey , 2005, Softw. Test. Verification Reliab..

[28]  Nelly Condori-Fernández,et al.  Systematic Testing of Web Applications with the Classification Tree Method , 2014, CIbSE.

[29]  Enrique Alba,et al.  Evolutionary algorithm for prioritized pairwise test data generation , 2012, GECCO '12.

[30]  Matthias Grochtmann,et al.  Classification trees for partition testing , 1993, Softw. Test. Verification Reliab..

[31]  Michael L. Fredman,et al.  The AETG System: An Approach to Testing Based on Combinatiorial Design , 1997, IEEE Trans. Software Eng..

[32]  Myra B. Cohen,et al.  An Improved Meta-heuristic Search for Constrained Interaction Testing , 2009, 2009 1st International Symposium on Search Based Software Engineering.

[33]  Ina Schieferdecker,et al.  Comparison of approaches to prioritized test generation for combinatorial interaction testing , 2012, 2012 Federated Conference on Computer Science and Information Systems (FedCSIS).

[34]  Matthias Grochtmann,et al.  Test Case Design Using Classification Trees and the Classification-Tree Editor CTE , 1995 .

[35]  Myra B. Cohen,et al.  Efficiency and early fault detection with lower and higher strength combinatorial interaction testing , 2013, ESEC/FSE 2013.

[36]  Nelly Condori-Fernandez,et al.  Evaluating applicability of combinatorial testing in an industrial environment: a case study , 2013, JAMAICA 2013.

[37]  Eitan Farchi,et al.  Using binary decision diagrams for combinatorial test design , 2011, ISSTA '11.

[38]  Myra B. Cohen,et al.  A deterministic density algorithm for pairwise interaction coverage , 2004, IASTED Conf. on Software Engineering.

[39]  Mary Lou Soffa,et al.  TimeAware test suite prioritization , 2006, ISSTA '06.

[40]  Gregg Rothermel,et al.  The Effects of Time Constraints on Test Case Prioritization: A Series of Controlled Experiments , 2010, IEEE Transactions on Software Engineering.

[41]  Myra B. Cohen,et al.  Interaction testing of highly-configurable systems in the presence of constraints , 2007, ISSTA '07.

[42]  Joachim Wegener,et al.  Numerical Constraints for Combinatorial Interaction Testing , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[43]  Gregg Rothermel,et al.  Test Case Prioritization: A Family of Empirical Studies , 2002, IEEE Trans. Software Eng..