Mutation Testing and Test Data Generation Approaches: A Review

Software advancement has increased the complexities many fold and to meet the quality standards, a lot of research is being done in designing new testing methodologies and tools. Mutation testing is a proven effective technique but the high cost attached with it averts it from establishing it as an industrial tool. The review is an extension of the previous work where a review was done on search based test data generation and mutation testing. The objective is to study the remaining techniques/approaches and summaries the discussion of both the reviews. The application of mutation testing with various techniques at various phases of software development along with various languages/tools show that it is a versatile, adaptable and efficient, which is motivating the researchers to explore the new areas.

[1]  Jinhui Shan,et al.  An Approach to Test Data Generation for Killing Multiple Mutants , 2006, 2006 22nd IEEE International Conference on Software Maintenance.

[2]  Mike Papadakis,et al.  Strong Mutation-Based Test Data Generation Using Hill Climbing , 2016, 2016 IEEE/ACM 9th International Workshop on Search-Based Software Testing (SBST).

[3]  Jan Jürjens,et al.  Specification-Based Test Generation for Security-Critical Systems Using Mutations , 2002, ICFEM.

[4]  Mike Papadakis,et al.  An Effective Path Selection Strategy for Mutation Testing , 2009, 2009 16th Asia-Pacific Software Engineering Conference.

[5]  A. J. Offutt.  A practical system for mutation testing: help for the common programmer , 1994, Proceedings., International Test Conference.

[6]  Mark Harman,et al.  An Analysis and Survey of the Development of Mutation Testing , 2011, IEEE Transactions on Software Engineering.

[7]  Hong Zhu,et al.  Testing software modelling tools using data mutation , 2006, AST '06.

[8]  Rashmi Agrawal,et al.  Search based techniques and mutation analysis in automatic test case generation: A survey , 2015, 2015 IEEE International Advance Computing Conference (IACC).

[9]  Andreas Zeller,et al.  Mutation-Driven Generation of Unit Tests and Oracles , 2012, IEEE Trans. Software Eng..

[10]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[11]  Mike Papadakis,et al.  Mutation based test case generation via a path selection strategy , 2012, Inf. Softw. Technol..

[12]  Mike Papadakis,et al.  Searching and generating test inputs for mutation testing , 2013, SpringerPlus.

[13]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..

[14]  A. Jefferson Offutt,et al.  Experimental results from an automatic test case generator , 1993, TSEM.

[15]  William E. Howden,et al.  Weak Mutation Testing and Completeness of Test Sets , 1982, IEEE Transactions on Software Engineering.

[16]  Daniel Kroening,et al.  Mutation-Based Test Case Generation for Simulink Models , 2009, FMCO.

[17]  Jonas Mellin,et al.  Test Case Generation for Mutation-based Testing of Timeliness , 2006, Electron. Notes Theor. Comput. Sci..

[18]  Silvia Regina Vergilio,et al.  A Mutation and Multi-objective Test Data Generation Approach for Feature Testing of Software Product Lines , 2015, 2015 29th Brazilian Symposium on Software Engineering.

[19]  Bernhard K. Aichernig,et al.  Test case generation by OCL mutation and constraint solving , 2005, Fifth International Conference on Quality Software (QSIC'05).

[20]  Mike Papadakis,et al.  Test Data Generation Techniques for Mutation Testing: A Systematic Mapping , 2014, CIbSE.

[21]  Nikolai Tillmann,et al.  Test generation via Dynamic Symbolic Execution for mutation testing , 2010, 2010 IEEE International Conference on Software Maintenance.

[22]  Mike Papadakis,et al.  Automatic Mutation Test Case Generation via Dynamic Symbolic Execution , 2010, 2010 IEEE 21st International Symposium on Software Reliability Engineering.

[23]  Y. Yesha,et al.  Specification mutation for test generation and analysis , 2004 .

[24]  Macario Polo,et al.  Mutation at System and Functional Levels , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[25]  Jean-Marc Jézéquel,et al.  Design by Contract to Improve Software Vigilance , 2006, IEEE Transactions on Software Engineering.

[26]  Andreas Zeller,et al.  Generating parameterized unit tests , 2011, ISSTA '11.

[27]  A. Jefferson Offutt,et al.  Mutation 2000: uniting the orthogonal , 2001 .

[28]  Matthew Timothy Patrick,et al.  Mutation-optimised subdomains for test data generation and program analysis , 2013 .

[29]  Laurie A. Williams,et al.  On guiding the augmentation of an automated test suite via mutation analysis , 2009, Empirical Software Engineering.