Quality Evaluation of Object-Oriented and Standard Mutation Operators Applied to C# Programs

Mutation testing is a kind of fault injection approach that can be used to generate tests or to assess the quality of test sets. For object-oriented languages, like C#, both object-oriented and standard (traditional) mutation operators should be applied. The methods that can contribute to reducing the number of applied operators and lowering the costs of mutation testing were experimentally investigated. We extended the CREAM mutation tool to support selective testing, sampling and clustering of mutants, and combining code coverage with mutation testing. We propose an approach to quality evaluation and present experimental results of mutation operators applied to C# programs.

[1]  Anna Derezinska,et al.  Object-Oriented Testing Capabilities and Performance Evaluation of the C# Mutation System , 2009, CEE-SET.

[2]  Gregg Rothermel,et al.  An experimental evaluation of selective mutation , 1993, Proceedings of 1993 15th International Conference on Software Engineering.

[3]  Anna Derezinska.  Advanced mutation operators applicable in C# programs , 2006, SET.

[4]  Baowen Xu,et al.  A Novel Method of Mutation Clustering Based on Domain Analysis , 2009, SEKE.

[5]  Yong Rae Kwon,et al.  Empirical evaluation of orthogonality of class mutation operators , 2004, 11th Asia-Pacific Software Engineering Conference.

[6]  Anna Derezinska.  Quality Assessment of Mutation Operators Dedicated for C# Programs , 2006, 2006 Sixth International Conference on Quality Software (QSIC'06).

[7]  Yong Rae Kwon,et al.  Evaluation of mutation testing for object-oriented programs , 2006, ICSE.

[8]  John A. Clark,et al.  Class Mutation : Mutation Testing for Object-Oriented Programs , 2000 .

[9]  Philippe Chevalley,et al.  Applying mutation analysis for object-oriented programs using a reflective approach , 2001, Proceedings Eighth Asia-Pacific Software Engineering Conference.

[10]  Anna Derezinska,et al.  Distributed Environment Integrating Tools for Software Testing , 2008, SCSS.

[11]  A. Jefferson Offutt,et al.  An Analysis of OO Mutation Operators , 2011, 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops.

[12]  Macario Polo,et al.  Mutation Testing Cost Reduction Techniques: A Survey , 2010, IEEE Software.

[13]  Anna Derezinska,et al.  Tool-Supported Advanced Mutation Approach for Verification of C# Programs , 2008, 2008 Third International Conference on Dependability of Computer Systems DepCoS-RELCOMEX.

[14]  Anna Derezinska,et al.  Object-Oriented Mutation Applied in Common Intermediate Language Programs Originated from C# , 2011, 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops.

[15]  Tao Xie,et al.  Is operator-based mutant selection superior to random mutant selection? , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[16]  YongRaeKwon,et al.  Statistical Investigation on Class Mutation Operators , 2009 .

[17]  A. Jefferson Offutt,et al.  A logic mutation approach to selective mutation for programs and queries , 2011, Inf. Softw. Technol..

[18]  Krzysztof Sacha.  Software Engineering Techniques: Design for Quality, SET 2006, October 17-20, 2006, Warsaw, Poland , 2007, SET.

[19]  Auri Marcelo Rizzo Vincenzi,et al.  Toward the determination of sufficient mutant operators for C † , 2001, Softw. Test. Verification Reliab..

[20]  Akbar Siami Namin,et al.  On Sufficiency of Mutants , 2007, 29th International Conference on Software Engineering (ICSE'07 Companion).

[21]  A. Jefferson Offutt,et al.  Inter-class mutation operators for Java , 2002, 13th International Symposium on Software Reliability Engineering, 2002. Proceedings..

[22]  B.H. Smith,et al.  An Empirical Evaluation of the MuJava Mutation Operators , 2007, Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007).

[23]  Sergio Segura,et al.  Mutation testing on an object-oriented framework: An experience report , 2011, Inf. Softw. Technol..

[24]  A. Jefferson Offutt,et al.  MuJava: an automated class mutation system , 2005, Softw. Test. Verification Reliab..

[25]  W. Eric Wong,et al.  Reducing the cost of mutation testing: An empirical study , 1995, J. Syst. Softw..

[26]  Mark Harman,et al.  An Analysis and Survey of the Development of Mutation Testing , 2011, IEEE Transactions on Software Engineering.