Resolving the Equivalent Mutant Problem in the Presence of Non-determinism and Coincidental Correctness

In this paper, we develop a new mutation testing technique called Interlocutory Mutation Testing (IMT) that mitigates the equivalent mutant problem in the presence of coincidental correctness and non-determinism. The accuracy of IMT was evaluated; it obtained a classification accuracy of 93.33 % for non-equivalent mutants and 100 % for equivalent mutants in a non-deterministic system with coincidental correctness.

[1]  Wes Masri,et al.  Prevalence of coincidental correctness and mitigation of its impact on fault localization , 2014, TSEM.

[2]  Wes Masri,et al.  UCov: a user‐defined coverage criterion for test case intent verification , 2014, Softw. Test. Verification Reliab..

[3]  Richard H. Carver,et al.  Mutation-based testing of concurrent programs , 1993, Proceedings of IEEE International Test Conference - (ITC).

[4]  A. Jefferson Offutt,et al.  How strong is weak mutation? , 1991, TAV4.

[5]  Bernhard K. Aichernig,et al.  Efficient Refinement Checking for Model-Based Mutation Testing , 2012, 2012 12th International Conference on Quality Software.

[6]  Mark Harman,et al.  A Comprehensive Survey of Trends in Oracles for Software Testing , 2013 .

[7]  Mark Harman,et al.  An Analysis and Survey of the Development of Mutation Testing , 2011, IEEE Transactions on Software Engineering.

[8]  Yves Le Traon,et al.  Trivial Compiler Equivalence: A Large Scale Empirical Study of a Simple, Fast and Effective Equivalent Mutant Detection Technique , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[9]  Tsong Yueh Chen,et al.  METRIC: METamorphic Relation Identification based on the Category-choice framework , 2016, J. Syst. Softw..

[10]  Wes Masri,et al.  Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[12]  Mark Harman,et al.  An analysis of the relationship between conditional entropy and failed error propagation in software testing , 2014, ICSE.

[13]  Jeffrey M. Voas,et al.  PIE: A Dynamic Failure-Based Technique , 1992, IEEE Trans. Software Eng..

[14]  Fei-Ching Kuo,et al.  Verification of phylogenetic Inference Programs Using Metamorphic Testing , 2011, J. Bioinform. Comput. Biol..

[15]  Mark Harman,et al.  A study of equivalent and stubborn mutation operators using human analysis of equivalence , 2014, ICSE.

[16]  Darko Marinov,et al.  MuTMuT: Efficient Exploration for Mutation Testing of Multithreaded Code , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[17]  A. Jefferson Offutt,et al.  Investigations of the software testing coupling effect , 1992, TSEM.

[18]  Mark Harman,et al.  An overview of program slicing , 2001, Softw. Focus.

[19]  Dana Angluin,et al.  Two notions of correctness and their relation to testing , 1982, Acta Informatica.