A Theoretical Study: The Impact of Cloning Failed Test Cases on the Effectiveness of Fault Localization

Statistical fault localization techniques analyze the dynamic program information provided by executing a large number of test cases to predict fault positions in faulty programs. Related studies show that the extent of imbalance between the number of passed test cases and that of failed test cases may reduce the effectiveness of such techniques, while failed test cases can frequently be less than passed test cases in practice. In this study, we propose a strategy to generate balanced test suite by cloning the failed test cases for suitable number of times to catch up with the number of passed test cases. We further give an analysis to show that by carrying out the cloning the effectiveness of two representative fault localization techniques can be improved under certain conditions and impaired at no time.

[1]  W. Eric Wong,et al.  Insights on Fault Interference for Programs with Multiple Bugs , 2009, 2009 20th International Symposium on Software Reliability Engineering.

[2]  Andy Podgurski,et al.  Causal inference for statistical fault localization , 2010, ISSTA '10.

[3]  Wei Zhao,et al.  A similarity-aware approach to testing based fault localization , 2005, ASE '05.

[4]  Lee Naish,et al.  A model for spectra-based software diagnosis , 2011, TSEM.

[5]  Rajiv Gupta,et al.  Fault localization using value replacement , 2008, ISSTA '08.

[6]  Mary Jean Harrold,et al.  Empirical evaluation of the tarantula automatic fault-localization technique , 2005, ASE.

[7]  Yves Le Traon,et al.  Improving test suites for efficient fault localization , 2006, ICSE.

[8]  T. H. Tse,et al.  Capturing propagation of infected program states , 2009, ESEC/FSE '09.

[9]  T. H. Tse,et al.  Non-parametric statistical fault localization , 2011, J. Syst. Softw..

[10]  Lei Zhao,et al.  A Crosstab-based Statistical Method for Effective Fault Localization , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[11]  Peter Zoeteweij,et al.  An Evaluation of Similarity Coefficients for Software Fault Localization , 2006, 2006 12th Pacific Rim International Symposium on Dependable Computing (PRDC'06).

[12]  Michael I. Jordan,et al.  Scalable statistical bug isolation , 2005, PLDI '05.

[13]  Wei Li,et al.  Effects of Class Imbalance in Test Suites: An Empirical Study of Spectrum-Based Fault Localization , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference Workshops.

[14]  Mary Jean Harrold,et al.  An empirical study of the effects of test-suite reduction on fault localization , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.