Experiences from an Empirical Study of Programs Code Coverage

The paper is devoted to functional and structural testing of programs. Experimental results of a set of programs are presented. The experiments cover selection of functional tests, analysis of function and line coverage and optimization of test suites. The comparison of code coverage results and selection of the most effective tests are discussed in the relation to the test-first approach for program development. The types of the code not covered by the tests are classified for different categories.

[1]  Marco Torchiano,et al.  On the effectiveness of the test-first approach to programming , 2005, IEEE Transactions on Software Engineering.

[2]  David M. Weiss,et al.  Code-coverage guided prioritized test generation , 2006, Inf. Softw. Technol..

[3]  Swapna S. Gokhale,et al.  From test count to code coverage using the Lognormal Failure Rate , 2004, 15th International Symposium on Software Reliability Engineering.

[4]  David Leon,et al.  An Empirical Study of Test Case Filtering Techniques Based on Exercising Information Flows , 2007, IEEE Transactions on Software Engineering.

[5]  Fabio Del Frate,et al.  On the correlation between code coverage and software reliability , 1995, Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95.

[6]  Neelam Gupta,et al.  Improving Fault Detection Capability by Selectively Retaining Test Cases during Test Suite Reduction , 2007, IEEE Transactions on Software Engineering.

[7]  Pekka Abrahamsson,et al.  Does Test-Driven Development Improve the Program Code? Alarming Results from a Comparative Case Study , 2008, CEE-SET.

[8]  Dave Astels,et al.  Test Driven Development: A Practical Guide , 2003 .

[9]  Claes Wohlin,et al.  Using Students as Subjects—A Comparative Study of Students and Professionals in Lead-Time Impact Assessment , 2000, Empirical Software Engineering.

[10]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[11]  Dietmar Pfahl,et al.  Using simulation for assessing the real impact of test-coverage on defect-coverage , 2000, IEEE Trans. Reliab..

[12]  Boris Beizer,et al.  Software Testing Techniques , 1983 .

[13]  Lionel C. Briand,et al.  Using Mutation Analysis for Assessing and Comparing Testing Coverage Criteria , 2006, IEEE Transactions on Software Engineering.

[14]  Gregg Rothermel,et al.  The impact of software evolution on code coverage information , 2001, Proceedings IEEE International Conference on Software Maintenance. ICSM 2001.