Experiences in coverage testing of a Java middleware

This paper addresses the issues of test coverage analysis of J2EE [22] servers. These middleware are nowadays at the core of the modern information technology's landscape. They provide enterprise applications with several non functional services such as security, persistence, transaction, messaging, etc. In several cases, J2EE servers play a critical role when applied to e-business or banking applications. Therefore, ensuring the quality of such software layers becomes an essential requirement. However, in industrial context, professional middleware software are highly complicated and have a huge size which makes their maintenance and quality management a big challenge for testers and quality managers. The aim of this paper is to present our test and coverage analysis case study with and the JOnAS [23] J2EE server. The challenges of this work result from the size of the test suites and the size of the tested middleware (200,000 lines of code (LOC) for JOnAS)

[1]  Aditya P. Mathur,et al.  Certification of Distributed Component Computing Middleware and Applications , 2001 .

[2]  Michael R. Lyu,et al.  A coverage analysis tool for the effectiveness of software testing , 1993, Proceedings of 1993 IEEE International Symposium on Software Reliability Engineering.

[3]  Yong Woo Kim,et al.  Efficient use of code coverage in large-scale software development , 2003, CASCON.

[4]  J Hayhurst Kelly,et al.  Streamlining Software Aspects of Certification: Report on the SSAC Survey , 1999 .

[5]  James F. Power,et al.  A Coverage Analysis of Java Benchmark Suites , 2005, IASTED Conf. on Software Engineering.

[6]  Paul A. Strooper,et al.  A case study in testing distributed systems , 2001, Proceedings 3rd International Symposium on Distributed Objects and Applications.

[7]  Christian Trefftz,et al.  Tools for coverage testing: necessary but not sufficient , 2004 .

[8]  Avi Ziv,et al.  Defining coverage views to improve functional coverage analysis , 2004, Proceedings. 41st Design Automation Conference, 2004..

[9]  Elaine J. Weyuker,et al.  The distribution of faults in a large industrial software system , 2002, ISSTA '02.

[10]  C. Mallows,et al.  When Should One Stop Testing Software , 1988 .

[11]  David S. Rosenblum,et al.  Using Coverage Information to Predict the Cost-Effectiveness of Regression Testing Strategies , 1997, IEEE Trans. Software Eng..

[12]  Yashwant K. Malaiya,et al.  Estimating Defect Density Using Test Coverage , 1999 .

[13]  Paul Piwowarski,et al.  Coverage measurement experience during function test , 1993, Proceedings of 1993 15th International Conference on Software Engineering.

[14]  Brian Marick,et al.  EXPERIENCE WITH THE COST OF DIFFERENT COVERAGE GOALS FOR TESTING , 1991 .

[15]  Stephen S. Yau,et al.  Testing context-sensitive middleware-based software applications , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[16]  J Hayhurst Kelly,et al.  A Practical Tutorial on Modified Condition/Decision Coverage , 2001 .

[17]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[18]  Steven P. Miller,et al.  Applicability of modified condition/decision coverage to software testing , 1994, Softw. Eng. J..