GERT: an empirical reliability estimation and testing feedback tool

Software testing is an integral part of the software development process. Some software developers, particularly those who use the Extreme Programming test-driven development practice, continuously write automated tests to verify their code. We present a tool to complement the feedback loops created by continuous testing. The tool combines static source code metrics with dynamic test coverage for use throughout the development phase to predict a reliability estimate based on a linear combination of these values. Implemented as an open source plug-in to the Eclipse IDE, the tool facilitates the rapid transition between unit test case completions and testing feedback. The color-coded results highlight inadequate testing efforts as well as weaknesses in overall program structure. To illustrate the tool's efficacy, we share the results of its use on university software engineering course projects.

[1]  Jason A. Osborne,et al.  Initial results of using in-process testing metrics to estimate software reliability , 2004 .

[2]  Swapna S. Gokhale,et al.  SREPT: software reliability estimation and prediction tool , 2000, Perform. Evaluation.

[3]  Michael R. Lyu,et al.  What is software reliability? , 1994, Proceedings of COMPASS'94 - 1994 IEEE 9th Annual Conference on Computer Assurance.

[4]  Jeffrey M. Voas,et al.  Faults on its sleeve: amplifying software reliability testing , 1993, ISSTA '93.

[5]  Mladen A. Vouk Software Reliability Engineering , 1999 .

[6]  John D. Musa,et al.  Software Reliability Engineering , 1998 .

[7]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[8]  George E. Stark A survey of software reliability measurement tools , 1991, Proceedings. 1991 International Symposium on Software Reliability Engineering.

[9]  Kent L. Beck,et al.  Test-driven Development - by example , 2002, The Addison-Wesley signature series.

[10]  Yashwant K. Malaiya,et al.  ROBUST: a next generation software reliability engineering tool , 1995, Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95.

[11]  Mladen A. Vouk,et al.  Towards a Metric Suite for Early Software Reliability Assessment , 2003 .

[12]  Khaled El Emam,et al.  The Confounding Effect of Class Size on the Validity of Object-Oriented Metrics , 2001, IEEE Trans. Software Eng..