Software Reliability Models and Test Coverage

In recent works some authors proposed to use measures of test coverage in software reliability estimation. They suggested to use these measures either to improve the predictive accuracy of classical reliability growth models or to provide a direct estimation of reliability. This paper provides a short survey of these approaches and describes a case study aimed at investigating the relation between test coverage and reliability growth. Results of the case study are analysed and used to discuss the validity of the proposed approaches.

[1]  Ricky W. Butler,et al.  The infeasibility of experimental quantification of life-critical software reliability , 1991 .

[2]  Bev Littlewood,et al.  Validation of ultrahigh dependability for software-based systems , 1993, CACM.

[3]  Eldred Nelson,et al.  Estimating software reliability from test data , 1978 .

[4]  Fabio Del Frate,et al.  On the correlation between code coverage and software reliability , 1995, Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95.

[5]  Sarah Brocklehurst,et al.  Recalibrating Software Reliability Models , 1990, IEEE Trans. Software Eng..

[6]  Adam C. Marshall,et al.  A relationship between software coverage metrics and reliability , 1994, Softw. Test. Verification Reliab..

[7]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[8]  Michael R. Lyu,et al.  Applying reliability models more effectively (software) , 1992, IEEE Software.

[9]  Philip S. Yu,et al.  Optimal Design and Sequential Analysis of VLSI Testing Strategy , 1988, IEEE Trans. Computers.

[10]  M. A. Hennell,et al.  Testing for the achievement of software reliability , 1991 .

[11]  John D. Musa,et al.  Software reliability measurement , 1984, J. Syst. Softw..

[12]  Douglas R. Miller,et al.  On the use and the performance of software reliability growth models , 1991 .

[13]  Joseph Robert Horgan,et al.  Assessing testing tools in research and education , 1992, IEEE Software.

[14]  James M. Bieman,et al.  The relationship between test coverage and reliability , 1994, Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering.

[15]  Paul Piwowarski,et al.  Coverage measurement experience during function test , 1993, Proceedings of 1993 15th International Conference on Software Engineering.

[16]  Raymond Jacoby,et al.  Test coverage dependent software reliability estimation by the HGD model , 1992, [1992] Proceedings Third International Symposium on Software Reliability Engineering.

[17]  Sarah Brocklehurst,et al.  Combination of Predictions Obtained from Different Software Reliability Growth Models , 1995 .

[18]  David Lindley,et al.  Optimal Statistical Decisions , 1971 .

[19]  John D. Musa,et al.  Operational profiles in software-reliability engineering , 1993, IEEE Software.

[20]  Sarah Brocklehurst,et al.  New Ways to Get Accurate Reliability Measures , 1992, IEEE Softw..

[21]  Wen-Ben Jone.  Defect level estimation of circuit testing using sequential statistical analysis , 1993, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..