Predictability measures for software reliability models

A two-component predictability measure is presented that characterizes the long-term predictability of a software reliability growth model. The first component, average predictability, measures how well a model predicts throughout the testing phase. The second component, average bias, is a measure of the general tendency to overestimate or underestimate the number of faults. Data sets for both large and small projects from diverse sources have been analyzed. The results seem to support the observation that the logarithmic model appears to have good predictability is most cases. However, at very low fault densities, the exponential model may be slightly better. The delayed S-shaped model which in some cases has been shown to have good fit, generally performed poorly.<<ETX>>

[1]  Alan N. Sukert Empirical Validation of Three Software Error Prediction Models , 1979, IEEE Transactions on Reliability.

[2]  Paul B. Moranda,et al.  Predictions of software reliability during debugging , 1975 .

[3]  Pratap N. Misra,et al.  Software Reliability Analysis , 1983, IBM Syst. J..

[4]  Sarah Brocklehurst,et al.  Recalibrating Software Reliability Models , 1990, IEEE Trans. Software Eng..

[5]  William H Farr A Survey of Software Reliability Modeling and Estimation , 1983 .

[6]  Bev Littlewood,et al.  Evaluation of competing software reliability predictions , 1986, IEEE Transactions on Software Engineering.

[7]  Amrit L. Goel,et al.  Software Reliability Models: Assumptions, Limitations, and Applicability , 1985, IEEE Transactions on Software Engineering.

[8]  Bev Littlewood,et al.  A Bayesian Reliability Model with a Stochastically Monotone Failure Rate , 1974 .

[9]  Martin L. Shooman,et al.  Probabilistic Models for Software reliability Prediction , 1972, Statistical Computer Performance Evaluation.

[10]  John D. Musa,et al.  Software reliability measurement , 1984, J. Syst. Softw..

[11]  Mitsuru Ohba,et al.  Software Reliability Analysis Models , 1984, IBM J. Res. Dev..

[12]  John D. Musa Validity of Execution-Time Theory of Software Reliability , 1979, IEEE Transactions on Reliability.

[13]  Katsuro Inoue,et al.  Experimental evaluation of software reliability growth models , 1988, [1988] The Eighteenth International Symposium on Fault-Tolerant Computing. Digest of Papers.

[14]  John D. Musa,et al.  A theory of software reliability and its application , 1975, IEEE Transactions on Software Engineering.

[15]  B. M. Brown,et al.  Practical Non-Parametric Statistics. , 1981 .

[16]  Shigeru Yamada,et al.  S-Shaped Reliability Growth Modeling for Software Error Detection , 1983, IEEE Transactions on Reliability.

[17]  Nozer D. Singpurwalla,et al.  Assessing (Software) Reliability Growth Using a Random Coefficient Autoregressive Process and Its Ramifications , 1985, IEEE Transactions on Software Engineering.