Predictability of software-reliability models

A two-component predictability measure that characterizes the long-term predictive capability of a model is presented. One component, average error, measures how well a model predicts throughout the testing phase. The other component, average bias, measures the general tendency to overestimate or underestimate the number of faults. Data sets for both large and small projects from diverse sources with various initial fault density ranges have been analyzed. The results show that: (i) the logarithmic model seems to predict well in most data sets, (ii) the inverse polynomial model can be used as the next alternative, and (iii) the delayed S-shaped model, which in some data sets fit well generally performed poorly. The statistical analysis shows that these models have appreciably different predictive capabilities. >

[1]  Martin L. Shooman Probabilistic Models for Software reliability Prediction , 1972, Statistical Computer Performance Evaluation.

[2]  Bev Littlewood,et al.  A Bayesian Reliability Model with a Stochastically Monotone Failure Rate , 1974 .

[3]  John D. Musa,et al.  A theory of software reliability and its application , 1975, IEEE Transactions on Software Engineering.

[4]  Paul B. Moranda,et al.  Predictions of software reliability during debugging , 1975 .

[5]  Alan N. Sukert Empirical Validation of Three Software Error Prediction Models , 1979, IEEE Transactions on Reliability.

[6]  John D. Musa Validity of Execution-Time Theory of Software Reliability , 1979, IEEE Transactions on Reliability.

[7]  Shigeru Yamada,et al.  S-Shaped Reliability Growth Modeling for Software Error Detection , 1983, IEEE Transactions on Reliability.

[8]  Pratap N. Misra,et al.  Software Reliability Analysis , 1983, IBM Syst. J..

[9]  J. Musa,et al.  A logarithmic poisson execution time model for software reliability measurement , 1984, ICSE '84.

[10]  Mitsuru Ohba,et al.  Software Reliability Analysis Models , 1984, IBM J. Res. Dev..

[11]  Nozer D. Singpurwalla,et al.  Assessing (Software) Reliability Growth Using a Random Coefficient Autoregressive Process and Its Ramifications , 1985, IEEE Transactions on Software Engineering.

[12]  Amrit L. Goel,et al.  Software Reliability Models: Assumptions, Limitations, and Applicability , 1985, IEEE Transactions on Software Engineering.

[13]  Bev Littlewood,et al.  Evaluation of competing software reliability predictions , 1986, IEEE Transactions on Software Engineering.

[14]  Katsuro Inoue,et al.  Experimental evaluation of software reliability growth models , 1988, [1988] The Eighteenth International Symposium on Fault-Tolerant Computing. Digest of Papers.

[15]  YOSHIHIRO TOHMA,et al.  Structural Approach to the Estimation of the Number of Residual Software Faults Based on the Hyper-Geometric Distribution , 1989, IEEE Trans. Software Eng..

[16]  Yashwant K. Malaiya,et al.  Predictability measures for software reliability models , 1990, Proceedings., Fourteenth Annual International Computer Software and Applications Conference.

[17]  Sarah Brocklehurst,et al.  Recalibrating Software Reliability Models , 1990, IEEE Trans. Software Eng..

[18]  L. Darrell Whitley,et al.  Prediction of software reliability using neural networks , 1991, Proceedings. 1991 International Symposium on Software Reliability Engineering.

[19]  Yoshihiro Tohma,et al.  The Estimation of Parameters of the Hypergeometric Distribution and Its Application to the Software Reliability Growth Model , 1991, IEEE Trans. Software Eng..

[20]  L. Darrell Whitley,et al.  Prediction of Software Reliability Using Connectionist Models , 1992, IEEE Trans. Software Eng..