Comparison of software-reliability-growth predictions: neural networks vs parametric-recalibration

This paper compares empirically the predictive performance of two different methods of software reliability prediction: 'neural networks' and 'recalibration for parametric models'. Both methods were claimed to predict as good or better than the conventional parametric models that have been used-with limited results so far. Each method applied its own predictability measure, impeding a direct comparison. To be able to compare, this study uses a common predictability measure and common data-sets. This study reveals that neural networks are not only much simpler to use than the recalibration method, but that they are equal or better trend (variable term) predictors. The neural network prediction is further improved by preparing the data with a running average, instead of the traditionally used averages of grouped data points. Neural network predictions do not depend on prior known models. Off-the-shelf neural network software tools make it easy to apply the method.

[1]  Yashwant K. Malaiya,et al.  Predictability measures for software reliability models , 1990, Proceedings., Fourteenth Annual International Computer Software and Applications Conference.

[2]  John D. Musa Validity of Execution-Time Theory of Software Reliability , 1979, IEEE Transactions on Reliability.

[3]  Sarah Brocklehurst,et al.  Recalibrating Software Reliability Models , 1990, IEEE Trans. Software Eng..

[4]  Bev Littlewood,et al.  A Bayesian Reliability Model with a Stochastically Monotone Failure Rate , 1974 .

[5]  L. Darrell Whitley,et al.  Prediction of Software Reliability Using Connectionist Models , 1992, IEEE Trans. Software Eng..

[6]  Shigeru Yamada,et al.  S-Shaped Reliability Growth Modeling for Software Error Detection , 1983, IEEE Transactions on Reliability.

[7]  John D. Musa,et al.  A theory of software reliability and its application , 1975, IEEE Transactions on Software Engineering.