Extensions to an approach to the modeling of software testing with some performance comparisons

It is shown how a major (and questionable) assumption underlying a previously reported approach to the modeling of software testing can be relaxed in order to provide a more realistic model. Under the assumption of uniform execution the new model is found to perform only marginally better than the previous model, indicating that the uniform execution assumption is a poor one. A nonuniform execution model is then shown to give very good performance on application to three sets of software reliability data. Attention is also devoted to the problem of comparing the performance of different models, and some difficulties in this area are noted.

[1]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[2]  Bev Littlewood,et al.  A Bayesian Reliability Growth Model for Computer Software , 1973 .

[3]  Bev Littlewood,et al.  Stochastic Reliability-Growth: A Model for Fault-Removal in Computer-Programs and Hardware-Designs , 1981, IEEE Transactions on Reliability.

[4]  E. Kay,et al.  Methods for statistical analysis of reliability and life data , 1974 .

[5]  C. Harris,et al.  Life Distributions Derived from Stochastic Hazard Functions , 1968 .

[6]  F. Massey.  The Kolmogorov-Smirnov Test for Goodness of Fit , 1951 .

[7]  Z. Jelinski,et al.  Software reliability Research , 1972, Statistical Computer Performance Evaluation.

[8]  Jean-Claude Laprie,et al.  Dependability Evaluation of Software Systems in Operation , 1984, IEEE Transactions on Software Engineering.

[9]  D. McDonald,et al.  On the poisson approximation to the multinomial distribution , 1980 .

[10]  Thomas Downs,et al.  An Approach to the Modeling of Software Testing with Some Applications , 1985, IEEE Transactions on Software Engineering.

[11]  F. G Parsons,et al.  A Kolmogorov - Smirnov goodness-of-fit test for the two-parameter weibull distribution when the parameters are estimated from the data , 1982 .

[12]  Bev Littlewood,et al.  Evaluation of competing software reliability predictions , 1986, IEEE Transactions on Software Engineering.

[13]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for the Exponential Distribution with Mean Unknown , 1969 .

[14]  Bev Littlewood,et al.  Theories of Software Reliability: How Good Are They and How Can They Be Improved? , 1980, IEEE Transactions on Software Engineering.