Statistical Methods for Software Reliability Assessment, Past, Present and Future

The role of statistics in software reliability assessment is reviewed in the light of current experience. It is argued that there is a place for statistical methods provided they are founded on the proper sources of uncertainty. These sources are defined and two of them emerge as the basis for reliability predictions. Various perceptions of reliability are identified and attention focuses on one of them, namely the in-use reliability. A general discussion of past and current models for reliability prediction is given together with remarks on several other applications of statistical methods. Some areas of future work are briefly described.

[1]  Harlan D. Mills,et al.  Certifying the reliability of software , 1986, IEEE Transactions on Software Engineering.

[2]  Nozer D. Singpurwalla,et al.  An Empirical Stopping Rule for Debugging and Testing Computer Software , 1977 .

[3]  Nozer D. Singpurwalla,et al.  An Empirically Developed Fourier Series Model for Describing Software Failures , 1984, IEEE Transactions on Reliability.

[4]  Nancy G. Leveson,et al.  An experimental evaluation of the assumption of independence in multiversion programming , 1986, IEEE Transactions on Software Engineering.

[5]  Ushio Sumita,et al.  A Software Reliability Model with Multiple-Error Introduction & Removal , 1986, IEEE Transactions on Reliability.

[6]  Z. Jelinski,et al.  Software reliability Research , 1972, Statistical Computer Performance Evaluation.

[7]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[8]  F.-W. Scholz,et al.  Software reliability modeling and analysis , 1986, IEEE Transactions on Software Engineering.

[9]  Amrit L. Goel,et al.  Optimum release time for software systems based on reliability and cost criteria , 1984, J. Syst. Softw..

[10]  Mitsuru Ohba,et al.  Software Reliability Analysis Models , 1984, IBM J. Res. Dev..

[11]  Sheldon M. Ross,et al.  Software Reliability: The Stopping Rule Problem , 1985, IEEE Transactions on Software Engineering.

[12]  Nozer D. Singpurwalla,et al.  A Unification of Some Software Reliability Models , 1985 .

[13]  Bev Littlewood,et al.  Evaluation of competing software reliability predictions , 1986, IEEE Transactions on Software Engineering.

[14]  William S. Jewell Bayesian Extensions to a Basic Model of Software Reliability , 1985, IEEE Transactions on Software Engineering.

[15]  A. Veevers,et al.  Credibility as a Quantification of Software Reliability , 1985 .

[16]  Wilhelm Kremer,et al.  Birth-Death and Bug Counting , 1983, IEEE Transactions on Reliability.

[17]  C. V. Ramamoorthy,et al.  Software Reliability—Status and Perspectives , 1982, IEEE Transactions on Software Engineering.

[18]  Roger C. Cheung,et al.  A User-Oriented Software Reliability Model , 1978, IEEE Transactions on Software Engineering.

[19]  Peter G. Bishop,et al.  Project on Diverse Software — An Experiment in Software Reliability , 1985 .

[20]  Shigeru Yamada,et al.  Software Reliability Growth Models with Testing-Effort , 1986, IEEE Transactions on Reliability.

[21]  Douglas R. Miller Exponential order statistic models of software reliability growth , 1986, IEEE Transactions on Software Engineering.

[22]  A. Bendell,et al.  Time series methods in reliability , 1987 .

[23]  Nozer D. Singpurwalla,et al.  Assessing (Software) Reliability Growth Using a Random Coefficient Autoregressive Process and Its Ramifications , 1985, IEEE Transactions on Software Engineering.

[24]  J. G. Shanthikumar,et al.  Software reliability models: A review , 1983 .

[25]  Bev Littlewood,et al.  A Bayesian Reliability Model with a Stochastically Monotone Failure Rate , 1974 .

[26]  Ronald R. Luman,et al.  Practical Kalman Filter Software Performance Testing & Validation , 1984, IEEE Transactions on Reliability.

[27]  A. Kandel,et al.  Fuzzy sets, fuzzy algebra, and fuzzy statistics , 1978, Proceedings of the IEEE.