Software Reliability Models: Assumptions, Limitations, and Applicability

A number of analytical models have been proposed during the past 15 years for assessing the reliability of a software system. In this paper we present an overview of the key modeling approaches, provide a critical analysis of the underlying assumptions, and assess the limitations and applicability of these models during the software development cycle. We also propose a step-by-step procedure for fitting a model and illustrate it via an analysis of failure data from a medium-sized real-time command and control software system.

[1]  George J. Schick,et al.  An Analysis of Competing Software Reliability Models , 1978, IEEE Transactions on Software Engineering.

[2]  John D. Musa.  Validity of Execution-Time Theory of Software Reliability , 1979, IEEE Transactions on Reliability.

[3]  Amrit L. Goel.  Software error detection model with applications , 1980, J. Syst. Softw..

[4]  Lawrence Yelowitz,et al.  Observations of Fallibility in Applications of Modern Programming Methodologies , 1976, IEEE Transactions on Software Engineering.

[5]  T. A. Thayer,et al.  Software Reliability Study. , 1974 .

[6]  Amrit L. Goel.  A Guidebook for Software Reliability Assessment. , 1983 .

[7]  J. E. Angus.  The Application of Software Reliability Models to a Major C/sup 3/I System , 1984 .

[8]  W D Brooks,et al.  Analysis of Discrete Software Reliability Models. , 1980 .

[9]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[10]  Nozer D. Singpurwalla,et al.  An Empirically Developed Fourier Series Model for Describing Software Failures , 1984, IEEE Transactions on Reliability.

[11]  Wilhelm Kremer,et al.  Birth-Death and Bug Counting , 1983, IEEE Transactions on Reliability.

[12]  C. V. Ramamoorthy,et al.  Software Reliability—Status and Perspectives , 1982, IEEE Transactions on Software Engineering.

[13]  Eldred Nelson,et al.  Estimating software reliability from test data , 1978 .

[14]  Norman F. Schneidewind,et al.  Analysis of error processes in computer software , 1975, Reliable Software.

[15]  Pratap N. Misra,et al.  Software Reliability Analysis , 1983, IBM Syst. J..

[16]  Amrit L Goel,et al.  Software Reliability Modelling and Estimation Techniques. , 1982 .

[17]  M. Lipow,et al.  Testing for software reliability , 1975, Reliable Software.

[18]  AMRIT L. GOEL,et al.  A Markovian model for reliability and other performance measures of software systems* , 1979, 1979 International Workshop on Managing Requirements Knowledge (MARK).

[19]  Bev Littlewood,et al.  Theories of Software Reliability: How Good Are They and How Can They Be Improved? , 1980, IEEE Transactions on Software Engineering.

[20]  Amrit L. Goel,et al.  Availability and other performance measures of software systems under imperfect maintenance , 1978, COMPSAC.

[21]  Martin L. Shooman,et al.  Probabilistic Models for Software reliability Prediction , 1972, Statistical Computer Performance Evaluation.

[22]  Nozer D. Singpurwalla,et al.  An Empirical Stopping Rule for Debugging and Testing Computer Software , 1977 .

[23]  Barry W. Boehm,et al.  Quantitative evaluation of software quality , 1976, ICSE '76.

[24]  Glenford J. Myers,et al.  Software Reliability: Principles and Practices , 1976 .

[25]  Shigeru Yamada,et al.  S-Shaped Reliability Growth Modeling for Software Error Detection , 1983, IEEE Transactions on Reliability.

[26]  A. L. Goel,et al.  When and how to use a software reliability model , 1982 .

[27]  Martin L. Shooman,et al.  Structural models for software reliability prediction , 1976, ICSE '76.

[28]  Z. Jelinski,et al.  Software reliability Research , 1972, Statistical Computer Performance Evaluation.

[29]  Farokh B. Bastani,et al.  On the Uncertainty in the Correctness of Computer Programs , 1985, IEEE Transactions on Software Engineering.

[30]  R. W. Wolverton,et al.  Assessment of Software Reliability , 1973 .

[31]  Mitsuru Ohba,et al.  Software Reliability Analysis Models , 1984, IBM J. Res. Dev..

[32]  Nozer D. Singpurwalla,et al.  A Unification of Some Software Reliability Models , 1985 .

[33]  Amrit L. Goel,et al.  A Summary of the Discussion on "An Analysis of Competing Software Reliability Models" , 1980, IEEE Transactions on Software Engineering.

[34]  Paul B. Moranda,et al.  Predictions of software reliability during debugging , 1975 .

[35]  Bev Littlewood,et al.  A Bayesian Reliability Growth Model for Computer Software , 1973 .

[36]  Susanl . Gerhartandlawrenceyelowitz.  Observations ofFallibility inApplications ofModern Programming Methodologies , 1976 .

[37]  John D. Musa,et al.  A theory of software reliability and its application , 1975, IEEE Transactions on Software Engineering.