Software reliability model with bathtub-shaped fault detection rate

This paper proposes a software reliability model with a ba thtub-shaped fault detection rate. We discuss how the inherent characteristics of the software testing process support the three phases of the bathtub; the first phase with a decreasing fault detection rate arises from the removal of simple, yet frequent faults like syntax errors and typos; the second phase possesses a constant fault detection rate marking the beginning of functional requirements testing; the third and final code comprehension stage exhibits an increasing fault detection rate because testers are now familiar with the system and can focus their attention on the outstanding and as yet untested portions of code. We also discuss how eliminating one of the testing phases gives rise to the burn-in model, which is a special case of the bathtub model. We compare the performance of the bathtub and burn-in models with the three classical software reliability models using the Predictive Mean Square Error and Akaike Information Criterion, by applying these models to a data set in the literature. Our results suggest that the bathtub model best describes the observed data and also most precisely predicts the future data points compared to the other popular software reliability models. The bathtub model can thus be used to provide accurate predictions during the testing process and guide optimal release time decisions.

[1]  Richard E. Barlow,et al.  Stochastic Ageing and Dependence for Reliability , 2006 .

[2]  Norman F Schneidewind Software Acquisition Life Cycle Measure Plan based on the Revised IEEE P1633\AIAA R-013A Recommended Practice on Software Reliability , 2004 .

[3]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[4]  Taghi M. Khoshgoftaar,et al.  Software reliability model selection: a cast study , 1991, Proceedings. 1991 International Symposium on Software Reliability Engineering.

[5]  G. Kitagawa,et al.  Akaike Information Criterion Statistics , 1988 .

[6]  Mitsuru Ohba,et al.  Inflection S-Shaped Software Reliability Growth Model , 1984 .

[7]  Xiaolin Teng,et al.  Considering fault removal efficiency in software reliability assessment , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[8]  J. R. Horgan,et al.  A data flow coverage testing tool for C , 1992, [1992] Proceedings of the Second Symposium on Assessment of Quality Software Development Tools.

[9]  Herbert Hecht Fault-Tolerant Software , 1979, IEEE Transactions on Reliability.

[10]  W. Weibull A Statistical Distribution Function of Wide Applicability , 1951 .

[11]  Mitsuru Ohba,et al.  Software Reliability Analysis Models , 1984, IBM J. Res. Dev..

[12]  G. Kitagawa,et al.  Akaike Information Criterion Statistics , 1988 .

[13]  Eoca Raton SOFTWARE RELIABILITY MODEL SELECTION: A CASE STUDY , 1991 .

[14]  Way Kuo,et al.  Reliability, Yield, And Stress Burn-In , 1998 .

[15]  G. B. Finelli,et al.  The Infeasibility of Quantifying the Reliability of Life-Critical Real-Time Software , 1993, IEEE Trans. Software Eng..

[16]  Larry Lee Testing Adequacy of the Weibull and Log Linear Rate Models for a Poisson Process , 1980 .

[17]  H. Akaike A new look at the statistical model identification , 1974 .

[18]  Subir Ghosh,et al.  Reliability and Risk: A Bayesian Perspective , 2008, Technometrics.

[19]  Nozer D. Singpurwalla,et al.  Reliability and risk , 2006 .

[20]  K Okumoto,et al.  TIME-DEPENDENT ERROR-DETECTION RATE MODEL FOR SOFTWARE AND OTHER PERFORMANCE MEASURES , 1979 .

[21]  Amrit L. Goel,et al.  Optimum release time for software systems based on reliability and cost criteria , 1984, J. Syst. Softw..

[22]  Swapna S. Gokhale,et al.  A time/structure based software reliability model , 1999, Ann. Softw. Eng..