Incorporating Burr Type XII Testing-efforts into Software Reliability Growth Modeling and Actual Data Analysis with Applications

Software reliability is the probability that the given software functions correctly under a given environment, during the specified period of time. During the software-testing phase, software reliability is highly related to the amount of development resources spent on detecting and correcting latent software errors, i.e. the amount of testing effort expenditures. This paper develops software reliability growth models (SRGM) based on non homogeneous Poisson process (NHPP) which incorporates the Burr Type XII testing-effort functions (TEF). Numerous testing-effort functions for modeling software reliability growth based on NHPP have been proposed in the past decade. This paper shows that the Burr Type XII testing-effort function can be expressed as the actual testing-effort consumption during software development process. Its fault-prediction capability is evaluated through the numerical experiments. SRGM parameters are estimated by  least square estimation (LSE) and maximum likelihood estimation (MLE) methods and computational experiments performed on actual software failure data set from various software projects. The results show that the proposed testing-efforts functions predicts fault better than the other existing models. Thus, the proposed models evaluate software reliability more realistically. In addition, the optimal release policy based on reliability and cost criteria for software system are proposed.

[1]  Michael R. Lyu,et al.  Software reliability modeling and cost estimation incorporating testing-effort and efficiency , 1999, Proceedings 10th International Symposium on Software Reliability Engineering (Cat. No.PR00443).

[2]  Michael R. Lyu,et al.  Applying reliability models more effectively (software) , 1992, IEEE Software.

[3]  Michael R. Lyu,et al.  Framework for modeling software reliability, using various testing-efforts and fault-detection rates , 2001, IEEE Trans. Reliab..

[4]  S. M. K. Quadri,et al.  Modelling and analysis of software reliability with Burr type X testing‐effort and release‐time determination , 2009 .

[5]  Chin-Yu Huang,et al.  Pragmatic study of parametric decomposition models for estimating software reliability growth , 1998, Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257).

[6]  Simon P. Wilson,et al.  Software Reliability Modeling , 1994 .

[7]  John D. Musa,et al.  Software reliability engineering : more reliable software, faster development and testing , 1999 .

[8]  P. S. Grover,et al.  Modelling an imperfect debugging phenomenon with testing effort , 1994, Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering.

[9]  Shunji Osaki,et al.  Software-reliability growth with a Weibull test-effort: a model and application , 1993 .

[10]  Mitsuru Ohba,et al.  Software Reliability Analysis Models , 1984, IBM J. Res. Dev..

[11]  Shigeru Yamada,et al.  Software Reliability Growth Models with Testing-Effort , 1986, IEEE Transactions on Reliability.

[12]  Shigeru Yamada,et al.  Software quality/reliability measurement and assessment: software reliability growth models and data analysis , 1991 .

[13]  Dallas R. Wingo,et al.  Maximum likelihood methods for fitting the burr type XII distribution to multiply (progressively) censored life test data , 1993 .

[14]  Shigeru Yamada,et al.  Software reliability growth models for testing-effort control , 1990 .

[15]  S. M. K. Quadri,et al.  The exponentiated Weibull software reliability growth model with various testing‐efforts and optimal release policy: A performance analysis , 2008 .

[16]  D. R. Wingo,et al.  Maximum Likelihood Methods for Fitting the Burr Type XII Distribution to Life Test Data , 1983 .

[17]  Amrit L. Goel,et al.  Optimum release time for software systems based on reliability and cost criteria , 1984, J. Syst. Softw..

[18]  P. C. Sander,et al.  Repairable systems reliability: Modeling, inference, misconceptions and their causes , 1986 .

[19]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[20]  A. Islam,et al.  Optimal accelerated life test designs for Burr type XII distributions under periodic inspection and type I censoring , 1996 .

[21]  I. W. Burr Cumulative Frequency Functions , 1942 .

[22]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[23]  Shunji Osaki,et al.  Software Reliability Growth Modeling: Models and Applications , 1985, IEEE Transactions on Software Engineering.

[24]  P. K. Kapur,et al.  Modelling an imperfect debugging phenomenon in software reliability , 1996 .

[25]  W. Marsden I and J , 2012 .

[26]  Michael R. Lyu,et al.  Handbook of software reliability engineering , 1996 .

[27]  Chin-Yu Huang,et al.  Analysis of a software reliability growth model with logistic testing-effort function , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.

[28]  Robert N. Rodriguez A guide to the Burr type XII distributions , 1977 .

[29]  A. Abdel-Ghaly,et al.  The use of Burr type XII distribution on software reliability growth modelling , 1997 .

[30]  John D. Musa,et al.  Software reliability measurement , 1984, J. Syst. Softw..

[31]  Shigeru Yamada,et al.  Cost-Reliability Optimal Release Policies for Software Systems , 1985, IEEE Transactions on Reliability.

[32]  Michael R. Lyu,et al.  An Assessment of Testing-Effort Dependent Software Reliability Growth Models , 2007, IEEE Transactions on Reliability.

[33]  Peng Lu,et al.  Test-Execution-Based Reliability Measurement and Modeling for Large Commercial Software , 1995, IEEE Trans. Software Eng..

[34]  Mohammad Ubaidullah Bokhari,et al.  Analysis of a software reliability growth models: the case of log-logistic test-effort function , 2006 .

[35]  Chin-Yu Huang,et al.  Performance analysis of software reliability growth models with testing-effort and change-point , 2005, J. Syst. Softw..

[36]  Michael R. Lyu,et al.  Effort-index-based software reliability growth models and performance assessment , 2000, Proceedings 24th Annual International Computer Software and Applications Conference. COMPSAC2000.

[37]  Michael R. Lyu,et al.  Optimal allocation of testing-resource considering cost, reliability, and testing-effort , 2004, 10th IEEE Pacific Rim International Symposium on Dependable Computing, 2004. Proceedings..

[38]  Min Xie,et al.  Software Reliability Modelling , 1991, Series on Quality, Reliability and Engineering Statistics.

[39]  Chin-Yu Huang,et al.  Analysis of incorporating logistic testing-effort function into software reliability modeling , 2002, IEEE Trans. Reliab..