Selection of Optimal Software Reliability Growth Models Using a Distance Based Approach

A large number of software reliability growth models (SRGMs) have been proposed during the past 30 years to estimate software reliability measures such as the number of remaining faults, software failure rate, and software reliability. Selection of an optimal SRGM for use in a particular case has been an area of interest for researchers in the field of software reliability. Tools and techniques for software reliability model selection found in the literature cannot be used with high confidence as they use a limited number of model selection criteria. For the first time, we developed a deterministic quantitative model based on a distance based approach (DBA) method, then applied it for evaluation, optimal selection, and ranking of SRGMs. DBA recognizes the need for relative importance of criteria for a given application, without which inter-criterion comparison could not be accomplished. It requires a set of model selection criteria, along with a set of SRGMs, and their level of criteria for optimal selection; and it successfully presents the results in terms of a merit value which is used to rank the SRGMs. We use two distinct, real data sets for demonstration of the DBA method. The result of this study will be a ranking of SRGMs based on the Euclidean composite distance of each alternative to the designated optimal SRGM.

[1]  Eoca Raton.  SOFTWARE RELIABILITY MODEL SELECTION: A CASE STUDY , 1991 .

[2]  Michael R. Lyu,et al.  CASRE: a computer-aided software reliability estimation tool , 1992, [1992] Proceedings of the Fifth International Workshop on Computer-Aided Software Engineering.

[3]  Xuemei Zhang,et al.  An NHPP Software Reliability Model and Its Comparison , 1997 .

[4]  Gregory Levitin,et al.  Robust recurrent neural network modeling for software fault detection and correction prediction , 2007, Reliab. Eng. Syst. Saf..

[5]  P K Kapur,et al.  SOFTWARE RELIABILITY GROWTH MODELS BASED ON NHPP , 1999 .

[6]  Elaine J. Weyuker,et al.  An Extended Domain-Bases Model of Software Reliability , 1988, IEEE Trans. Software Eng..

[7]  Suku Nair,et al.  A Model for Software Development Effort and Cost Estimation , 1997, IEEE Trans. Software Eng..

[8]  Swapna S. Gokhale,et al.  Important Milestones in Software Reliability Modeling , 1996, SEKE.

[9]  Alan N. Sukert.  Empirical Validation of Three Software Error Prediction Models , 1979, IEEE Transactions on Reliability.

[10]  Hoang Pham,et al.  Quasi-Renewal Time-Delay Fault-Removal Consideration in Software Reliability Modeling , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[11]  Shigeru Yamada,et al.  Imperfect debugging models with fault introduction rate for software reliability assessment , 1992 .

[12]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[13]  Michael R. Lyu,et al.  Applying reliability models more effectively (software) , 1992, IEEE Software.

[14]  Hoang Pham,et al.  Calibrating software reliability models when the test environment does not match the user environment , 2002 .

[15]  B. Littlewood.  Software Reliability Model for Modular Program Structure , 1979, IEEE Transactions on Reliability.

[16]  Swapna S. Gokhale,et al.  A time/structure based software reliability model , 1999, Ann. Softw. Eng..

[17]  Sarah Brocklehurst,et al.  Recalibrating Software Reliability Models , 1990, IEEE Trans. Software Eng..

[18]  Mary Shaw,et al.  Forecasting field defect rates using a combined time-based and metrics-based approach: a case study of OpenBSD , 2005, 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05).

[19]  Swapna S. Gokhale,et al.  Analysis of Software Fault Removal Policies Using a Non-Homogeneous Continuous Time Markov Chain , 2004, Software Quality Journal.

[20]  Michael R. Lyu,et al.  A Unified Scheme of Some Nonhomogenous Poisson Process Models for Software Reliability Estimation , 2003, IEEE Trans. Software Eng..

[21]  George J. Schick,et al.  An Analysis of Competing Software Reliability Models , 1978, IEEE Transactions on Software Engineering.

[22]  Bev Littlewood,et al.  Evaluation of competing software reliability predictions , 1986, IEEE Transactions on Software Engineering.

[23]  Carol-Sophie Smidts,et al.  Software reliability modeling: an approach to early reliability prediction , 1998 .

[24]  Katerina Goseva-Popstojanova,et al.  Architecture-based approach to reliability assessment of software systems , 2001, Perform. Evaluation.

[25]  Paul B. Moranda,et al.  An Error Detection Model for Application During Software Development , 1981, IEEE Transactions on Reliability.

[26]  Min Xie,et al.  Software Reliability Modelling , 1991, Series on Quality, Reliability and Engineering Statistics.

[27]  Chin-Yu Huang,et al.  Analysis of incorporating logistic testing-effort function into software reliability modeling , 2002, IEEE Trans. Reliab..

[28]  Dai Pan,et al.  Architecture-based software reliability modeling , 2006, J. Syst. Softw..

[29]  Chin-Yu Huang,et al.  Performance analysis of software reliability growth models with testing-effort and change-point , 2005, J. Syst. Softw..

[30]  Eric R. Ziegel,et al.  Statistical Methods for the Reliability of Repairable Systems , 2001, Technometrics.

[31]  Carol S. Smidts,et al.  Software reliability models: an approach to early reliability prediction , 1996, Proceedings of ISSRE '96: 7th International Symposium on Software Reliability Engineering.

[32]  Xiaolin Teng,et al.  Considering fault removal efficiency in software reliability assessment , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[33]  P. C. Jha,et al.  Software Reliability Growth Models , 2011 .

[34]  Amrit L. Goel,et al.  Software Reliability Models: Assumptions, Limitations, and Applicability , 1985, IEEE Transactions on Software Engineering.

[35]  Min Xie,et al.  A simple goodness-of-fit test for the power-law process, based on the Duane plot , 2003, IEEE Trans. Reliab..

[36]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[37]  Yeu-Shiang Huang,et al.  A study of software reliability growth from the perspective of learning effects , 2008, Reliab. Eng. Syst. Saf..

[38]  Paul B. Moranda.  Event-Altered Rate Models for General Reliability Analysis , 1979, IEEE Transactions on Reliability.

[39]  C.-T. Lin,et al.  Software Reliability Analysis by Considering Fault Dependency and Debugging Time Lag , 2006, IEEE Transactions on Reliability.

[40]  Ming Zhao,et al.  On the log-power NHPP software reliability model , 1992, [1992] Proceedings Third International Symposium on Software Reliability Engineering.

[41]  Catherine Stringfellow,et al.  An Empirical Method for Selecting Software Reliability Growth Models , 2002, Empirical Software Engineering.

[42]  Z. Jelinski,et al.  Software reliability Research , 1972, Statistical Computer Performance Evaluation.

[43]  Alan Wood,et al.  Software reliability growth models: assumptions vs. reality , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.

[44]  Hoang Pham,et al.  A general imperfect-software-debugging model with S-shaped fault-detection rate , 1999 .

[45]  Xuemei Zhang,et al.  Some successful approaches to software reliability modeling in industry , 2005, J. Syst. Softw..

[46]  A. Wood,et al.  Predicting Software Reliability , 1996, Computer.

[47]  Swapna S. Gokhale,et al.  An analytical approach to architecture-based software reliability prediction , 1998, Proceedings. IEEE International Computer Performance and Dependability Symposium. IPDS'98 (Cat. No.98TB100248).

[48]  Chenggang Bai,et al.  Bayesian network based software reliability prediction with an operational profile , 2005, J. Syst. Softw..

[49]  John D. Musa,et al.  Software reliability measurement , 1984, J. Syst. Softw..

[50]  Ye Wu,et al.  An architecture-based software reliability model , 1999, Proceedings 1999 Pacific Rim International Symposium on Dependable Computing.

[51]  Taghi M. Khoshgoftaar,et al.  Software reliability model selection , 1992 .

[52]  Hoang Pham,et al.  Software reliability and cost models: Perspectives, comparison, and practice , 2003, Eur. J. Oper. Res..

[53]  Taghi M. Khoshgoftaar,et al.  Software reliability model selection: a cast study , 1991, Proceedings. 1991 International Symposium on Software Reliability Engineering.

[54]  Liang Tian,et al.  On-line prediction of software reliability using an evolutionary connectionist model , 2005, J. Syst. Softw..

[55]  Hoang Pham,et al.  Software field failure rate prediction before software deployment , 2006, J. Syst. Softw..

[56]  Xuemei Zhang,et al.  Accounting for realities when estimating the field failure rate of software , 2001, Proceedings 12th International Symposium on Software Reliability Engineering.