A general modeling and analysis framework for software fault detection and correction process

Software reliability growth modeling plays an important role in software reliability evaluation. To incorporate more information and provide more accurate analysis, modeling software fault detection and correction processes has attracted widespread research attention recently. In modeling software correction processes, the assumption of fault correction time is relaxed from constant delay to random delay. However, stochastic distribution of fault correction time brings more difficulties in modeling and corresponding parameter estimation. In this paper, a framework of software reliability models containing both information from software fault detection process and correction process is studied. Different from previous extensions on software reliability growth modeling, the proposed approach is based on Markov model other than a nonhomogeneous Poisson process model. Also, parameter estimation is carried out with weighted least‐square estimation method, which emphasizes the influence of later data on the prediction. Two data sets from practical software development projects are applied with the proposed framework, which shows satisfactory performance with the results. Copyright © 2016 John Wiley & Sons, Ltd.

[1]  Tadashi Dohi,et al.  Software reliability growth models with normal failure time distributions , 2013, Reliab. Eng. Syst. Saf..

[2]  Miguel Correia,et al.  Intrusion Tolerance in Wireless Environments: An Experimental Evaluation , 2007 .

[3]  Felix Salfner,et al.  Software Reliability , 2005, Dependability Metrics.

[4]  Yeu-Shiang Huang,et al.  Bayesian updating of optimal release time for software systems , 2009, Software Quality Journal.

[5]  Q. P. Hu,et al.  Modeling and Analysis of Software Fault Detection and Correction Process by Considering Time Dependency , 2007, IEEE Transactions on Reliability.

[6]  Shigeru Yamada,et al.  TESTING-DOMAIN DEPENDENT SOFTWARE RELIABILITY GROWTH MODELS AND THEIR COMPARISONS OF GOODNESS-OF-FIT , 2001 .

[7]  N. Draper,et al.  Applied Regression Analysis: Draper/Applied Regression Analysis , 1998 .

[8]  Swapna S. Gokhale,et al.  Analysis of Software Fault Removal Policies Using a Non-Homogeneous Continuous Time Markov Chain , 2004, Software Quality Journal.

[9]  Mehmet Sahinoglu,et al.  Alternative Parameter Estimation Methods for the Compound Poisson Software Reliability Model with Clustered Failure Data , 1997, Software testing, verification & reliability.

[10]  Norman F. Schneidewind,et al.  Modelling the fault correction process , 2001, Proceedings 12th International Symposium on Software Reliability Engineering.

[11]  Yashwant K. Malaiya,et al.  Predictability of software-reliability models , 1992 .

[12]  Min Xie,et al.  Software reliability models—A selected annotated bibliography , 1993, Softw. Test. Verification Reliab..

[13]  Gregory Levitin,et al.  Robust recurrent neural network modeling for software fault detection and correction prediction , 2007, Reliab. Eng. Syst. Saf..

[14]  Tadashi Dohi,et al.  Quantifying Software Maintainability Based on a Fault-Detection/Correction Model , 2007 .

[15]  Chin-Yu Huang,et al.  Evaluation and Application of Bounded Generalized Pareto Analysis to Fault Distributions in Open Source Software , 2014, IEEE Transactions on Reliability.

[16]  Tevfik Aktekin,et al.  Imperfect debugging in software reliability: A Bayesian approach , 2013, Eur. J. Oper. Res..

[17]  Michael R. Lyu,et al.  A Unified Scheme of Some Nonhomogenous Poisson Process Models for Software Reliability Estimation , 2003, IEEE Trans. Software Eng..

[18]  Amrit L. Goel,et al.  Software Reliability Models: Assumptions, Limitations, and Applicability , 1985, IEEE Transactions on Software Engineering.

[19]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[20]  Bertrand Meyer,et al.  On the number and nature of faults found by random testing , 2011, Softw. Test. Verification Reliab..

[21]  Dragan Jukic,et al.  The L p -norm estimation of the parameters for the Jelinski–Moranda model in software reliability , 2012, Int. J. Comput. Math..

[22]  Nozer D. Singpurwalla,et al.  A Unification of Some Software Reliability Models , 1985 .

[23]  Peter Bajorski,et al.  Wiley Series in Probability and Statistics , 2010 .

[24]  Michael R. Lyu Software Reliability Engineering: A Roadmap , 2007, Future of Software Engineering (FOSE '07).

[25]  Douglas R. Miller Exponential order statistic models of software reliability growth , 1986, IEEE Transactions on Software Engineering.

[26]  Tadashi Dohi,et al.  Unification of Software Reliability Models Using Markovian Arrival Processes , 2011, 2011 IEEE 17th Pacific Rim International Symposium on Dependable Computing.

[27]  Tadashi Dohi,et al.  Gompertz software reliability model: Estimation algorithm and empirical validation , 2009, J. Syst. Softw..

[28]  Tadashi Dohi,et al.  Software Reliability Prediction Based on Least Squares Estimation , 2012 .

[29]  Chin-Yu Huang,et al.  Software reliability analysis and assessment using queueing models with multiple change-points , 2010, Comput. Math. Appl..

[30]  P. K. Kapur,et al.  A Unified Approach for Developing Software Reliability Growth Models in the Presence of Imperfect Debugging and Error Generation , 2011, IEEE Transactions on Reliability.

[31]  Walter Freiberger,et al.  Statistical Computer Performance Evaluation , 1972 .

[32]  Sheldon M. Ross,et al.  Statistical Estimation of Software Reliability , 1985, IEEE Transactions on Software Engineering.

[33]  Rui Peng,et al.  Testing effort dependent software reliability model for imperfect debugging process considering both detection and correction , 2014, Reliab. Eng. Syst. Saf..

[34]  S. P. Koh,et al.  WEIGHTED LEAST-SQUARE ESIMATE FOR SOFTWARE ERROR INTENSITY , 2008 .

[35]  Q. P. Hu,et al.  A study of the modeling and analysis of software fault‐detection and fault‐correction processes , 2007, Qual. Reliab. Eng. Int..

[36]  Michael R. Lyu,et al.  Handbook of software reliability engineering , 1996 .