Phase-type software reliability model: parameter estimation algorithms with grouped data

This paper introduces a phase-type software reliability model (PH-SRM) and develops parameter estimation algorithms with grouped data. The PH-SRM is one of the most flexible models, which contains the existing non-homogeneous Poisson process (NHPP) models, and can approximate any type of NHPP-based models with high accuracy. Hence PH-SRM is promising to reduce the effort to select the best models in software reliability assessment. However, PH-SRM may involve many parameters compared to typical NHPP models. Thus the efficient parameter estimation algorithm is required. This paper enhances the parameter estimation algorithms for PH-SRM, so that they can handle grouped data. The grouped data is commonly applied to collect the data such as the number of bugs per day in practice. Thus the presented algorithms are helpful for the reliability assessment in practical software development project. Concretely, we consider the EM (expectation–maximization) algorithm for PH-SRM with both fault-detection time and grouped data. Finally, we examine performance of PH-SRM from the viewpoints of fitting ability.

[1]  Sumio Watanabe,et al.  Singularities in mixture models and upper bounds of stochastic complexity , 2003, Neural Networks.

[2]  Douglas R. Miller.  Exponential order statistic models of software reliability growth , 1986, IEEE Transactions on Software Engineering.

[3]  Swapna S. Gokhale,et al.  Unification of finite failure non-homogeneous Poisson process models through test coverage , 1996, Proceedings of ISSRE '96: 7th International Symposium on Software Reliability Engineering.

[4]  Shigeru Yamada,et al.  S-Shaped Reliability Growth Modeling for Software Error Detection , 1983, IEEE Transactions on Reliability.

[5]  Taghi M. Khoshgoftaar,et al.  The Detection of Fault-Prone Programs , 1992, IEEE Trans. Software Eng..

[6]  Swapna S. Gokhale,et al.  Log-logistic software reliability growth model , 1998, Proceedings Third IEEE International High-Assurance Systems Engineering Symposium (Cat. No.98EX231).

[7]  Tadashi Dohi,et al.  Hyper-Erlang Software Reliability Model , 2008, 2008 14th IEEE Pacific Rim International Symposium on Dependable Computing.

[8]  Tadashi Dohi,et al.  Improvement of expectation–maximization algorithm for phase‐type distributions with grouped and truncated data , 2013 .

[9]  Kishor S. Trivedi,et al.  On a method for mending time to failure distributions , 2005, 2005 International Conference on Dependable Systems and Networks (DSN'05).

[10]  Rui Peng,et al.  Testing effort dependent software reliability model for imperfect debugging process considering both detection and correction , 2014, Reliab. Eng. Syst. Saf..

[11]  Marcel F. Neuts,et al.  Matrix-Geometric Solutions in Stochastic Models , 1981 .

[12]  Mitsuru Ohba,et al.  Inflection S-Shaped Software Reliability Growth Model , 1984 .

[13]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[14]  Tadashi Dohi,et al.  Software reliability growth models with normal failure time distributions , 2013, Reliab. Eng. Syst. Saf..

[15]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[16]  Dipak K. Dey,et al.  A Bayesian Approach Using Nonhomogeneous Poisson Process for Software Reliability Models , 2007 .

[17]  Asit P. Basu,et al.  Frontiers in Reliability , 1998 .

[18]  Q. P. Hu,et al.  A study of the modeling and analysis of software fault‐detection and fault‐correction processes , 2007, Qual. Reliab. Eng. Int..

[19]  Shunji Osaki,et al.  Stochastic Models in Reliability Theory , 1984 .

[20]  Tadashi Dohi,et al.  Gompertz software reliability model: Estimation algorithm and empirical validation , 2009, J. Syst. Softw..

[21]  P. K. Kapur,et al.  A Unified Approach for Developing Software Reliability Growth Models in the Presence of Imperfect Debugging and Error Generation , 2011, IEEE Transactions on Reliability.

[22]  A. Cumani.  On the canonical representation of homogeneous markov processes modelling failure - time distributions , 1982 .

[23]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[24]  Shigeru Yamada,et al.  Imperfect debugging models with fault introduction rate for software reliability assessment , 1992 .

[25]  Hoang Pham.  Software Reliability , 1999 .

[26]  Shigeru Yamada.  A stochastic software reliability growth model with Gompertz curve (abstract) , 1992 .

[27]  S. Asmussen,et al.  Marked point processes as limits of Markovian arrival streams , 1993 .

[28]  M. Zhao,et al.  On maximum likelihood estimation for a general non-homogeneous Poisson process , 1996 .

[29]  Jean-Claude Laprie,et al.  The KAT (Knowledge-Action-Transformation) Approach to the Modeling and Evaluation of Reliability and Availability Growth , 1991, IEEE Trans. Software Eng..

[30]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[31]  Hoang Pham,et al.  A software cost model with imperfect debugging, random life cycle and penalty cost , 1996, Int. J. Syst. Sci..

[32]  Harry Joe,et al.  Statistical Inference for General-Order-Statistics and Nonhomogeneous-Poisson-Process Software Reliability Models , 1989, IEEE Trans. Software Eng..

[33]  Yoshihiro Tohma,et al.  The Estimation of Parameters of the Hypergeometric Distribution and Its Application to the Software Reliability Growth Model , 1991, IEEE Trans. Software Eng..

[34]  Nozer D. Singpurwalla,et al.  A Unification of Some Software Reliability Models , 1985 .

[35]  H. Pham,et al.  On the Maximum Likelihood Estimates for the Goel–Okumoto Software Reliability Model , 2001 .

[36]  Amrit L. Goel,et al.  Optimum release time for software systems based on reliability and cost criteria , 1984, J. Syst. Softw..

[37]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[38]  Hoang Pham,et al.  A software cost model with error removal times and risk costs , 1998, Int. J. Syst. Sci..

[39]  Tadashi Dohi,et al.  A Bayesian Inference Tool for NHPP-Based Software Reliability Assessment , 2009, FGIT.

[40]  Bev Littlewood,et al.  Stochastic Reliability-Growth: A Model for Fault-Removal in Computer-Programs and Hardware-Designs , 1981, IEEE Transactions on Reliability.

[41]  Bev Littlewood.  Rationale for a Modified Duane Model , 1984, IEEE Transactions on Reliability.

[42]  Tadashi Dohi,et al.  Metrics-Based Software Reliability Models Using Non-homogeneous Poisson Processes , 2006, 2006 17th International Symposium on Software Reliability Engineering.

[43]  Michael R. Lyu,et al.  A Unified Scheme of Some Nonhomogenous Poisson Process Models for Software Reliability Estimation , 2003, IEEE Trans. Software Eng..

[44]  Peter Buchholz,et al.  A Novel Approach for Phase-Type Fitting with the EM Algorithm , 2006, IEEE Transactions on Dependable and Secure Computing.

[45]  Amrit L. Goel,et al.  Software Reliability Models: Assumptions, Limitations, and Applicability , 1985, IEEE Transactions on Software Engineering.

[46]  John D. Musa,et al.  Software Reliability Engineering , 1998 .

[47]  Tadashi Dohi,et al.  An iterative scheme for maximum likelihood estimation in software reliability modeling , 2003, 14th International Symposium on Software Reliability Engineering, 2003. ISSRE 2003..

[48]  Hoang Pham,et al.  Quasi-Renewal Time-Delay Fault-Removal Consideration in Software Reliability Modeling , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[49]  Tadashi Dohi,et al.  A refined EM algorithm for PH distributions , 2011, Perform. Evaluation.

[50]  Tadashi Dohi,et al.  An infinite server queueing approach for describing software reliability growth: unified modeling and estimation framework , 2004, 11th Asia-Pacific Software Engineering Conference.

[51]  Tadashi Dohi,et al.  EM algorithm for discrete software reliability models: a unified parameter estimation method , 2004, Eighth IEEE International Symposium on High Assurance Systems Engineering, 2004. Proceedings..

[52]  Nozer D. Singpurwalla,et al.  Unification of Software Reliability Models by Self-Exciting Point Processes , 1997, Advances in Applied Probability.

[53]  Shigeru Yamada,et al.  TESTING-DOMAIN DEPENDENT SOFTWARE RELIABILITY GROWTH MODELS AND THEIR COMPARISONS OF GOODNESS-OF-FIT , 2001 .

[54]  Dong Ho Park,et al.  Mean functions based on meta-mixtures in nonhomogeneous Poisson processes , 2010 .

[55]  Shigeru Yamada,et al.  Toward Practical Software Reliability Assessment with Change-Point Based on Hazard Rate Models , 2013, 2013 IEEE 37th Annual Computer Software and Applications Conference.

[56]  Yi-Ping Chang,et al.  On a unified theory of some nonhomogeneous Poisson process models for software reliability , 1998, Proceedings. 1998 International Conference Software Engineering: Education and Practice (Cat. No.98EX220).

[57]  Tadashi Dohi,et al.  Building Phase-Type Software Reliability Models , 2006, 2006 17th International Symposium on Software Reliability Engineering.

[58]  Tadashi Dohi,et al.  Improvement of EM Algorithm for Phase-Type Distributions with Grouped and Truncated Data , 2012 .

[59]  Ren Asmussen,et al.  Fitting Phase-type Distributions via the EM Algorithm , 1996 .