NHPP models with Markov switching for software reliability

We describe the use of a latent Markov process governing the parameters of a nonhomogeneous Poisson process (NHPP) model for characterizing the software development defect discovery process. Use of a Markov switching process allows us to characterize non-smooth variations in the rate at which defects are found, better reflecting the industrial software development environment in practice. Additionally, we propose a multivariate model for characterizing changes in the distribution of defect types that are found over time, conditional on the total number of defects. A latent Markov chain governs the evolution of probabilities of the different types. Bayesian methods via Markov chain Monte Carlo facilitate inference. We illustrate the efficacy of the methods using simulated data, then apply them to model reliability growth in a large operating system software component-based on defects discovered during the system testing phase of development.

[1]  Ram Chillarege,et al.  Reliability Growth for Typed Defects , 1992 .

[2]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[3]  Ram Chillarege,et al.  Reliability growth for typed defects (software development) , 1992, Annual Reliability and Maintainability Symposium 1992 Proceedings.

[4]  Inderpal S. Bhandari,et al.  Orthogonal Defect Classification - A Concept for In-Process Measurements , 1992, IEEE Trans. Software Eng..

[5]  Ram Chillarege,et al.  Identifying risk using ODC based growth models , 1994, Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering.

[6]  John M. Olin.  Calculating posterior distributions and modal estimates in Markov mixture models , 1996 .

[7]  Nader Ebrahimi,et al.  Bayesian Software Reliability Models Based on Martingale Processes , 2003, Technometrics.

[8]  Nalini Ravishanker,et al.  Dynamic Reliability Models for Software Using Time-Dependent Covariates , 2006, Technometrics.

[9]  G. Q. Kenny.  Estimating defects in commercial software during operational use , 1993 .

[10]  Joseph G. Ibrahim,et al.  Criterion-based methods for Bayesian model assessment , 2001 .

[11]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[12]  S. L. Scott.  Bayesian Methods for Hidden Markov Models , 2002 .

[13]  Nalini Ravishanker,et al.  NHPP models for categorized software defects , 2005 .

[14]  Eric R. Ziegel,et al.  Statistical Methods for the Reliability of Repairable Systems , 2001, Technometrics.

[15]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[16]  Nalini Ravishanker,et al.  Bayesian inference for non-homogeneous poisson process models for software reliability , 2006 .

[17]  Fabrizio Ruggeri,et al.  Bayesian reliability analysis of complex repairable systems , 2004 .

[18]  Simon P. Wilson,et al.  Statistical methods in software engineering : reliability and risk , 1999 .

[19]  Dani Gamerman,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference , 1997 .

[20]  A. Gelfand,et al.  Identifiability, Improper Priors, and Gibbs Sampling for Generalized Linear Models , 1999 .

[21]  Fabrizio Ruggeri,et al.  Bayesian reliability analysis of complex repairable systems: Research Articles , 2004 .

[22]  Nozer D. Singpurwalla,et al.  Assessing (Software) Reliability Growth Using a Random Coefficient Autoregressive Process and Its Ramifications , 1985, IEEE Transactions on Software Engineering.

[23]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.