Metrics-Based Software Reliability Models Using Non-homogeneous Poisson Processes

The traditional software reliability models aim to describe the temporal behavior of software fault-detection processes with only the fault data, but fail to incorporate some significant test-metrics data observed in software testing. In this paper we develop a useful modeling framework to assess the quantitative software reliability with time-dependent covariate as well as software-fault data. The basic ideas employed here are to introduce the discrete proportional hazard model on a cumulative Bernoulli trial process, and to represent a generalized fault-detection processes having time-dependent covariate structure. The resulting stochastic models are regarded as combinations of the proportional hazard models and the familiar non-homogeneous Poisson processes. We compare these metrics-based software reliability models with some typical non-homogeneous Poisson process models, and evaluate quantitatively both goodness-of-fit and predictive performances from the viewpoint of information criteria. As an important result, the accuracy on reliability assessment strongly depends on the kind of software metrics used for analysis and can be improved by incorporating time-dependent metrics data in modeling

[1]  James J. Reed Data and Analysis Center for Software , 1993 .

[2]  Z. Jelinski,et al.  Software reliability Research , 1972, Statistical Computer Performance Evaluation.

[3]  14th International Symposium on Software Reliability Engineering , 2003, 14th International Symposium on Software Reliability Engineering, 2003. ISSRE 2003..

[4]  Maurice H. Halstead,et al.  Elements of software science , 1977 .

[5]  Frank Proschan,et al.  Fault Diversity in Software Reliability , 1987 .

[6]  J. G. Shanthikumar,et al.  Software reliability models: A review , 1983 .

[7]  Michael R. Lyu,et al.  What is software reliability? , 1994, Proceedings of COMPASS'94 - 1994 IEEE 9th Annual Conference on Computer Assurance.

[8]  Shunji Osaki,et al.  Discrete software reliability growth models , 1985 .

[9]  Shigeru Yamada,et al.  S-Shaped Reliability Growth Modeling for Software Error Detection , 1983, IEEE Transactions on Reliability.

[10]  Suku Nair,et al.  A Model for Software Development Effort and Cost Estimation , 1997, IEEE Trans. Software Eng..

[11]  Taghi M. Khoshgoftaar,et al.  Predicting Software Development Errors Using Software Complexity Metrics , 1990, IEEE J. Sel. Areas Commun..

[12]  Taghi M. Khoshgoftaar,et al.  Predicting software errors, during development, using nonlinear regression models: a comparative study , 1992 .

[13]  Taghi M. Khoshgoftaar,et al.  Predictive Modeling Techniques of Software Quality from Software Measures , 1992, IEEE Trans. Software Eng..

[14]  D.,et al.  Regression Models and Life-Tables , 2022 .

[15]  Amrit L. Goel,et al.  Software Reliability Models: Assumptions, Limitations, and Applicability , 1985, IEEE Transactions on Software Engineering.

[16]  Lawrence H. Putnam,et al.  A General Empirical Solution to the Macro Software Sizing and Estimating Problem , 1978, IEEE Transactions on Software Engineering.

[17]  Tadashi Dohi,et al.  EM algorithm for discrete software reliability models: a unified parameter estimation method , 2004, Eighth IEEE International Symposium on High Assurance Systems Engineering, 2004. Proceedings..

[18]  T. Dohi,et al.  Software reliability assessment models based on cumulative Bernoulli trial process , 2003 .

[19]  Tony Bendell,et al.  The Use of Exploratory Data Analysis Techniques for Software Reliability Assessment and Prediction , 1986 .

[20]  Sousuke Amasaki,et al.  A New Challenge for Applying Time Series Metrics Data to Software Quality Estimation , 2005, Software Quality Journal.

[21]  Mary Shaw,et al.  Empirical evaluation of defect projection models for widely-deployed production software systems , 2004, SIGSOFT '04/FSE-12.

[22]  John D. Musa,et al.  Software reliability measurement , 1984, J. Syst. Softw..

[23]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[24]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[25]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[26]  Norman F. Schneidewind Software metrics model for integrating quality control and prediction , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.

[27]  Harold Ascher,et al.  The Use of Regression Techniques for Matching Reliability Models to the Real World , 1986 .

[28]  L. J. Wei,et al.  On the Cox Model With Time-Varying Regression Coefficients , 2005 .

[29]  F.-W. Scholz,et al.  Software reliability modeling and analysis , 1986, IEEE Transactions on Software Engineering.

[30]  Michael R. Lyu,et al.  Handbook of software reliability engineering , 1996 .

[31]  Taghi M. Khoshgoftaar,et al.  Comparing software fault predictions of pure and zero-inflated Poisson regression models , 2005, Int. J. Syst. Sci..

[32]  W. M. Evanco,et al.  Using a proportional hazards model to analyze software reliability , 1999, STEP '99. Proceedings Ninth International Workshop Software Technology and Engineering Practice.

[33]  J. Lawless Regression Methods for Poisson Process Data , 1987 .

[34]  Mizan Rahman,et al.  Cumulative Bernoulli trials and Krawtchouk processes , 1984 .

[35]  Nalini Ravishanker,et al.  Dynamic Reliability Models for Software Using Time-Dependent Covariates , 2006, Technometrics.

[36]  Tadashi Dohi,et al.  Proportional Intensity-Based Software Reliability Modeling with Time-Dependent Metrics , 2006, 30th Annual International Computer Software and Applications Conference (COMPSAC'06).

[37]  Tadashi Dohi,et al.  Determination of the optimal software release time based on proportional hazards software reliability growth models , 2003 .

[38]  D W Wightman,et al.  Proportional hazards modelling of software failure data , 1986 .

[39]  Norman F. Schneidewind,et al.  Measuring and evaluating maintenance process using reliability, risk, and test metrics , 1997, 1997 Proceedings International Conference on Software Maintenance.

[40]  Muneo Takahashi,et al.  An empirical study of a model for program error prediction , 1985, ICSE '85.

[41]  P. Sen,et al.  Time-dependent coefficients in a Cox-type regression model , 1991 .