Software reliability prediction and analysis during operational use

In reality, the fault detection (or correction) phenomenon and software reliability estimation in the operational phase are different from that in the testing phase. The fault removal continues at a slower rate during the operational phase. In this paper, we will investigate some techniques for software reliability prediction and measurement in the operational phase. We first review how some software reliability growth models (SRGMs) based on non-homogeneous Poisson processes (NHPPs) can be readily derived based on a unified theory for NHPP models. Under this general framework, we can not only verify some conventional SRGMs but also derive some new SRGMs that can be used for software reliability measurement in the operational phase. That is, based on the unified theory, we can incorporate the concept of multiple changepoints into software reliability modeling. We can formularize and simulate the fault detection process in the operational phase. Some numerical illustrations based on real software failure data are also presented. The experimental results show that the proposed models can easily reflect the possible changes of fault detection process and offer quantitative analysis on software failure behavior in field operation.

[1]  A. L. Goel Relating operational software reliability and workload: results from an experimental study , 1996, Proceedings of 1996 Annual Reliability and Maintainability Symposium.

[2]  Hiroyuki Okamura,et al.  A reliability assessment method for software products in operational phase—proposal of an accelerated life testing model , 2001 .

[3]  Yi-Ping Chang,et al.  ESTIMATION OF PARAMETERS FOR NONHOMOGENEOUS POISSON PROCESS: SOFTWARE RELIABILITY WITH CHANGE-POINT MODEL , 2001 .

[4]  Hoan Sung Jung,et al.  Prediction of Safety Critical Software Operational Reliability from Test Reliability Using Testing Environment Factors , 1999 .

[5]  Huan-Jyh Shyur,et al.  A stochastic software reliability model with imperfect-debugging and change-point , 2003, J. Syst. Softw..

[6]  Ming Zhao Change-point problems in software and hardware reliability , 1993 .

[7]  Lynn Kuo,et al.  Bayesian Binary Segmentation Procedure for a Poisson Process With Multiple Changepoints , 2001 .

[8]  Ken Isaacson,et al.  I I , 1982 .

[9]  Jin Wang,et al.  Downtime Optimization for Fishing Vessel Equipment Using Delay Time Analysis , 2001 .

[10]  S. Yamada,et al.  Optimum software-release time considering an error-detection phenomenon during operation , 1990 .

[11]  Kwang Mo Jeong,et al.  An Adaptive Failure Rate Change-Point Model for Software Reliability , 2001 .

[12]  Michael R. Lyu,et al.  Applying reliability models more effectively (software) , 1992, IEEE Software.

[13]  Michael R. Lyu,et al.  Handbook of software reliability engineering , 1996 .

[14]  Chin-Yu Huang,et al.  Performance analysis of software reliability growth models with testing-effort and change-point , 2005, J. Syst. Softw..

[15]  Min Xie,et al.  A study of operational and testing reliability in software reliability analysis , 2000, Reliab. Eng. Syst. Saf..

[16]  Ravishankar K. Iyer,et al.  Field Failures And Reliability In Operation , 1993, Proceedings of 1993 IEEE International Symposium on Software Reliability Engineering.

[17]  Feng-Zhong Zou,et al.  A change‐point perspective on the software failure process , 2003, Softw. Test. Verification Reliab..

[18]  Kishor S. Trivedi,et al.  A multiphase software reliability model: From testing to operational phase , 1996 .

[19]  G. Q. Kenny Estimating defects in commercial software during operational use , 1993 .

[20]  Michael R. Lyu,et al.  A Unified Scheme of Some Nonhomogenous Poisson Process Models for Software Reliability Estimation , 2003, IEEE Trans. Software Eng..

[21]  Michael R. Lyu,et al.  Quantitative software reliability modeling from testing to operation , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.