Considering Testing-Coverage and Fault Removal Efficiency Subject to the Random Field Environments with Imperfect Debugging in Software Reliability Assessment

As the quantitative software reliability assessment means, software reliability model has become one of the most successful and practical software reliability engineering contributions. Although many models have been developed in the past 30 years, most of them take the following assumptions: 1) the software's final field environment is the same as its testing environment, so the software reliability model used in testing environment will be suitable for its field applications, 2) fault removal efficiency equals to 1, i.e. the faults detected will be removed perfectly and not part of the faults will remain. But these two assumptions do not always stand in practice. Firstly, software is usually tested in a given controlled environment, but it might be used in different field environments by different users, so due to the randomness of the field environments, the software's performance and reliability may be considerably influenced in an unpredictable way. Secondly, the fault removal efficiency is usually imperfect, i.e. the faults causing the observed failures may not be removed completely and the original faults may remain and new faults may be introduced during the debugging process. This paper aims to incorporate fault removal efficiency, testing coverage and the randomness of field environments into software reliability assessment and develop a new software reliability model. We compare the performance of the proposed model with several existing nonhomogeneous Poisson process (NHPP) software reliability growth models (SRGMs) using software failure data collected from real applications. All results show that the new model can give an improved goodness-of-fit.

[1]  Hoang Pham,et al.  A new software reliability model with Vtub-shaped fault-detection rate and the uncertainty of operating environments , 2014 .

[2]  Xuemei Zhang,et al.  Adjusting software failure rates that are estimated from test data , 2005, IEEE Transactions on Reliability.

[3]  H. Pham,et al.  A New Methodology for Predicting Software Reliability in the Random Field Environments , 2006, IEEE Transactions on Reliability.

[4]  Hoang Pham,et al.  Calibrating software reliability models when the test environment does not match the user environment , 2002 .

[5]  Hiroyuki Okamura,et al.  A reliability assessment method for software products in operational phase—proposal of an accelerated life testing model , 2001 .

[6]  Xuemei Zhang,et al.  An NHPP Software Reliability Model and Its Comparison , 1997 .

[7]  Hoang Pham A New Generalized Systemability Model , 2005 .

[8]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[9]  Zhao Jing,et al.  A Software Reliability Growth Model Considering Testing Environment and Actual Operation Environment , 2006 .

[10]  David H. Pham,et al.  A New Mathematical Logistic Model and Its Applications , 2014 .

[11]  Hoang Pham,et al.  System Software Reliability , 1999 .

[12]  Hoang Pham Mathematical systemability function approximations , 2010 .

[13]  Kazu Okumoto,et al.  Customer-Perceived Software Reliability Predictions: Beyond Defect Prediction Models , 2013 .

[14]  Mitsuru Ohba,et al.  Inflection S-Shaped Software Reliability Growth Model , 1984 .

[15]  Hoang Pham,et al.  A testing-coverage software reliability model with the uncertainty of operating environments , 2014 .

[16]  Xiaolin Teng,et al.  Considering fault removal efficiency in software reliability assessment , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[17]  Shigeru Yamada,et al.  S-Shaped Reliability Growth Modeling for Software Error Detection , 1983, IEEE Transactions on Reliability.

[18]  Yoshihiro Tohma,et al.  The Estimation of Parameters of the Hypergeometric Distribution and Its Application to the Software Reliability Growth Model , 1991, IEEE Trans. Software Eng..

[19]  Hoang Pham,et al.  A general imperfect-software-debugging model with S-shaped fault-detection rate , 1999 .

[20]  Hoang Pham,et al.  Comparisons of nonhomogeneous Poisson process software reliability models and its applications , 2000, Int. J. Syst. Sci..

[21]  Hoang Pham,et al.  NHPP software reliability and cost models with testing coverage , 2003, Eur. J. Oper. Res..

[22]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[23]  Hoang Pham,et al.  An imperfect-debugging fault-detection dependent-parameter software , 2007, Int. J. Autom. Comput..

[24]  Shigeru Yamada,et al.  Imperfect debugging models with fault introduction rate for software reliability assessment , 1992 .

[25]  Shigeru Yamada,et al.  USER-ORIENTED AND -PERCEIVED SOFTWARE AVAILABILITY MEASUREMENT AND ASSESSMENT WITH ENVIRONMENTAL FACTORS , 2007 .

[26]  Michael R. Lyu,et al.  Quantitative software reliability modeling from testing to operation , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.

[27]  Shigeru Yamada,et al.  Software reliability modeling , 2014 .

[28]  Hoang Pham,et al.  Loglog fault-detection rate and testing coverage software reliability models subject to random environments , 2014, Vietnam Journal of Computer Science.

[29]  山田 茂,et al.  Software reliability modeling : fundamentals and applications , 2014 .