A Testing Coverage Model Based on NHPP Software Reliability Considering the Software Operating Environment and the Sensitivity Analysis

We have been attempting to evaluate software quality and improve its reliability. Therefore, research on a software reliability model was part of the effort. Currently, software is used in various fields and environments; hence, one must provide quantitative confidence standards when using software. Therefore, we consider the testing coverage and uncertainty or randomness of an operating environment. In this paper, we propose a new testing coverage model based on NHPP software reliability with the uncertainty of operating environments, and we provide a sensitivity analysis to study the impact of each parameter of the proposed model. We examine the goodness-of-fit of a new testing coverage model based on NHPP software reliability and other existing models based on two datasets. The comparative results for the goodness-of-fit show that the proposed model does significantly better than the existing models. In addition, the results for the sensitivity analysis show that the parameters of the proposed model affect the mean value function.

[1]  Hoang Pham,et al.  A new software reliability model with Vtub-shaped fault-detection rate and the uncertainty of operating environments , 2014 .

[2]  Min Xie,et al.  A study of operational and testing reliability in software reliability analysis , 2000, Reliab. Eng. Syst. Saf..

[3]  H. Akaike.  A new look at the statistical model identification , 1974 .

[4]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[5]  Shigeru Yamada,et al.  S-Shaped Reliability Growth Modeling for Software Error Detection , 1983, IEEE Transactions on Reliability.

[6]  Hoang Pham,et al.  A general imperfect-software-debugging model with S-shaped fault-detection rate , 1999 .

[7]  Hoang Pham,et al.  A Software Reliability Model with a Weibull Fault Detection Rate Function Subject to Operating Environments , 2017 .

[8]  Kashi Nath Dey,et al.  AN NHPP SOFTWARE RELIABILITY GROWTH MODEL WITH IMPERFECT DEBUGGING AND ERROR GENERATION , 2014 .

[9]  Hoang Pham,et al.  Calibrating software reliability models when the test environment does not match the user environment , 2002 .

[10]  P. K. Kapur,et al.  A Unified Approach for Developing Software Reliability Growth Models in the Presence of Imperfect Debugging and Error Generation , 2011, IEEE Transactions on Reliability.

[11]  Xuemei Zhang,et al.  An NHPP Software Reliability Model and Its Comparison , 1997 .

[12]  Xuemei Zhang,et al.  Some successful approaches to software reliability modeling in industry , 2005, J. Syst. Softw..

[13]  Mitsuru Ohba,et al.  Inflection S-Shaped Software Reliability Growth Model , 1984 .

[14]  Xiaolin Teng,et al.  Considering fault removal efficiency in software reliability assessment , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[15]  James M. Bieman,et al.  Software reliability growth with test coverage , 2002, IEEE Trans. Reliab..

[16]  Hoang Pham,et al.  NHPP software reliability model considering the uncertainty of operating environments with imperfect debugging and testing coverage , 2017 .

[17]  Michael R. Lyu,et al.  Quantitative software reliability modeling from testing to operation , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.

[18]  Shigeru Yamada,et al.  Imperfect debugging models with fault introduction rate for software reliability assessment , 1992 .

[19]  Hoang Pham,et al.  A three-parameter fault-detection software reliability model with the uncertainty of operating environments , 2017, Journal of Systems Science and Systems Engineering.

[20]  Hoang Pham,et al.  A testing-coverage software reliability model with the uncertainty of operating environments , 2014 .

[21]  Hoang Pham,et al.  System Software Reliability , 1999 .

[22]  Hoang Pham,et al.  A testing-coverage software reliability model considering fault removal efficiency and error generation , 2017, PloS one.

[23]  Tadashi Dohi,et al.  Metrics-Based Software Reliability Models Using Non-homogeneous Poisson Processes , 2006, 2006 17th International Symposium on Software Reliability Engineering.

[24]  Hoang Pham,et al.  An NHPP Software Reliability Model with S-Shaped Growth Curve Subject to Random Operating Environments and Optimal Release Time , 2017 .

[25]  Hoang Pham,et al.  An imperfect-debugging fault-detection dependent-parameter software , 2007, Int. J. Autom. Comput..

[26]  Hoang Pham,et al.  A two-phase software reliability modeling involving with software fault dependency and imperfect fault removal , 2017, Comput. Lang. Syst. Struct..

[27]  Hoang Pham,et al.  Optimal Release Time and Sensitivity Analysis Using a New NHPP Software Reliability Model with Probability of Fault Removal Subject to Operating Environments , 2018 .

[28]  S. A. Hossain,et al.  Estimating the parameters of a non-homogeneous Poisson-process model for software reliability , 1993 .

[29]  Shigeru Yamada,et al.  Software Reliability Growth Models with Testing-Effort , 1986, IEEE Transactions on Reliability.

[30]  Michael R. Lyu,et al.  An Assessment of Testing-Effort Dependent Software Reliability Growth Models , 2007, IEEE Transactions on Reliability.

[31]  Hoang Pham,et al.  NHPP software reliability and cost models with testing coverage , 2003, Eur. J. Oper. Res..

[32]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[33]  H. Pham,et al.  A New Methodology for Predicting Software Reliability in the Random Field Environments , 2006, IEEE Transactions on Reliability.

[34]  Nesar Ahmad,et al.  Analysis and Ranking of Software Reliability Models Based on Weighted Criteria Value , 2013 .