A general formulation of optimal testing-time allocation for modular systems

Software testing is very costly in software development and the testing-time during the module testing phase is limited. Thus, the problem of optimal testing-time allocation is of great importance in practice. In this paper, a general formulation of optimal testing-time allocation for modular systems is proposed. The objective is to maximize the reliability of the entire software system. In our formulation, both architecture-based models and non-homogeneous Poisson process (NHPP) models are used. The assumptions are also highlighted to help practitioners better under the limitations that need attention. A numerical example is provided and sensitivity analysis is conducted to detect significant parameters.

[1]  Shunji Osaki,et al.  Software-reliability growth with a Weibull test-effort: a model and application , 1993 .

[2]  Katerina Goseva-Popstojanova,et al.  Architecture-based approach to reliability assessment of software systems , 2001, Perform. Evaluation.

[3]  Xuan Wang,et al.  Adequacy, Accuracy, Scalability, and Uncertainty of Architecture-based Software Reliability: Lessons Learned from Large Empirical Case Studies , 2006, 2006 17th International Symposium on Software Reliability Engineering.

[4]  Roger C. Cheung,et al.  A User-Oriented Software Reliability Model , 1978, IEEE Transactions on Software Engineering.

[5]  Adequacy , 2010 .

[6]  Michael R. Lyu,et al.  Optimal testing resource allocation, and sensitivity analysis in software development , 2005, IEEE Transactions on Reliability.

[7]  Min Xie,et al.  A study of the sensitivity of software release time , 1998, J. Syst. Softw..

[8]  Katerina Goseva-Popstojanova,et al.  Large empirical case study of architecture-based software reliability , 2005, 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05).

[9]  Jean-Claude Laprie,et al.  Dependability Evaluation of Software Systems in Operation , 1984, IEEE Transactions on Software Engineering.

[10]  Rani Rajan,et al.  Optimal testing resource allocation models for modular software , 2006, RAMS '06. Annual Reliability and Maintainability Symposium, 2006..

[11]  Min Xie,et al.  A study of operational and testing reliability in software reliability analysis , 2000, Reliab. Eng. Syst. Saf..

[12]  Thomas L. Hemminger,et al.  A Moving Average Non-Homogeneous Poisson Process Reliability Growth Model to Account for Software with Repair and System Structures , 2007, IEEE Transactions on Reliability.

[13]  Katerina Goseva-Popstojanova,et al.  Architecture-based approaches to software reliability prediction , 2003 .

[14]  Chin-Yu Huang,et al.  Optimal resource allocation for cost and reliability of modular software systems in the testing phase , 2006, J. Syst. Softw..

[15]  Swapna S. Gokhale,et al.  Analytical Models for Architecture-Based Software Reliability Prediction: A Unification Framework , 2006, IEEE Transactions on Reliability.

[16]  K Okumoto,et al.  TIME-DEPENDENT ERROR-DETECTION RATE MODEL FOR SOFTWARE AND OTHER PERFORMANCE MEASURES , 1979 .

[17]  P. K. Kapur,et al.  On allocation of resources during testing phase of a modular software , 2007, Int. J. Syst. Sci..

[18]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[19]  Min Xie,et al.  Optimal testing‐time allocation for modular systems , 2001 .