Determining an Optimal Time Interval for Testing and Debugging Software

A decision-theoretic procedure for determining an optimal time interval for testing software prior to its release is proposed. The approach is based on the principles of decision-making under uncertainty and involves a maximization of expected utility. Two plausible forms for the utility function, one based on costs and the other involving the realized reliability of the software, are described. Using previous results on probabilistic models for software failure, the ensuing optimization problem (which can be addressed using numerical techniques) is outlined for the case of single-state testing. The sensitivity of the results to the various input parameters is discussed, and some directions for future research are outlined. >

[1]  B. Efron,et al.  Estimating the number of unseen species: How many words did Shakespeare know? Biometrika 63 , 1976 .

[2]  Z. Jelinski,et al.  Software reliability Research , 1972, Statistical Computer Performance Evaluation.

[3]  Sheldon M. Ross,et al.  Software Reliability: The Stopping Rule Problem , 1985, IEEE Transactions on Software Engineering.

[4]  Giovanni Andreatta,et al.  Estimation of Finite Population Properties When Sampling is without Replacement and Proportional to Magnitude , 1986 .

[5]  Nozer D. Singpurwalla,et al.  Optimal Time Intervals for Testing Hypotheses on Computer Software Errors , 1979, IEEE Transactions on Reliability.

[6]  Amrit L. Goel,et al.  Optimum release time for software systems based on reliability and cost criteria , 1984, J. Syst. Softw..

[7]  Watts S. Humphrey,et al.  Managing the software process , 1989, The SEI series in software engineering.

[8]  Lee J. Bain,et al.  A Note on the Truncated Exponential Distribution , 1964 .

[9]  Nozer D. Singpurwalla PREPOSTERIOR ANALYSIS IN SOFTWARE TESTING , 1989 .

[10]  Nozer D. Singpurwalla,et al.  A Unification of Some Software Reliability Models , 1985 .

[11]  Shunji Osaki,et al.  Optimum Release Policies for a Software System with a Scheduled Software Delivery Time , 1984 .

[12]  Thomas S. Ferguson,et al.  Stopping rules for proofreading , 1989, Journal of Applied Probability.

[13]  Nozer D. Singpurwalla,et al.  Bayesian Analysis of a Commonly Used Model for Describing Software Failures , 1983 .

[14]  C. Mallows,et al.  When Should One Stop Testing Software , 1988 .

[15]  John D. Musa,et al.  Quantifying Software Validation: When to Stop Testing? , 1989, IEEE Softw..

[16]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[17]  Nozer D. Singpurwalla,et al.  An Empirical Stopping Rule for Debugging and Testing Computer Software , 1977 .