High assurance software testing in business and DoD

This paper argues that software testing can be less thorough yet more efficient if applied in a well-managed, empirical manner across the entire software development life cycle (SDLC). To ensure success, testing must be planned and executed within an earned value management (EVM) paradigm. A specific example of empirical software testing is given: the Empirical Bayesian Stopping Rule (EBSR). The Stopping Rule is applied to an actual Department of Defense (DoD) software development to show potential gains with respect to archaic testing methods that were used. The result is that a considerable percentage of the particular testing effort could have been saved under usual circumstances, had the testing been planned and executed under EVM with the Empirical Bayesian Stopping Rule algorithm.

[1]  Mehmet Sahinoglu,et al.  Alternative Parameter Estimation Methods for the Compound Poisson Software Reliability Model with Clustered Failure Data , 1997, Software testing, verification & reliability.

[2]  Susana Stoica How much testing is enough , 1998, Proceedings International Test Conference 1998 (IEEE Cat. No.98CH36270).

[3]  BayrakCoskun,et al.  High Assurance Software Testing In Business And DOD , 2002 .

[4]  Anneliese Amschler Andrews,et al.  Achieving the quality of verification for behavioral models with minimum effort , 2000, Proceedings IEEE 2000 First International Symposium on Quality Electronic Design (Cat. No. PR00525).

[5]  A. von Mayrhauser,et al.  On the efficiency of a compound Poisson stopping rule for mixed strategy testing , 1999, 1999 IEEE Aerospace Conference. Proceedings (Cat. No.99TH8403).

[6]  Paul H. Randolph,et al.  A stopping rule for a compound poisson random variable , 1995 .

[7]  Mehmet Sahinoglu,et al.  A STOPPING RULE FOR TIME-DOMAIN SOFTWARE TESTING , 1999 .

[8]  Mehmet Sahinoglu,et al.  Compound-Poisson Software Reliability Model , 1992, IEEE Trans. Software Eng..

[9]  Anneliese Amschler Andrews,et al.  How much testing is enough? Applying stopping rules to behavioral model testing , 1999, Proceedings 4th IEEE International Symposium on High-Assurance Systems Engineering.

[10]  Mehmet Sahinoglu,et al.  Alternative Parameter Estimation Methods for the Compound Poisson Software Reliability Model with Clustered Failure Data , 1997, Softw. Test. Verification Reliab..