Investigating coverage-reliability relationship and sensitivity of reliability to errors in the operational profile

The focus of the work is an investigation into the correlation between "true" reliability of a software system and the white box testing measures such as block coverage, c-uses and p-uses coverage. We believe that software reliability and testing measures, especially white box testing, are inherently related. Results from experiments are presented to support this belief. We also demonstrate that the estimated reliability is sensitive to the operational profile defined for the software and hence errors in the operational profile may lead to incorrect reliability estimates.

[1]  J. R. Brown,et al.  Testing for software reliability , 1975 .

[2]  M. Lipow,et al.  Testing for software reliability , 1975, Reliable Software.

[3]  Bev Littlewood,et al.  A Bayesian Reliability Growth Model for Computer Software , 1973 .

[4]  John D. Musa,et al.  A theory of software reliability and its application , 1975, IEEE Transactions on Software Engineering.

[5]  Victor R. Basili,et al.  Comparing the Effectiveness of Software Testing Strategies , 1987, IEEE Transactions on Software Engineering.

[6]  Jeffrey M. Voas,et al.  Estimating the Probability of Failure When Testing Reveals No Failures , 1992, IEEE Trans. Software Eng..

[7]  Roger C. Cheung A User-Oriented Software Reliability Model , 1980, IEEE Trans. Software Eng..

[8]  John D. Musa Validity of Execution-Time Theory of Software Reliability , 1979, IEEE Transactions on Reliability.

[9]  Bev Littlewood A bayesian differential debugging model for software reliability , 1981, SIGMETRICS Perform. Evaluation Rev..

[10]  Vernon Rego,et al.  TERSE: A tool for evaluating software reliability models , 1993, Proceedings of 1993 IEEE International Symposium on Software Reliability Engineering.

[11]  Vernon Rego,et al.  Effect of testing techniques on software reliability estimates obtained using a time-domain model , 1995 .

[12]  Nozer D. Singpurwalla,et al.  A Unification of Some Software Reliability Models , 1985 .

[13]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[14]  Bev Littlewood,et al.  A Reliability Model for Systems with Markov Structure , 1975 .

[15]  Amrit L. Goel,et al.  Software Reliability Models: Assumptions, Limitations, and Applicability , 1985, IEEE Transactions on Software Engineering.

[16]  Elaine J. Weyuker,et al.  An Extended Domain-Bases Model of Software Reliability , 1988, IEEE Trans. Software Eng..