An Examination of Fault Exposure Ratio

The fault exposure ratio, K, is an important factor that controls the per-fault hazard rate, and hence, the effectiveness of the testing of software. The authors examine the variations of K with fault density, which declines with testing time. Because faults become harder to find, K should decline if testing is strictly random. However, it is shown that at lower fault densities K tends to increase. This is explained using the hypothesis that real testing is more efficient than strictly random testing especially at the end of the test phase. Data sets from several different projects (in USA and Japan) are analyzed. When the two factors, e.g., shift in the detectability profile and the nonrandomness of testing, are combined the analysis leads to the logarithmic model that is known to have superior predictive capability. >

[1]  W. Kent Fuchs,et al.  Partial detectability profiles , 1990, 1990 IEEE International Conference on Computer-Aided Design. Digest of Technical Papers.

[2]  Edward N. Adams,et al.  Optimizing Preventive Service of Software Products , 1984, IBM J. Res. Dev..

[3]  Pratap N. Misra,et al.  Software Reliability Analysis , 1983, IBM Syst. J..

[4]  James Mark Keables Program structure and dynamic models of software reliability: investigation in a simulation environment , 1992 .

[5]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[6]  Anneliese Amschler Andrews,et al.  A data collection environment for software reliability research , 1991, Proceedings. 1991 International Symposium on Software Reliability Engineering.

[7]  Shuetsu Hanata,et al.  An error complexity model for software reliability measurement , 1989, ICSE '89.

[8]  Nozer D. Singpurwalla,et al.  Assessing (Software) Reliability Growth Using a Random Coefficient Autoregressive Process and Its Ramifications , 1985, IEEE Transactions on Software Engineering.

[9]  Yashwant K. Malaiya,et al.  The Coverage Problem for Random Testing , 1984, ITC.

[10]  Yashwant K. Malaiya,et al.  Empirical Estimation of Fault Exposure Ratio , 1993 .

[11]  Yashwant K. Malaiya,et al.  Predictability of software-reliability models , 1992 .

[12]  Muneo Takahashi,et al.  An empirical study of a model for program error prediction , 1985, ICSE '85.

[13]  Yoshihiro Tohma,et al.  Parameter estimation of the hyper-geometric distribution model for real test/debug data , 1991, Proceedings. 1991 International Symposium on Software Reliability Engineering.

[14]  Taghi M. Khoshgoftaar,et al.  Predicting Software Development Errors Using Software Complexity Metrics , 1990, IEEE J. Sel. Areas Commun..

[15]  W. W. Everett An 'extended execution time' software reliability model , 1992, [1992] Proceedings Third International Symposium on Software Reliability Engineering.

[16]  John D. Musa Performance analysis rat holes to avoid or how to stall a performance presentation , 1991, SOEN.

[17]  Mitsuru Ohba,et al.  Software Reliability Analysis Models , 1984, IBM J. Res. Dev..

[18]  C. V. Ramamoorthy,et al.  Software Reliability—Status and Perspectives , 1982, IEEE Transactions on Software Engineering.

[19]  George B. Finelli Results of software error-data experiments , 1988 .

[20]  YOSHIHIRO TOHMA,et al.  Structural Approach to the Estimation of the Number of Residual Software Faults Based on the Hyper-Geometric Distribution , 1989, IEEE Trans. Software Eng..

[21]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[22]  Katsuro Inoue,et al.  Experimental evaluation of software reliability growth models , 1988, [1988] The Eighteenth International Symposium on Fault-Tolerant Computing. Digest of Papers.

[23]  Pradip K. Srimani,et al.  Software Reliability Models: Developments, Evaluation and Applications , 1991 .

[24]  Pradip K. Srimani,et al.  The nature of fault exposure ratio , 1992, [1992] Proceedings Third International Symposium on Software Reliability Engineering.

[25]  Bev Littlewood A bayesian differential debugging model for software reliability , 1981, SIGMETRICS Perform. Evaluation Rev..

[26]  John D. Musa,et al.  Rationale for fault exposure ratio K , 1991, SOEN.

[27]  Mitsuru Ohba,et al.  Does imperfect debugging affect software reliability growth? , 1989, ICSE '89.

[28]  L. Darrell Whitley,et al.  Using neural networks in reliability prediction , 1992, IEEE Software.

[29]  Pradip K. Srimani,et al.  Software reliability models : theoretical developments, evaluation, and applications , 1990 .