Empirically based analysis of failures in software systems

An empirical analysis of failures in software systems is used to evaluate several specific issues and questions in software testing, reliability analysis, and reuse. The issues examined include the following: diminishing marginal returns of testing; effectiveness of multiple fault-detection and testing phases; measuring system reliability versus function or component reliability; developer bias regarding the amount of testing that functions or components will receive; fault-proneness of reused versus newly developed software; and the relationship between degree of reuse and development effort and fault-proneness. Failure data from a large software manufacturer and a NASA production environment were collected and analyzed. >

[1]  Harlan D. Mills,et al.  Certifying the reliability of software , 1986, IEEE Transactions on Software Engineering.

[2]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[3]  Victor R. Basili,et al.  Metric Analysis and Data Validation Across Fortran Projects , 1983, IEEE Transactions on Software Engineering.

[4]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[5]  William E. Howden.  Applicability of Software Validation Techniques to Scientific Programs , 1980, TOPL.

[6]  J. George Shanthikumar.  A state- and time-dependent error occurrence-rate software reliability model with imperfect debugging , 1981, AFIPS '81.

[7]  William E. Howden,et al.  Functional Program Testing , 1978, IEEE Transactions on Software Engineering.

[8]  Bev Littlewood,et al.  A Bayesian Reliability Growth Model for Computer Software , 1973 .

[9]  Michael E. Fagan.  Advances in software inspections , 1986, IEEE Transactions on Software Engineering.

[10]  Victor R. Basili,et al.  Evaluating Software Development by Analysis of Changes: Some Data from the Software Engineering Laboratory , 1985, IEEE Transactions on Software Engineering.

[11]  Bill Curtis,et al.  Productivity factors and programming environments , 1984, ICSE '84.

[12]  Edward N. Adams,et al.  Optimizing Preventive Service of Software Products , 1984, IBM J. Res. Dev..

[13]  Bev Littlewood,et al.  Stochastic Reliability-Growth: A Model for Fault-Removal in Computer-Programs and Hardware-Designs , 1981, IEEE Transactions on Reliability.

[14]  Harlan D. Mills,et al.  Cleanroom Software Engineering , 1987, IEEE Software.

[15]  Simeon C. Ntafos,et al.  A report on random testing , 1981, ICSE '81.

[16]  David J. Panzl.  Automatic Software Test Drivers , 1978, Computer.

[17]  Kenneth A. Foster.  Error Sensitive Test Cases Analysis (ESTCA) , 1980, IEEE Transactions on Software Engineering.

[18]  Victor R. Basili,et al.  A Methodology for Collecting Valid Software Engineering Data , 1984, IEEE Transactions on Software Engineering.

[19]  John D. Musa.  Validity of Execution-Time Theory of Software Reliability , 1979, IEEE Transactions on Reliability.

[20]  Elaine J. Weyuker,et al.  Collecting and categorizing software error data in an industrial environment , 2018, J. Syst. Softw..

[21]  William E. Howden,et al.  Reliability of the Path Analysis Testing Strategy , 1976, IEEE Transactions on Software Engineering.

[22]  John D. Musa,et al.  Software reliability measurement , 1984, J. Syst. Softw..

[23]  Harlan D. Mills,et al.  Correction to 'Certifying the reliability of software' (Jan. 1986 3-11) , 1989 .

[24]  William E. Howden,et al.  Symbolic Testing and the DISSECT Symbolic Evaluation System , 1977, IEEE Transactions on Software Engineering.

[25]  Jack C. Wileden,et al.  Foundations for the Arcadia environment architecture , 1989, SDE 3.

[26]  Bev Littlewood,et al.  Criteria for Software Reliability Model Comparisons , 1984, IEEE Transactions on Software Engineering.

[27]  Amrit L. Goel.  A Guidebook for Software Reliability Assessment. , 1983 .

[28]  Victor R. Basili,et al.  Cleanroom Software Development: An Empirical Evaluation , 1987, IEEE Transactions on Software Engineering.

[29]  Victor R. Basili,et al.  Software errors and complexity: an empirical investigation0 , 1984, CACM.

[30]  Victor R. Basili,et al.  Evaluation of a software requirements document by analysis of change data , 1981, ICSE '81.

[31]  Paul R. McMullin,et al.  Implementing a compiler‐based test tool , 1982, Softw. Pract. Exp..

[32]  John D. Musa,et al.  A theory of software reliability and its application , 1975, IEEE Transactions on Software Engineering.