Applying sampling to improve software inspections

The main objective of software inspections is to find faults in software documents. The benefits of inspections are reported from researchers as well as software organizations. However, inspections are time consuming and the resources may not be sufficient to inspect all documents. Sampling of documents in inspections provides a systematic solution to select what to be inspected in the case resources are not sufficient to inspect everything. The method presented in this paper uses sampling, inspection and resource scheduling to increase the efficiency of an inspection session. A pre-inspection phase is used in order to determine which documents need most inspection time, i.e. which documents contain most faults. Then, the main inspection is focused on these documents. We describe the sampling method and provide empirical evidence, which indicates that the method is appropriate to use. A Monte Carlo simulation is used to evaluate the proposed method and a case study using industrial data is used to validate the simulation model. Furthermore, we discuss the results and important future research in the area of sampling of software inspections.

[1]  Stephen G. Eick,et al.  Estimating software fault content before coding , 1992, International Conference on Software Engineering.

[2]  Anne Chao,et al.  Estimating population size for sparse data in capture-recapture experiments , 1989 .

[3]  Raymond J. Madachy,et al.  Software process simulation modeling: Why? What? How? , 1999, J. Syst. Softw..

[4]  Edward F. Weller,et al.  Lessons from three years of inspection data (software development) , 1993, IEEE Software.

[5]  Forrest Shull,et al.  The empirical investigation of Perspective-Based Reading , 1995, Empirical Software Engineering.

[6]  Khaled El Emam,et al.  Evaluating Capture-Recapture Models with Two Inspectors , 2001, IEEE Trans. Software Eng..

[7]  Edward Kit,et al.  Software testing in the real world - improving the process , 1995 .

[8]  David R. Anderson,et al.  Statistical inference from capture data on closed animal populations , 1980 .

[9]  Robert G. Ebenau,et al.  Software Inspection Process , 1993 .

[10]  James Miller.  Estimating the number of remaining defects after inspection , 1999 .

[11]  Thomas Gilb,et al.  Software Inspection , 1994 .

[12]  Michael Fagan.  Design and Code Inspections to Reduce Errors in Program Development , 1976, IBM Syst. J..

[13]  Claes Wohlin,et al.  An empirical study of experience-based software defect content estimation methods , 1999, Proceedings 10th International Symposium on Software Reliability Engineering (Cat. No.PR00443).

[14]  Shinji Kusumoto,et al.  Experimental Evaluation of Time Allocation Procedure for Technical Reviews , 1996, J. Syst. Softw..