Defect categorization: making use of a decade of widely varying historical data

This paper describes our experience in aggregating a number of historical datasets containing inspection defect data using different categorization schemes. Our goal was to make use of the historical data by creating models to guide future development projects. We describe our approach to reconciling the different choices used in the historical datasets to categorize defects, and the challenges we faced. We also present a set of recommendations for others involved in classifying defects.

[1]  Li Ma,et al.  Analyzing Errors and Referral Pairs to Characterize Common Problems and Improve Web Reliability , 2003, ICWE.

[2]  Amit M. Paradkar,et al.  A software flaw taxonomy: aiming tools at security , 2005, SOEN.

[3]  Emily Hill,et al.  Applying Concept Analysis to User-Session-Based Testing of Web Applications , 2007, IEEE Transactions on Software Engineering.

[4]  Gregg Rothermel,et al.  Leveraging user-session data to support Web application testing , 2005, IEEE Transactions on Software Engineering.

[5]  Inderpal S. Bhandari,et al.  Orthogonal Defect Classification - A Concept for In-Process Measurements , 1992, IEEE Trans. Software Eng..

[6]  Carl E. Landwehr,et al.  A taxonomy of computer program security flaws , 1993, CSUR.

[7]  John C. Munson,et al.  Software Evolution and the Fault Process , 1999 .

[8]  Ellis Horowitz,et al.  Software system defect content prediction from development process and product characteristics , 1998 .

[9]  Ram Chillarege,et al.  Defect type and its impact on the growth curve (software development) , 1991, [1991 Proceedings] 13th International Conference on Software Engineering.

[10]  Cem Kaner,et al.  Bug Taxonomies: Use Them to Generate Better Tests 1 , 2003 .

[11]  Christian Denger,et al.  An industrial case study of implementing and validating defect classification for process improvement and quality management , 2005, 11th IEEE International Software Metrics Symposium (METRICS'05).

[12]  Li Ma,et al.  Web error classification and analysis for reliability improvement , 2007, J. Syst. Softw..

[13]  Eugene H. Spafford,et al.  Use of A Taxonomy of Security Faults , 1996 .

[14]  Leonardo Mariani,et al.  A Fault Taxonomy for Component-Based Software , 2003, TACoS.

[15]  Dewayne E. Perry,et al.  Classification and evaluation of defects in a project retrospective , 2002, J. Syst. Softw..