A Statistical Analysis of Defects in Debian and Strategies for Improving Quality in Free Software Projects

Publisher Summary This chapter discusses several statistical analyses of over 7,000 defect reports submitted on 77 core packages in the Debian system. The findings are of substantial value since they clearly show changes over time and allow the development of effective strategies for defect removal. It has been argued that free software and open source projects benefit from a high level of user involvement. Users influence the direction of a project through feature requests, and their identification of bugs and defects in the software contributes to high levels of quality. These analyses are used to make observations on the efficiency of the open source development process used by projects such as Debian and leads to recommendations on how to improve this process. Finally, this study shows that many important insights can be gained through the analysis of defect data that has been recorded over time, possibly for years. The tool written for this study can be used to investigate roughly 300,000 defect reports stored in Debian's bug tracking system.

[1]  Barton P. Miller,et al.  Fuzz Revisited: A Re-examination of the Reliability of UNIX Utilities and Services , 1995 .

[2]  Stefan Koch,et al.  Effort, co‐operation and co‐ordination in an open source software project: GNOME , 2002, Inf. Syst. J..

[3]  Martin Michlmayr,et al.  Software Process Maturity and the Success of Free Software Projects , 2005, Software Engineering: Evolution and Emerging Technologies.

[4]  Maurizio Morisio,et al.  Evidences in the evolution of OS projects through Changelog Analyses , 2003 .

[5]  Sebastian G. Elbaum,et al.  Quality assurance under the open source development model , 2003, J. Syst. Softw..

[6]  Martin Michlmayr,et al.  USENIX Association Proceedings of the FREENIX Track : 2004 , 2004 .

[7]  Jennifer Vesperman Essential CVS , 2003 .

[8]  Eric A. von Hippel,et al.  How Open Source Software Works: 'Free' User-to-User Assistance? , 2000 .

[9]  Martin Michlmayr,et al.  How to have a successful free software project , 2004, 11th Asia-Pacific Software Engineering Conference.

[10]  E. P. Doolan,et al.  Experience with Fagan's inspection method , 1992, Softw. Pract. Exp..

[11]  Ioannis Stamelos,et al.  Code quality analysis in open source software development , 2002, Inf. Syst. J..

[12]  Gregorio Robles,et al.  Analyzing the anatomy of GNU/Linux distributions: methodology and case studies (Red Hat and Debian) , 2005 .

[13]  Michael Fagan Design and Code Inspections to Reduce Errors in Program Development , 1976, IBM Syst. J..

[14]  Josh Lerner,et al.  The Simple Economics of Open Source , 2000 .

[15]  Kevin Crowston,et al.  FLOSSmole: A Collaborative Repository for FLOSS Research Data and Analyses , 2006, Int. J. Inf. Technol. Web Eng..

[16]  Gregorio Robles,et al.  Evolution of Volunteer Participation in Libre Software Projects: Evidence from Debian , 2005 .

[17]  Barton P. Miller,et al.  An empirical study of the reliability of UNIX utilities , 1990, Commun. ACM.