Why are Bug Reports Invalid?

Invalid bug reports cause overheads in the software process. This study examined the invalid bugs reported against a server application over four years time period and categorized the reasons. The research found that in addition to errors in testing, misunderstandings on functionality and environments, lack of background knowledge, problems in external systems and tools, and other reasons can lead to invalid bug reports. The details in each category were explored to reveal the weaknesses and mistakes in reporting invalid bugs. Based on these findings, the research proposed some suggestions on improving bug reporting quality and avoiding invalid bugs, such as optimal documentation and communication, sufficient training and learning, proper role setting, and testing methods like pair testing, etc. The value of this research is to share the experiences in software QA activities and provide references for other projects.

[1]  Andreas Zeller,et al.  How Long Will It Take to Fix This Bug? , 2007, Fourth International Workshop on Mining Software Repositories (MSR'07:ICSE Workshops 2007).

[2]  Abraham Bernstein,et al.  Software process data quality and characteristics: a historical view on open and closed source projects , 2009, IWPSE-Evol '09.

[3]  Thomas Zimmermann,et al.  What Makes a Good Bug Report? , 2008, IEEE Transactions on Software Engineering.

[4]  Gina Venolia,et al.  The secret life of bugs: Going past the errors and omissions in software repositories , 2009, 2009 IEEE 31st International Conference on Software Engineering.

[5]  Gail C. Murphy,et al.  Coping with an open bug repository , 2005, eclipse '05.

[6]  Westley Weimer,et al.  Modeling bug report quality , 2007, ASE '07.

[7]  Thomas Zimmermann,et al.  Information needs in bug reports: improving cooperation between developers and users , 2010, CSCW '10.

[8]  Foutse Khomh,et al.  Is it a bug or an enhancement?: a text-based approach to classify change requests , 2008, CASCON '08.

[9]  Gail C. Murphy,et al.  Who should fix this bug? , 2006, ICSE.

[10]  Per Runeson,et al.  Detection of Duplicate Defect Reports Using Natural Language Processing , 2007, 29th International Conference on Software Engineering (ICSE'07).