Towards improving bug tracking systems with game mechanisms

Low bug report quality and human conflicts pose challenges to keep bug tracking systems productive. This work proposes to address these issues by applying game mechanisms to bug tracking systems. We investigate the use of game mechanisms in Stack Overflow, an online community organized to resolve computer programming related problems, for which the improvements we seek for bug tracking systems also turn out to be relevant. The results of our Stack Overflow investigation show that its game mechanisms could be used to address these issues by motivating contributors to increase contribution frequency and quality, by filtering useful contributions, and by creating an agile and dependable moderation system. We proceed by mapping these mechanisms to open-source bug tracking systems, and find that most benefits are applicable. Additionally, our results motivate tailoring a reward and reputation system and summarizing bug reports as future directions for increasing the benefits of game mechanisms in bug tracking systems.

[1]  Saurabh Sinha,et al.  Entering the circle of trust: developer initiation as committers in open-source projects , 2011, MSR '11.

[2]  Christian Robottom Reis,et al.  An Overview of the Software Engineering Process and Tools in the Mozilla Project , 2002 .

[3]  Jian Sun.  Why are Bug Reports Invalid? , 2011, 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation.

[4]  Thomas Zimmermann,et al.  Extracting structural information from bug reports , 2008, MSR '08.

[5]  Thomas Zimmermann,et al.  Duplicate bug reports considered harmful … really? , 2008, 2008 IEEE International Conference on Software Maintenance.

[6]  Lena Mamykina,et al.  Design lessons from the fastest q&a site in the west , 2011, CHI.

[7]  Karl Fogel,et al.  How To Run A Successful Free Software Project - Producing Open Source Software , 2009 .

[8]  Amy J. Ko,et al.  How power users help and hinder open bug reporting , 2010, CHI.

[9]  Parmit K. Chilana,et al.  Design, discussion, and dissent in open bug reports , 2011, iConference '11.

[10]  J. McGonigal.  Reality Is Broken: Why Games Make Us Better and How They Can Change the World , 2011 .

[11]  Westley Weimer,et al.  Modeling bug report quality , 2007, ASE '07.

[12]  A. Maslow.  A Theory of Human Motivation , 1943 .

[13]  Juergen Rilling,et al.  Mining Bug Repositories--A Quality Assessment , 2008, 2008 International Conference on Computational Intelligence for Modelling Control & Automation.

[14]  Lionel C. Briand,et al.  A practical guide for using statistical tests to assess randomized algorithms in software engineering , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[15]  James H. Gerlach,et al.  An empirical analysis of open source software developers' motivations and continuance intentions , 2007, Inf. Manag..

[16]  Josh Lerner,et al.  The Simple Economics of Open Source , 2000 .

[17]  Thomas Zimmermann,et al.  Information needs in bug reports: improving cooperation between developers and users , 2010, CSCW '10.

[18]  Charles L. A. Clarke,et al.  Information Retrieval - Implementing and Evaluating Search Engines , 2010 .

[19]  Danny Cohen.  On Holy Wars and a Plea for Peace , 1981, Computer.

[20]  Andreas Zeller,et al.  How Long Will It Take to Fix This Bug? , 2007, Fourth International Workshop on Mining Software Repositories (MSR'07:ICSE Workshops 2007).

[21]  Chrysanthos Dellarocas,et al.  Self-Interest, Reciprocity, and Participation in Online Reputation Systems , 2004 .

[22]  Magnus Bergquist,et al.  The power of gifts: organizing social relationships in open source communities , 2001, Inf. Syst. J..

[23]  Philip J. Guo,et al.  Characterizing and predicting which bugs get fixed: an empirical study of Microsoft Windows , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[24]  Karl Fogel,et al.  Producing open source software - how to run a successful free software project , 2005 .

[25]  Thomas Zimmermann,et al.  What Makes a Good Bug Report? , 2008, IEEE Transactions on Software Engineering.

[26]  Robert J. Moore,et al.  "Alone together?": exploring the social dynamics of massively multiplayer online games , 2006, CHI.

[27]  S. R. Hiltz,et al.  Experiments in group decision making: Communication process and outcome in face-to-face versus computerized conferences. , 1986 .

[28]  Gina Venolia,et al.  The secret life of bugs: Going past the errors and omissions in software repositories , 2009, 2009 IEEE 31st International Conference on Software Engineering.