Gamification in software engineering - A systematic mapping

Abstract Context Gamification seeks for improvement of the user’s engagement, motivation, and performance when carrying out a certain task, by means of incorporating game mechanics and elements, thus making that task more attractive. Much research work has studied the application of gamification in software engineering for increasing the engagement and results of developers. Objective The objective of this paper is to carry out a systematic mapping of the field of gamification in software engineering in an attempt to characterize the state of the art of this field identifying gaps and opportunities for further research. Method We carried out a systematic mapping with a view to finding the primary studies in the existing literature, which were later classified and analyzed according to four criteria: the software process area addressed, the gamification elements used, the type of research method followed, and the type of forum in which they were published. A subjective evaluation of the studies was also carried out to evaluate them in terms of methodology, empirical evidence, integration with the organization, and replicability. Results As a result of the systematic mapping we found 29 primary studies, published between January 2011 and June 2014. Most of them focus on software development, and to a lesser extent, requirements, project management, and other support areas. In the main, they consider very simple gamification mechanics such as points and badges, and few provide empirical evidence of the impact of gamification. Conclusions Existing research in the field is quite preliminary, and more research effort analyzing the impact of gamification in SE would be needed. Future research work should look at other game mechanics in addition to the basic ones and should tackle software process areas that have not been fully studied, such as requirements, project management, maintenance, or testing. Most studies share a lack of methodological support that would make their proposals replicable in other settings. The integration of gamification with an organization’s existing tools is also an important challenge that needs to be taken up in this field.

[1]  Humaira Naz,et al.  Critical Requirements Engineering Issues and their Solution , 2009, 2009 International Conference on Computer Modeling and Simulation.

[2]  Fergal McCaffery,et al.  The Gamification of SPICE , 2012, SPICE.

[3]  Manu Sridharan,et al.  Predicting your own effort , 2012, AAMAS.

[4]  Constance Steinkuehler,et al.  Massively multiplayer online games & education: an outline of research , 2007, CSCL.

[5]  K. Werbach,et al.  For the Win: How Game Thinking Can Revolutionize Your Business , 2012 .

[6]  Wolfgang Prinz,et al.  Dynamic Self-moderation in a Corporate Wiki to Improve Participation and Contribution Quality , 2011, ECSCW.

[7]  Jan Nonnen,et al.  A Field Experiment on Gamification of Code Quality in Agile Development , 2012, PPIG.

[8]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[9]  Aisling Kelliher,et al.  Taskville: visualizing tasks and raising awareness in the workplace , 2013, CHI Extended Abstracts.

[10]  Jonathan Bell,et al.  Secret ninja testing with HALO software engineering , 2011, SSE '11.

[11]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[12]  Christoph Treude,et al.  Mutual assessment in the social programmer ecosystem: an empirical investigation of developer profile aggregators , 2013, CSCW.

[13]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..

[14]  M. Schijven,et al.  Systematic review of serious games for medical education and surgical skills training , 2012, The British journal of surgery.

[15]  Bogdan Vasilescu,et al.  Human aspects, gamification, and social media in collaborative software engineering , 2014, ICSE Companion.

[16]  Giordano Tamburrelli,et al.  Understanding gamification mechanisms for software development , 2013, ESEC/FSE 2013.

[17]  Francisco J. Conejo.  Loyalty 3.0: How to Revolutionize Customer and Employee Engagement with Big Data and Gamification (1st ed.) , 2014 .

[18]  Isabela Gasparini,et al.  Version Control System Gamification: A Proposal to Encourage the Engagement of Developers to Collaborate in Software Projects , 2014, HCI.

[19]  K. Kapp,et al.  The Gamification of Learning and Instruction Fieldbook , 2014 .

[20]  Leif Singer,et al.  Influencing the adoption of software engineering methods using social software , 2012, 2012 34th International Conference on Software Engineering (ICSE).

[21]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[22]  Leif Singer,et al.  It was a bit of a race: Gamification of version control , 2012, 2012 Second International Workshop on Games and Software Engineering: Realizing User Engagement with Game Engineering Techniques (GAS).

[23]  Emerson R. Murphy-Hill,et al.  Experiences gamifying developer adoption of practices and tools , 2014, ICSE Companion.

[24]  Miguel Mira da Silva,et al.  Collaborative Requirements Elicitation with Visualization Techniques , 2012, 2012 IEEE 21st International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[25]  Miguel Mira da Silva,et al.  iThink: A Game-Based Approach Towards Improving Collaboration and Participation in Requirement Elicitation , 2012, VS-GAMES.

[26]  Mark S. Pfaff,et al.  QuoDocs: improving developer engagement in software documentation through gamification , 2014, CHI Extended Abstracts.

[27]  Scott Grant,et al.  Encouraging user behaviour with achievements: An empirical study , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[28]  Pearl Brereton,et al.  Using mapping studies as the basis for further research - A participant-observer case study , 2011, Inf. Softw. Technol..

[29]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[30]  Emerson R. Murphy-Hill,et al.  Towards recognizing and rewarding efficient developer work patterns , 2013, 2013 35th International Conference on Software Engineering (ICSE).