The Effects of Gamification in Online Learning Environments: A Systematic Literature Review

Gamification has recently been presented as a successful strategy to engage users, with potential for online education. However, while the number of publications on gamification has been increasing in recent years, a classification of its empirical effects is still missing. We present a systematic literature review conducted with the purpose of closing this gap by clarifying what effects gamification generates on users’ behaviour in online learning. Based on the studies analysed, the game elements most used in the literature are identified and mapped with the effects they produced on learners. Furthermore, we cluster these empirical effects of gamification into six areas: performance, motivation, engagement, attitude towards gamification, collaboration, and social awareness. The findings of our systematic literature review point out that gamification and its application in online learning and in particular in Massive Online Open Courses (MOOCs) are still a young field, lacking in empirical experiments and evidence with a tendency of using gamification mainly as external rewards. Based on these results, important considerations for the gamification design of MOOCs are drawn.

[1]  Julita Vassileva,et al.  Does gamification work for boys and girls?: An exploratory study with a virtual learning environment , 2015, SAC.

[2]  Carina S. González-González,et al.  A Literature Review of Gamification Design Frameworks , 2015, 2015 7th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games).

[3]  Jacques Duilio Brancher,et al.  BrasilEduca — An open-source MOOC platform for Portuguese speakers with gamification concepts , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[4]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[5]  P. Gollwitzer Implementation intentions: Strong effects of simple plans. , 1999 .

[6]  Luís Velez Lapão,et al.  How can information systems provide support to nurses’ hand hygiene performance? Using gamification and indoor location to improve hand hygiene awareness and reduce hospital infections , 2017, BMC Medical Informatics and Decision Making.

[7]  Roland Klemke,et al.  Get Gamification of MOOC right ! How to Embed the Individual and Social Aspects of MOOCs in Gamification Design . , 2018 .

[8]  Ig Ibert Bittencourt,et al.  A gamified peer assessment model for on-line learning environments in a competitive context , 2016, Computers in Human Behavior.

[9]  Chris Piech,et al.  Deconstructing disengagement: analyzing learner subpopulations in massive open online courses , 2013, LAK '13.

[10]  Ahmad Fadhil Yusof,et al.  The Implementation of Gamification in Massive Open Online Courses (MOOC) Platform , 2018 .

[11]  Jing Luo,et al.  Enhancing student learning experience with technology-mediated gamification: An empirical study , 2018, Comput. Educ..

[12]  Juho Hamari,et al.  Do badges increase user activity? A field experiment on the effects of gamification , 2017, Comput. Hum. Behav..

[13]  Scott Grant,et al.  Encouraging user behaviour with achievements: An empirical study , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[14]  Eduardo Figueiredo,et al.  Gamification in Software Engineering Education: An Empirical Study , 2017, 2017 IEEE 30th Conference on Software Engineering Education and Training (CSEE&T).

[15]  Hung-Yu Wei,et al.  Exploring Engaging Gamification Mechanics in Massive Online Open Courses , 2016, J. Educ. Technol. Soc..

[16]  Maria Kihl,et al.  Analysis of World of Warcraft traffic patterns and user behavior , 2010, International Congress on Ultra Modern Telecommunications and Control Systems.

[17]  Fiona Fui-Hoon Nah,et al.  Gamification of Education: A Review of Literature , 2014, HCI.

[18]  Kft Hew,et al.  Do points, badges and leaderboard increase learning and activity: a quasi-experiment on the effects of gamification? , 2015 .

[19]  Jesse Fox,et al.  Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance , 2015, Comput. Educ..

[20]  Julio Navío-Marco,et al.  Student’s social e-reputation (“karma”) as motivational factor in MOOC learning , 2019, Interact. Learn. Environ..

[21]  Ali Idri,et al.  A systematic review of gamification in e-Health , 2017, J. Biomed. Informatics.

[22]  Galia Angelova,et al.  Gamification in Education: A Systematic Mapping Study , 2015, J. Educ. Technol. Soc..

[23]  Ming-Shiou Kuo,et al.  How gamification motivates visits and engagement for online academic dissemination - An empirical study , 2016, Comput. Hum. Behav..

[24]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[25]  Ourania Sitra,et al.  The effect of badges on the engagement of students with special educational needs: A case study , 2017, Education and Information Technologies.

[26]  Asimina Vasalou,et al.  Using Gamification to Motivate Students with Dyslexia , 2016, CHI.

[27]  Muhamad Risqi LexiPal: Design, Implementation and Evaluation of Gamification on Learning Application for Dyslexia , 2015 .

[28]  Sun Joo Ahn,et al.  The Role of Gamification in Enhancing Intrinsic Motivation to Use a Loyalty Program , 2017 .

[29]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[30]  Margarita Martinez-Nuñez,et al.  New challenges for the motivation and learning in engineering education using gamification in MOOC , 2015 .

[31]  Meaghan C. Lister,et al.  Gamification: The effect on student motivation and performance at the post-secondary level , 2015 .

[32]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[33]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[34]  Vincent Aleven,et al.  Gamification of Joint Student/System Control over Problem Selection in a Linear Equation Tutor , 2014, Intelligent Tutoring Systems.

[35]  S. Edney,et al.  Does gamification increase engagement with online programs? A systematic review , 2017, PloS one.

[36]  Luis de Marcos,et al.  An empirical study comparing gamification and social networking on e-learning , 2014, Comput. Educ..

[37]  Pooja Gupta,et al.  Gamification of MOOCs for increasing user engagement , 2014, 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE).

[38]  Marcus Grant,et al.  Overcoming Isolation in Distance Learning: Building a Learning Community through Time and Space , 2010 .

[39]  Lennart E. Nacke,et al.  The maturing of gamification research , 2017, Comput. Hum. Behav..

[40]  P. Gollwitzer,et al.  Implementation intentions and goal achievement: A meta-analysis of effects and processes , 2006 .

[41]  Muhammad Ovais Ahmad,et al.  Student perceptions and attitudes towards the software factory as a learning environment , 2014, 2014 IEEE Global Engineering Education Conference (EDUCON).

[42]  Ángel Fidalgo Blanco,et al.  Gamification in MOOC: challenges, opportunities and proposals for advancing MOOC model , 2014, TEEM '14.

[43]  KyewskiElias,et al.  To gamify or not to gamify? An experimental field study of the influence of badges on motivation, activity, and performance in an online learning course , 2018 .

[44]  Muhamad Risqi Utama Saputra,et al.  LexiPal: Design, Implementation and Evaluation of Gamification on Learning Application for Dyslexia , 2015 .

[45]  R. Landers,et al.  An Evaluation of Gamified Training: Using Narrative to Improve Reactions and Learning , 2017 .

[46]  David Coyle,et al.  Gamification of Cognitive Assessment and Cognitive Training: A Systematic Review of Applications and Efficacy , 2016, JMIR serious games.

[47]  Berkan Celik,et al.  A qualitative investigation of student perceptions of game elements in a gamified course , 2018, Comput. Hum. Behav..

[48]  Ari Korhonen,et al.  The Effect of Achievement Badges on Students' Behavior: An Empirical Study in a University-Level Computer Science Course , 2015, Int. J. Emerg. Technol. Learn..

[49]  Marco Kalz,et al.  The MOOC and learning analytics innovation cycle (MOLAC): a reflective summary of ongoing research and its challenges , 2016, J. Comput. Assist. Learn..

[50]  Harry B. Santoso,et al.  Development of gamification-enriched pedagogical agent for e-Learning system based on community of inquiry , 2015 .

[51]  Tamarah Smith,et al.  Gamified Modules for an Introductory Statistics Course and Their Impact on Attitudes and Learning , 2017 .

[52]  Seiji Isotani,et al.  A systematic mapping on gamification applied to education , 2014, SAC.

[53]  Roland Klemke,et al.  Get Gamification of MOOC right! , 2018, Int. J. Serious Games.

[54]  Yogesh Kumar Dwivedi,et al.  Examining the impact of gamification on intention of engagement and brand attitude in the marketing context , 2017, Comput. Hum. Behav..

[55]  Sébastien George,et al.  Adaptation of Gaming Features for Motivating Learners , 2017 .

[56]  Justin Reich,et al.  The MOOC pivot , 2019, Science.

[57]  Joseph Jay Williams,et al.  A Playful Game Changer: Fostering Student Retention in Online Education with Social Gamification , 2015, L@S.

[58]  Andrija Bernik,et al.  A Pilot Study of the Influence of Gamification on the Effectiveness of an e-Learning Course , 2015 .

[59]  Luís Filipe Rodrigues,et al.  Playing seriously - How gamification and social cues influence bank customers to use gamified e-business applications , 2016, Comput. Hum. Behav..

[60]  Alexandre N. Tuch,et al.  Towards understanding the effects of individual gamification elements on intrinsic motivation and performance , 2017, Comput. Hum. Behav..

[61]  A Sarina Sulaiman Nurbiha,et al.  Gaimooc: adapting gamification approach in massive open online courses to improve user engagement , 2018 .

[62]  Katheryn R. Christy,et al.  Leaderboards in a virtual classroom: A test of stereotype threat and social comparison explanations for women's math performance , 2014, Comput. Educ..

[63]  Alexandre N. Tuch,et al.  Do points, levels and leaderboards harm intrinsic motivation?: an empirical analysis of common gamification elements , 2013, Gamification.

[64]  Jouni Ikonen,et al.  Increasing collaborative communications in a programming course with gamification: a case study , 2014, CompSysTech.

[65]  Roland Klemke,et al.  Identifying Game Elements Suitable for MOOCs , 2017, EC-TEL.

[66]  Jeffrey Earp,et al.  Gamification and Education: a Literature Review , 2022 .

[67]  Marco Kalz,et al.  Refining success and dropout in massive open online courses based on the intention–behavior gap , 2017 .

[68]  Nicole C. Krämer,et al.  To gamify or not to gamify? An experimental field study of the influence of badges on motivation, activity, and performance in an online learning course , 2018, Comput. Educ..

[69]  E. A. Locke,et al.  New Directions in Goal-Setting Theory , 2006 .

[70]  Staffan Björk,et al.  Patterns In Game Design , 2004 .

[71]  Alejandra Martínez-Monés,et al.  How Gamification Is Being Implemented in MOOCs? A Systematic Literature Review , 2017, EC-TEL.

[72]  Han-Chung Huang,et al.  How Do Online Game Communities Retain Gamers? Social Presence and Social Capital Perspectives , 2015, J. Comput. Mediat. Commun..

[73]  Carol Maher,et al.  Engagement, compliance and retention with a gamified online social networking physical activity intervention , 2017, Translational behavioral medicine.

[74]  Ben-Gurion,et al.  Personality Based Gamification – Educational Gamification for Extroverts and Introverts , 2014 .

[75]  Roland Klemke,et al.  gMOOCs - Flow and Persuasion to Gamify MOOCs , 2017, GALA.

[76]  Dunia Ines Jara-Roa,et al.  Techno-instructional application in a MOOC designed with gamification techniques , 2016, 2016 Third International Conference on eDemocracy & eGovernment (ICEDEG).

[77]  Marco Kalz,et al.  If MOOCS are the answer - did we ask the right questions? Implications for the design of large-scale open online courses , 2013 .

[78]  Chuan-Hoo Tan,et al.  HCI in Business , 2014, Lecture Notes in Computer Science.

[79]  Richard N. Landers,et al.  Gamification of task performance with leaderboards: A goal setting experiment , 2017, Comput. Hum. Behav..

[80]  Antti Knutas,et al.  Publication trends in gamification: A systematic mapping study , 2018, Comput. Sci. Rev..

[81]  Amy K. Landers,et al.  An Empirical Test of the Theory of Gamified Learning , 2014 .

[82]  Lasse Hakulinen,et al.  The Effect of Gamification on Students with Different Achievement Goal Orientations , 2014, 2014 International Conference on Teaching and Learning in Computing and Engineering.

[83]  Eva García,et al.  On the effectiveness of game-like and social approaches in learning: Comparing educational gaming, gamification & social networking , 2016, Comput. Educ..

[84]  Roland Klemke,et al.  Towards Implementing Gamification in MOOCs , 2017, GALA.

[85]  Roland Klemke,et al.  Gamification in MOOCs to enhance users' goal achievement , 2017, 2017 IEEE Global Engineering Education Conference (EDUCON).

[86]  Mustafa Güler,et al.  Gamifying an ICT course: Influences on engagement and academic performance , 2017, Comput. Hum. Behav..

[87]  Martin Ebner,et al.  Gamification in MOOCs: A review of the state of the art , 2018, 2018 IEEE Global Engineering Education Conference (EDUCON).

[88]  Antonio García-Cabot,et al.  Social network analysis of a gamified e-learning course: Small-world phenomenon and network metrics as predictors of academic performance , 2016, Comput. Hum. Behav..