Understanding student behavior and perceptions toward earning badges in a gamified MOOC

Despite the advantages of MOOCs, such as the open and free access to education, these courses are criticized for students’ lack of motivation and their high dropout rates. Gamification is a technique used to increase student motivation and engagement in small-scale educational contexts. However, the effects of gamification on student engagement have been scarcely explored in MOOC environments, and the findings so far are inconsistent. To address this gap, this research work examines the students’ behavior toward earning badges and how it relates to their engagement in a gamified MOOC. According to the results, the behaviors toward badges of the active students were generally positive and significantly correlated with other variables measuring their engagement (e.g., pageviews, submitted tasks, forum posts), although this positive behavior seems to decrease throughout the course. Additionally, students that reported high motivation by badges at the end of the course showed a higher engagement level than those that were not appealed by badges.

[1]  Christoph Meinel,et al.  The gamification of a MOOC platform , 2017, 2017 IEEE Global Engineering Education Conference (EDUCON).

[2]  Alejandra Martínez-Monés,et al.  From Low-Scale to Collaborative, Gamified and Massive-Scale Courses: Redesigning a MOOC , 2017, EMOOCs.

[3]  Siobhan O'Donovan,et al.  A case study in the gamification of a university-level games development course , 2013, SAICSIT '13.

[4]  Galia Angelova,et al.  Gamification in Education: A Systematic Mapping Study , 2015, J. Educ. Technol. Soc..

[5]  Carlos Delgado Kloos,et al.  Delving into Participants’ Profiles and Use of Social Tools in MOOCs , 2014, IEEE Transactions on Learning Technologies.

[6]  Juho Hamari,et al.  Do badges increase user activity? A field experiment on the effects of gamification , 2017, Comput. Hum. Behav..

[7]  Claude Kirchner,et al.  Massive Open Online Courses: Current State and Perspectives (Dagstuhl Perspectives Workshop 14112) , 2014, Dagstuhl Manifestos.

[8]  Carlos Delgado Kloos,et al.  Detecting and Clustering Students by their Gamification Behavior with Badges: A Case Study in Engineering Education , 2017 .

[9]  Mohammad Khalil,et al.  Learning Analytics in MOOCs: Can Data Improve Students Retention and Learning? , 2016 .

[10]  Pedro J. Muñoz-Merino,et al.  An analysis of the use of badges in an educational experiment , 2016, 2016 IEEE Frontiers in Education Conference (FIE).

[11]  Katy Jordan,et al.  Initial trends in enrolment and completion of massive open online courses , 2014 .

[12]  L. Festinger A Theory of Social Comparison Processes , 1954 .

[13]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[14]  Ricardo Queirós,et al.  Gamification-Based E-Learning Strategies for Computer Programming Education , 2016 .

[15]  Martin Ebner,et al.  MOOCs Completion Rates and Possible Methods to Improve Retention - A Literature Review , 2014 .

[16]  I. Cuthill,et al.  Effect size, confidence interval and statistical significance: a practical guide for biologists , 2007, Biological reviews of the Cambridge Philosophical Society.

[17]  Martin Ebner,et al.  How can Gamification Improve MOOC Student Engagement , 2017 .

[18]  K. Werbach,et al.  For the Win: How Game Thinking Can Revolutionize Your Business , 2012 .

[19]  Denise Whitelock,et al.  The use, role and reception of open badges as a method for formative and summative reward in two Massive Open Online Courses , 2014 .

[20]  R. Stake The art of case study research , 1995 .

[21]  Tharindu Rekha Liyanagunawardena,et al.  Who are with us: MOOC learners on a FutureLearn course , 2015, Br. J. Educ. Technol..

[22]  Juho Hamari,et al.  Transforming homo economicus into homo ludens: A field experiment on gamification in a utilitarian peer-to-peer trading service , 2013, Electron. Commer. Res. Appl..

[23]  Marco Kalz,et al.  Refining success and dropout in massive open online courses based on the intention–behavior gap , 2017 .

[24]  John Brown,et al.  Gamification » Blog Archive » Gamification in Education: What, How, Why Bother? , 2014 .

[25]  M. Csíkszentmihályi Beyond boredom and anxiety , 1975 .

[26]  Khe Foon Hew,et al.  Promoting engagement in online courses: What strategies can we learn from three highly rated MOOCS , 2016, Br. J. Educ. Technol..

[27]  Seiji Isotani,et al.  A systematic mapping on gamification applied to education , 2014, SAC.

[28]  Roland Klemke,et al.  Gamification in MOOCs to enhance users' goal achievement , 2017, 2017 IEEE Global Engineering Education Conference (EDUCON).

[29]  Christian Guetl,et al.  An Attrition Model for MOOCs: Evaluating the Learning Strategies of Gamification , 2016 .

[30]  Ari Korhonen,et al.  Empirical Study on the Effect of Achievement Badges in TRAKLA2 Online Learning Environment , 2013, 2013 Learning and Teaching in Computing and Engineering.

[31]  Zachary Fitz-Walter,et al.  Achievement unlocked: Investigating the design of effective gamification experiences for mobile applications and devices , 2015 .

[32]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[33]  M. Mukaka,et al.  Statistics corner: A guide to appropriate use of correlation coefficient in medical research. , 2012, Malawi medical journal : the journal of Medical Association of Malawi.

[34]  Craig A. Mertler,et al.  Advanced and multivariate statistical methods: Practical application and interpretation: Sixth edition , 2001 .

[35]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[36]  Jennifer Caroline Greene,et al.  Mixed Methods in Social Inquiry , 2007 .

[37]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[38]  Nicole C. Krämer,et al.  To gamify or not to gamify? An experimental field study of the influence of badges on motivation, activity, and performance in an online learning course , 2018, Comput. Educ..

[39]  William Cyrus Navidi,et al.  Statistics for Engineers and Scientists , 2004 .

[40]  Jelke Bethlehem,et al.  Selection Bias in Web Surveys , 2010 .

[41]  Claude Kirchner,et al.  Massively Open Online Courses, Current State and Perspectives (Dagstuhl Perspectives Workshop 14112) , 2014, Dagstuhl Reports.

[42]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[43]  Charles R. Graham,et al.  Measuring student engagement in technology-mediated learning: A review , 2015, Comput. Educ..

[44]  Carlos Delgado Kloos,et al.  Proposal for a Conceptual Framework for Educators to Describe and Design MOOCs , 2014, J. Univers. Comput. Sci..

[45]  Jure Leskovec,et al.  Engaging with massive online courses , 2014, WWW.

[46]  Martin Ebner,et al.  Does Gamification in MOOC Discussion Forums Work? , 2017, EMOOCs.

[47]  Johanna Pirker,et al.  A Practical Experience on the Use of Gamification in MOOC Courses as a Strategy to Increase Motivation , 2016, LTEC@KMO.

[48]  Alejandra Martínez-Monés,et al.  Creating engaging experiences in MOOCs through in-course redeemable rewards , 2018, 2018 IEEE Global Engineering Education Conference (EDUCON).

[49]  Carlos Delgado Kloos,et al.  Gamification for Engaging Computer Science Students in Learning Activities: A Case Study , 2014, IEEE Transactions on Learning Technologies.

[50]  J. Daniel,et al.  Making Sense of MOOCs : Musings in a Maze of Myth , Paradox and Possibility Author : , 2013 .

[51]  Tiago Oliveira,et al.  Gamification: A key determinant of massive open online course (MOOC) success , 2019, Inf. Manag..

[52]  Rebecca Ferguson,et al.  Innovative Pedagogy at Massive Scale: Teaching and Learning in MOOCs , 2014, EC-TEL.

[53]  Alejandra Martínez-Monés,et al.  How Gamification Is Being Implemented in MOOCs? A Systematic Literature Review , 2017, EC-TEL.

[54]  Arturo Gonzalez-Escribano,et al.  Applying Gamification in a Parallel Programming Course , 2017 .

[55]  Martin Ebner,et al.  Gamification in MOOCs: A review of the state of the art , 2018, 2018 IEEE Global Engineering Education Conference (EDUCON).

[56]  Lu Ding,et al.  Studies of student engagement in gamified online discussions , 2017, Comput. Educ..