An analysis of the use of badges in an educational experiment

The use of badges in educational contexts its starting to gain popularity. However many studies do not offer an extensive analysis of the results regarding the use of badges after the educational experiment is finished. In this work we offer an evaluation of the results of three courses (physics, chemistry and mathematics) that we have conducted using Khan Academy with a wide badge system and 291 different students. We analyze these results regarding the distribution of badges per student, analyzing also the different badge types and which of them were delivered more often. We also explore the influence of factors such as the difficulty of problems or video length in the amount of badges triggered by exercises and videos respectively. We compare the results among the three courses trying to find possible explanations to these differences. We also put the lessons learned into context and give recommendations so that our findings can be used by instructional designers and other researchers.

[1]  Joaquim A. Jorge,et al.  Engaging Engineering Students with Gamification , 2013, 2013 5th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES).

[2]  Scott Grant,et al.  Encouraging user behaviour with achievements: An empirical study , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[3]  Ross M. Higashi,et al.  Are badges useful in education?: it depends upon the type of badge and expertise of learner , 2013 .

[4]  Carlos Delgado Kloos,et al.  Analyzing students' intentionality towards badges within a case study using Khan academy , 2016, LAK.

[5]  Joaquim A. Jorge,et al.  So Fun It Hurts - Gamifying an Engineering Course , 2013, HCI.

[6]  E. Deci,et al.  Extrinsic Rewards and Intrinsic Motivation in Education: Reconsidered Once Again , 2001 .

[7]  Carlos Delgado Kloos,et al.  ALAS-KA: A learning analytics extension for better understanding the learning process in the Khan Academy platform , 2015, Comput. Hum. Behav..

[8]  Emily Goligoski.  Motivating the Learner: Mozilla’s Open Badges Program , 2012 .

[9]  Juho Hamari,et al.  Framework for Designing and Evaluating Game Achievements , 2011, DiGRA Conference.

[10]  Ross Higashi,et al.  ‘ Achievement Systems ’ to Boost ‘ Achievement Motivation ’ , 2011 .

[11]  Jure Leskovec,et al.  Steering user behavior with badges , 2013, WWW.

[12]  Kim Flintoff,et al.  Digital badges in education , 2013, Education and Information Technologies.

[13]  Ari Korhonen,et al.  Empirical Study on the Effect of Achievement Badges in TRAKLA2 Online Learning Environment , 2013, 2013 Learning and Teaching in Computing and Engineering.

[14]  Carlos Delgado Kloos,et al.  Analyzing the Impact of Using Optional Activities in Self-Regulated Learning , 2016, IEEE Transactions on Learning Technologies.