Gamification in the classroom: Examining the impact of gamified quizzes on student learning

Abstract Gamification is emerging as a method aimed at enhancing instructional contents in educational settings. However, theoretical underpinnings of the proposed effects of gamification are lacking. This paper applies the theory of gamified learning and extends research exploring the benefits of gamification on student learning through the testing effect. In a quasi-experimental design, university students (N = 473) prepared for three tests using traditional quizzes (i.e., a question, four response options) or gamified online quizzes (i.e., a wager option, a progress bar, encouraging messages). We assumed that students completing gamified quizzes would complete more quizzes and, through the benefits of the testing effect, would demonstrate better learning. Findings supported the testing effect in that students who completed more quizzes performed better on subsequent tests. Furthermore, students who completed the gamified quizzes had significantly better scores on the first test. However, this effect was not due to students completing more quizzes in the gamification group. Additionally, the beneficial effect of gamification did not persist for subsequent tests. This supports that gamification might work through a novelty effect where its influence may not be sustainable. Further analyses showed that higher achieving students benefited more from gamification than lower achieving students. Overall, the results (a) imply that gamification may be a viable option for short-term assignments, (b) highlight concerns of a novelty effect possibly recommending instructors not to use the same gamification method permanently, and (c) indicate that there are contexts where gamification might not be adequate to target low achieving students. Given these results we call for longitudinal studies investigating the novelty effects of gamification and research examining individual differences moderating the effects of gamification.

[1]  Pierpaolo Di Bitonto,et al.  Training and Learning in e-Health Using the Gamification Approach: The Trainer Interaction , 2014, HCI.

[2]  Kevin C. Almeroth,et al.  Clickers in college classrooms: Fostering learning with questioning methods in large lecture classes , 2009 .

[3]  Ben R. Newell,et al.  The testing effect: The role of feedback and collaboration in a tertiary classroom setting , 2010 .

[4]  Richard N. Landers,et al.  Gamifying Recruitment, Selection, Training, and Performance Management: Game-Thinking in Human Resource Management , 2015 .

[5]  S. P. Singh Gamification: A Strategic Tool for Organizational Effectiveness , 2012 .

[6]  A. Hayes An Index and Test of Linear Moderated Mediation , 2015, Multivariate behavioral research.

[7]  Ivica Boticki,et al.  Usage of a mobile social learning platform with virtual badges in a primary school , 2015, Comput. Educ..

[8]  Christopher A. Rowland The effect of testing versus restudy on retention: a meta-analytic review of the testing effect. , 2014, Psychological bulletin.

[9]  Robert A. Wisher,et al.  THE COMPARATIVE EFFECTIVENESS OF WEB-BASED AND CLASSROOM INSTRUCTION: , 2006 .

[10]  Eean R. Crawford,et al.  JOB ENGAGEMENT: ANTECEDENTS AND EFFECTS ON JOB PERFORMANCE , 2010 .

[11]  James A. Kulik,et al.  Effects of Frequent Classroom Testing. , 1991 .

[12]  Tyler Sax,et al.  Just a Fad? Gamification in Health and Fitness Apps , 2014, JMIR serious games.

[13]  Günter Daniel Rey A Review of Research and a Meta-Analysis of the Seductive Detail Effect. , 2012 .

[14]  Marta Gómez Domingo,et al.  Exploring the use of educational technology in primary education: Teachers' perception of mobile technology learning impacts and applications' use in the classroom , 2016, Comput. Hum. Behav..

[15]  Steven A. Taylor,et al.  The Effectiveness of Customer Participation in New Product Development: A Meta-Analysis , 2016 .

[16]  Jodi Asbell-Clarke,et al.  Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning , 2016, Comput. Hum. Behav..

[17]  M. McDaniel,et al.  Testing the testing effect in the classroom , 2007 .

[18]  Florin Oprescu,et al.  I PLAY AT WORK—ten principles for transforming work processes through gamification , 2014, Front. Psychol..

[19]  Henry L. Roediger,et al.  Disparate Effects of Repeated Testing: Reconciling Ballard's (1913) and Bartlett's (1932) Results , 1992 .

[20]  Alexandre N. Tuch,et al.  Towards understanding the effects of individual gamification elements on intrinsic motivation and performance , 2017, Comput. Hum. Behav..

[21]  Christopher Cunningham,et al.  Gamification by Design - Implementing Game Mechanics in Web and Mobile Apps , 2011 .

[22]  Susan Finlayson,et al.  Importance of Gamification in Increasing Learning. , 2016, Journal of continuing education in nursing.

[23]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[24]  Ana Isabel Canhoto,et al.  Learning From Simulation Design to Develop Better Experiential Learning Initiatives , 2016 .

[25]  J. McAlaney,et al.  Applying Psychological Theory to In-Game Moral Behaviors Through the Development of a Purpose-Made Game , 2018, Video Games.

[26]  Shana K. Carpenter,et al.  Impoverished cue support enhances subsequent retention: Support for the elaborative retrieval explanation of the testing effect , 2006, Memory & cognition.

[27]  Jennifer C. Richardson,et al.  EXAMINING SOCIAL PRESENCE IN ONLINE COURSES IN RELATION TO STUDENTS' PERCEIVED LEARNING AND SATISFACTION , 2003, Online Learning.

[28]  Cheryl Tay,et al.  Personality, biographical characteristics, and job interview success: a longitudinal study of the mediating effects of interviewing self-efficacy and the moderating effects of internal locus of causality. , 2006, The Journal of applied psychology.

[29]  J. Wiley,et al.  An examination of the seductive details effect in terms of working memory capacity , 2006, Memory & cognition.

[30]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .

[31]  Darina Dicheva,et al.  A course gamification platform supporting student motivation and engagement , 2014, 2014 International Conference on Web and Open Access to Learning (ICWOAL).

[32]  Amy K. Landers,et al.  An Empirical Test of the Theory of Gamified Learning , 2014 .

[33]  Jesse Fox,et al.  Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance , 2015, Comput. Educ..

[34]  Barbara Means,et al.  Technology and Education Change , 2010 .

[35]  Shana K. Carpenter Testing Enhances the Transfer of Learning , 2012 .

[36]  Debi A. LaPlante,et al.  Behavioral characteristics of Internet gamblers who trigger corporate responsible gambling interventions. , 2012, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[37]  Robert D. Smither,et al.  The Nature of Competitiveness: The Development and Validation of the Competitiveness Index , 1992 .

[38]  Juho Hamari,et al.  Demographic differences in perceived benefits from gamification , 2014, Comput. Hum. Behav..

[39]  Mark A. McDaniel,et al.  Test-Enhanced Learning in a Middle School Science Classroom: The Effects of Quiz Frequency and Placement. , 2011 .

[40]  Neerincx,et al.  Gamification for Astronaut Training , 2012 .

[41]  Dennis W. Moore,et al.  Vocabulary acquisition from teacher explanation and repeated listening to stories: Do they overcome the Matthew effect? , 2002 .

[42]  Nathan D. Kling,et al.  The Impact of Testing Frequency on Student Performance in a Marketing Course , 2005 .

[43]  Henry L. Roediger,et al.  Generalizing test-enhanced learning from the laboratory to the classroom , 2007, Psychonomic bulletin & review.

[44]  Hung-Yu Wei,et al.  Exploring Engaging Gamification Mechanics in Massive Online Open Courses , 2016, J. Educ. Technol. Soc..

[45]  E. Deci,et al.  Ego-involved persistence: When free-choice behavior is not intrinsically motivated , 1991 .

[46]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[47]  Erik A. Wing,et al.  Neural correlates of retrieval-based memory enhancement: An fMRI study of the testing effect , 2013, Neuropsychologia.

[48]  Curtis J. Bonk,et al.  The Handbook of Blended Learning: Global Perspectives, Local Designs , 2005 .

[49]  D. Garrison,et al.  Facilitating Cognitive Presence in Online Learning: Interaction Is Not Enough , 2005 .

[50]  Heinz Mandl,et al.  How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction , 2017, Comput. Hum. Behav..

[51]  B. Zimmerman,et al.  Self-Motivation for Academic Attainment: The Role of Self-Efficacy Beliefs and Personal Goal Setting , 1992, American Educational Research Journal.

[52]  C. Abraham,et al.  Psychological correlates of university students' academic performance: a systematic review and meta-analysis. , 2012, Psychological bulletin.

[53]  Richard N. Landers,et al.  Casual Social Games as Serious Games: The Psychology of Gamification in Undergraduate Education and Employee Training , 2011, Serious Games and Edutainment Applications.

[54]  L. Baird,et al.  Do grades and tests predict adult accomplishment? , 1985 .

[55]  Richard N. Landers,et al.  Gamification of task performance with leaderboards: A goal setting experiment , 2017, Comput. Hum. Behav..

[56]  Charles M. Reigeluth,et al.  Instructional Design Theories and Models : An Overview of Their Current Status , 1983 .

[57]  Cornelius J. König,et al.  Dear Computer, Teach Me Manners: Testing Virtual Employment Interview Training , 2016 .

[58]  Richard N. Landers,et al.  Enhancing instructional outcomes with gamification: An empirical test of the Technology-Enhanced Training Effectiveness Model , 2017, Comput. Hum. Behav..

[59]  Cheryl I. Johnson,et al.  A Testing Effect with Multimedia Learning , 2009 .

[60]  J. H. Sandholtz Teaching With Technology: Creating Student-Centered Classrooms , 1997 .

[61]  R. Garner,et al.  "Seductive details" and learning from text. , 1992 .

[62]  Min Kyu Kim,et al.  The experience of three flipped classrooms in an urban university: an exploration of design principles , 2014, Internet High. Educ..

[63]  Eduardo Salas,et al.  Toward a Taxonomy Linking Game Attributes to Learning , 2012 .

[64]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[65]  Gianni Vercelli,et al.  Applying gamification techniques to enhance effectiveness of video-lessons , 2015 .

[66]  Thomas C. Reeves,et al.  Patterns of engagement in authentic online learning environments , 2003, ASCILITE.

[67]  Daniel B. Horn,et al.  An Examination of the Role Individual Differences Play in Videogame–Based Training , 2009 .

[68]  Patrick Gebhard,et al.  Serious Games for Training Social Skills in Job Interviews , 2019, IEEE Transactions on Games.

[69]  Susanne Narciss,et al.  Promoting self-regulated learning in web-based learning environments , 2007, Comput. Hum. Behav..

[70]  Douglas P. Larsen When I say … test‐enhanced learning , 2013, Medical education.

[71]  Richard N. Landers,et al.  Gamification Science, Its History and Future: Definitions and a Research Agenda , 2018 .

[72]  C.-H. Cheng,et al.  A mobile gamification learning system for improving the learning motivation and achievements , 2015, J. Comput. Assist. Learn..

[73]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[74]  Charles Buabeng-Andoh Factors influencing teachers' adoption and integration of information and communication technology into teaching: A review of the literature , 2012 .

[75]  Marilyn E. Gist,et al.  Self-Efficacy: A Theoretical Analysis of Its Determinants and Malleability , 1992 .

[76]  K. Werbach,et al.  For the Win: How Game Thinking Can Revolutionize Your Business , 2012 .

[77]  Karen E. Irving,et al.  Classroom connectivity and Algebra 1 achievement: A three-year longitudinal study , 2016 .

[78]  A. Bandura GUIDE FOR CONSTRUCTING SELF-EFFICACY SCALES , 2006 .

[79]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[80]  Galia Angelova,et al.  Gamification in Education: A Systematic Mapping Study , 2015, J. Educ. Technol. Soc..

[81]  R. Landers Developing a Theory of Gamified Learning , 2014 .

[82]  K. Hazel Kwon,et al.  Tweeting Badges: User Motivations for Displaying Achievement in Publicly Networked Environments , 2015, Cyberpsychology Behav. Soc. Netw..

[83]  Tyler A. Kummer,et al.  Teaching to the Test…or Testing to Teach: Exams Requiring Higher Order Thinking Skills Encourage Greater Conceptual Understanding , 2014 .

[84]  V. Hein,et al.  Perceptions of teacher’s feedback and learning environment as predictors of intrinsic motivation in physical education , 2003 .

[85]  Nian-Shing Chen,et al.  The impact of persuasive SMS on students' self-regulated learning , 2012, Br. J. Educ. Technol..

[86]  K. Patricia Cross,et al.  Collaborative Learning Techniques: A Handbook for College Faculty , 2004 .