Research Note - Gamification of Technology-Mediated Training: Not All Competitions Are the Same

Gamification, an application of game design elements to non-gaming contexts, is proposed as a way to add engagement in technology-mediated training programs. Yet there is hardly any information on how to adapt game design elements to improve learning outcomes and promote learner engagement. To address this issue, we focus on a popular game design element, competition, and specifically examine the effects of different competitive structures, i.e., whether a person faces a higher-skilled, lower-skilled or equally-skilled competitor, on learning and engagement. We study a gamified training design for databases, where trainees play a trivia-based mini-game with a competitor after each e-training module. Trainees who faced a lower-skilled competitor reported higher self-efficacy beliefs and better learning outcomes, supporting the effect of peer appraisal, a less examined aspect of social cognitive theory. Yet trainees who faced equally-skilled competitors reported higher levels of engagement, supporting the b...

[1]  J. Harackiewicz,et al.  Winning Isn't Everything: Competition, Achievement Orientation, and Intrinsic Motivation , 1999 .

[2]  Z. Demetrovics,et al.  Why do you play? The development of the motives for online gaming questionnaire (MOGQ) , 2011, Behavior research methods.

[3]  L. Festinger A Theory of Social Comparison Processes , 1954 .

[4]  Andrew Whinston,et al.  Optimal Design of Consumer Contests , 2007 .

[5]  J. Webster,et al.  Teaching Effectiveness in Technology-Mediated Distance Learning , 1997 .

[6]  Radhika Santhanam,et al.  Digital Games and Beyond: What Happens When Players Compete , 2013, MIS Q..

[7]  Dorothy E. Leidner,et al.  Research Commentary: Technology-Mediated Learning - A Call for Greater Depth and Breadth of Research , 2001, Inf. Syst. Res..

[8]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[9]  Abraham P. Buunk,et al.  Social Comparison in the Classroom: A Review , 2008 .

[10]  Robert P. Bostrom,et al.  Technology-Mediated Learning: A Comprehensive Theoretical Model , 2009, J. Assoc. Inf. Syst..

[11]  Edward L. Deci,et al.  Elements of the Competitive Situation that Affect Intrinsic Motivation , 1996 .

[12]  Kyung Hwan Baik Two‐Player Asymmetric Contests with Ratio‐Form Contest Success Functions , 2004 .

[13]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[14]  Frederik Cornillie,et al.  Concepts and Mechanics for Educational Mini-Games A Human-Centred Conceptual Design Approach involving Adolescent Learners and Domain Experts , 2012 .

[15]  Juan C. Burguillo,et al.  Using game theory and Competition-based Learning to stimulate student motivation and performance , 2010, Comput. Educ..

[16]  Chaelynne M. Wolak Assessing User Competence: Conceptualization and Measurement , 2000 .

[17]  Timothy Paul Cronan,et al.  Comparing Objective Measures and Perceptions of Cognitive Learning in an ERP Simulation Game , 2012 .

[18]  Jesse Fox,et al.  Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance , 2015, Comput. Educ..

[19]  Roger Azevedo,et al.  Learning With Computer-Based Learning Environments: A Literature Review of Computer Self-Efficacy , 2009 .

[20]  Radhika Santhanam,et al.  Using Self-Regulatory Learning to Enhance E-Learning-Based Information Technology Training , 2008, Inf. Syst. Res..

[21]  Tarja Susi,et al.  Serious Games : An Overview , 2007 .

[22]  P. Pintrich Multiple Goals, Multiple Pathways: The Role of Goal Orientation in Learning and Achievement. , 2000 .

[23]  Thomas W. Malone,et al.  Toward a Theory of Intrinsically Motivating Instruction , 1981, Cogn. Sci..

[24]  A. Kohn No Contest: The Case Against Competition , 1986 .

[25]  Michael F. Young,et al.  Our Princess Is in Another Castle , 2012 .

[26]  Fred D. Davis,et al.  Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition , 2003, Inf. Syst. Res..

[27]  Marilyn K. Potts,et al.  Going the Distance , 2000 .

[28]  Jincheul Jang,et al.  Effects of Alternative Coding Strategies on Computer Software Training: Imagery Coding and Procedural Coding , 2012 .

[29]  Joey J. Lee,et al.  Gamification in Education: What, How, Why Bother? , 2011 .

[30]  Seung-Hyun Kim,et al.  Gamification: A New Paradigm for Online User Engagement , 2012, ICIS.

[31]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[32]  Nathan W. Twyman,et al.  Taking "Fun and Games" Seriously: Proposing the Hedonic-Motivation System Adoption Model (HMSAM) , 2012, J. Assoc. Inf. Syst..

[33]  Jiming Wu,et al.  Effects of Extrinsic and Intrinsic Motivators on Using Utilitarian, Hedonic, and Dual-Purposed Information Systems: A Meta-Analysis , 2013, J. Assoc. Inf. Syst..

[34]  Jane Webster,et al.  Validation of a Multidimensional Measure of Goal Orientation. , 2004 .

[35]  Khim-Yong Goh,et al.  Engaging Consumers with Advergames: An Experimental Evaluation of Interactivity, Fit and Expectancy , 2014, J. Assoc. Inf. Syst..

[36]  A. J. Faria,et al.  Developments In Business Simulation & Experiential Exercises, Volume 23, 1996 BUSINESS SIMULATION GAMES: CURRENT USAGE LEVELS A TEN YEAR UPDATE , 1996 .

[37]  Robert P. Bostrom,et al.  End-user training methods: what we know, need to know , 2010, Data Base.

[38]  Avishalom Tor,et al.  Ranks and Rivals: A Theory of Competition , 2006, Personality & social psychology bulletin.

[39]  R. Santhanam Towards Meaningful Engagement : A Framework for Design and , 2016 .

[40]  Clark C. Abt,et al.  Serious games , 2016, Springer International Publishing.

[41]  John Brown,et al.  Gamification » Blog Archive » Gartner Says by 2014, 80 Percent of Current Gamified Applications Will Fail to Meet Business Objectives Primarily Due to Poor Design , 2014 .

[42]  Radhika Santhanam,et al.  Could the use of a knowledge-based system lead to implicit learning? , 2007, Decis. Support Syst..

[43]  Hercy N. H. Cheng,et al.  Equal opportunity tactic: Redesigning and applying competition games in classrooms , 2009, Comput. Educ..

[44]  Mengze Shi,et al.  Designing Optimal Sales Contests: A Theoretical Perspective , 2001 .

[45]  H. Bless,et al.  Bulletin Personality and Social Psychology Flow and Regulatory Compatibility: an Experimental Approach to the Flow Model of Intrinsic Motivation on Behalf Of: Society for Personality and Social Psychology , 2022 .

[46]  Ian Glover,et al.  Play As You Learn: Gamification as a Technique for Motivating Learners , 2013 .

[47]  A. Bandura,et al.  Social Cognitive Theory of Organizational Management , 1989 .

[48]  M. Csíkszentmihályi The flow experience and its significance for human psychology. , 1988 .

[49]  Deborah Compeau,et al.  The Effects of Self-Regulated Learning Processes on E-Learning Outcomes in Organizational Settings , 2012, J. Manag. Inf. Syst..

[50]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[51]  Matthias J. Sjerps,et al.  Time flies when you're having fun: Cognitive load makes speech sound fast , 2016 .

[52]  M. Csíkszentmihályi Beyond boredom and anxiety , 1975 .

[53]  Martin Oliver,et al.  How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? , 2006, Comput. Educ..

[54]  Robert P. Bostrom,et al.  An Investigation of the Appropriation of Technology-Mediated Training Methods Incorporating Enactive and Collaborative Learning , 2013, Inf. Syst. Res..

[55]  J. S. Armstrong,et al.  Book Review of No Contest : The Case Against Competition By Alfie Kohn Boston : Houghton Mifflin , 1986 By , 1988 .

[56]  C. Saunders,et al.  “Is It Already 4 a.m. in Your Time Zone?” , 2007 .

[57]  J. Harackiewicz,et al.  The effects of cooperation and competition on intrinsic motivation and performance. , 2004, Journal of personality and social psychology.

[58]  Richard N. Van Eck Digital Game-Based Learning: It's Not Just the Digital Natives Who Are Restless. , 2006 .

[59]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[60]  Petra Kaufmann The Gamification Of Learning And Instruction Fieldbook Ideas Into Practice , 2016 .

[61]  Richard D. Johnson,et al.  Research Report: The Role of Behavioral Modeling in Computer Skills Acquisition: Toward Refinement of the Model , 2000, Inf. Syst. Res..

[62]  S. Engeser,et al.  Flow, performance and moderators of challenge-skill balance , 2008 .

[63]  Frank L. Greitzer,et al.  Cognitive science implications for enhancing training effectiveness in a serious gaming context , 2007, JERC.

[64]  Radhika Santhanam,et al.  Toward an Integrative Understanding of Information Technology Training Research across Information Systems and Human-Computer Interaction: A Comprehensive Review , 2013 .

[65]  Robert McCartney,et al.  Why Evidence? , 2007, JERC.

[66]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[67]  Jennifer A. Epstein,et al.  Winning is Not Enough: The Effects of Competition and Achievement Orientation on Intrinsic Interest , 1992 .

[68]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[69]  ksmouk Comparing Objective Measures and Perceptions of Cognitive Learning in an ERP Simulation Game , 2010 .

[70]  A. J. Faria Business Simulation Games: Current Usage Levels—An Update , 1998 .

[71]  Radhika Santhanam,et al.  Toward Meaningful Engagement: A Framework for Design and Research of Gamified Information Systems , 2017, MIS Q..

[72]  Radhika Santhanam,et al.  Improving End-User Proficiency: Effects of Conceptual Training and Nature of Interaction , 1994, Inf. Syst. Res..

[73]  I. E. Allen,et al.  Going the Distance: Online Education in the United States, 2011. , 2011 .

[74]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.