Gamification of Technology-Mediated Training : Not All Competitions Are the Same Radhika Santhanam

G an application of game design elements to non-gaming contexts, is proposed as a way to add engagement in technology-mediated training programs. Yet there is hardly any information on how to adapt game design elements to improve learning outcomes and promote learner engagement. To address this issue, we focus on a popular game design element, competition, and specifically examine the effects of different competitive structures, i.e., whether a person faces a higher-skilled, lower-skilled or equally-skilled competitor, on learning and engagement. We study a gamified training design for databases, where trainees play a trivia-based mini-game with a competitor after each e-training module. Trainees who faced a lower-skilled competitor reported higher self-efficacy beliefs and better learning outcomes, supporting the effect of peer appraisal, a less examined aspect of social cognitive theory. Yet trainees who faced equally-skilled competitors reported higher levels of engagement, supporting the balance principle of flow theory. Our study findings indicate that no one competitive structure can simultaneously address learning and engagement outcomes. The choice of competitive structures depends on the priority of the outcomes in training. Our findings provide one explanation for the mixed findings on the effect of competitive gamification designs in technology mediated training.

[1]  Seung-Hyun Kim,et al.  Gamification: A New Paradigm for Online User Engagement , 2012, ICIS.

[2]  Radhika Santhanam,et al.  Could the use of a knowledge-based system lead to implicit learning? , 2007, Decis. Support Syst..

[3]  Hercy N. H. Cheng,et al.  Equal opportunity tactic: Redesigning and applying competition games in classrooms , 2009, Comput. Educ..

[4]  Edward L. Deci,et al.  Elements of the Competitive Situation that Affect Intrinsic Motivation , 1996 .

[5]  M. Csíkszentmihályi The flow experience and its significance for human psychology. , 1988 .

[6]  J. Harackiewicz,et al.  Winning Isn't Everything: Competition, Achievement Orientation, and Intrinsic Motivation , 1999 .

[7]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[8]  Robert P. Bostrom,et al.  An Investigation of the Appropriation of Technology-Mediated Training Methods Incorporating Enactive and Collaborative Learning , 2013, Inf. Syst. Res..

[9]  Radhika Santhanam,et al.  Using Self-Regulatory Learning to Enhance E-Learning-Based Information Technology Training , 2008, Inf. Syst. Res..

[10]  Andrew Whinston,et al.  Optimal Design of Consumer Contests , 2007 .

[11]  Jesse Fox,et al.  Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance , 2015, Comput. Educ..

[12]  C. Saunders,et al.  “Is It Already 4 a.m. in Your Time Zone?” , 2007 .

[13]  Robert P. Bostrom,et al.  End-user training methods: what we know, need to know , 2006, SIGMIS CPR '06.

[14]  Michael F. Young,et al.  Our Princess Is in Another Castle , 2012 .

[15]  Khim-Yong Goh,et al.  Engaging Consumers with Advergames: An Experimental Evaluation of Interactivity, Fit and Expectancy , 2014, J. Assoc. Inf. Syst..

[16]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[17]  J. Webster,et al.  Teaching Effectiveness in Technology-Mediated Distance Learning , 1997 .

[18]  A. Bandura,et al.  Social Cognitive Theory of Organizational Management , 1989 .

[19]  Frank L. Greitzer,et al.  Cognitive science implications for enhancing training effectiveness in a serious gaming context , 2007, JERC.

[20]  Avishalom Tor,et al.  Ranks and Rivals: A Theory of Competition , 2006, Personality & social psychology bulletin.

[21]  H. Bless,et al.  Bulletin Personality and Social Psychology Flow and Regulatory Compatibility: an Experimental Approach to the Flow Model of Intrinsic Motivation on Behalf Of: Society for Personality and Social Psychology , 2022 .

[22]  Deborah Compeau,et al.  The Effects of Self-Regulated Learning Processes on E-Learning Outcomes in Organizational Settings , 2012, J. Manag. Inf. Syst..

[23]  Tarja Susi,et al.  Serious Games : An Overview , 2007 .

[24]  Robert P. Bostrom,et al.  Technology-Mediated Learning: A Comprehensive Theoretical Model , 2009, J. Assoc. Inf. Syst..

[25]  ksmouk Comparing Objective Measures and Perceptions of Cognitive Learning in an ERP Simulation Game , 2010 .

[26]  Dorothy E. Leidner,et al.  Research Commentary: Technology-Mediated Learning - A Call for Greater Depth and Breadth of Research , 2001, Inf. Syst. Res..

[27]  Ian Glover,et al.  Play As You Learn: Gamification as a Technique for Motivating Learners , 2013 .

[28]  P. Pintrich Multiple Goals, Multiple Pathways: The Role of Goal Orientation in Learning and Achievement. , 2000 .

[29]  Z. Demetrovics,et al.  Why do you play? The development of the motives for online gaming questionnaire (MOGQ) , 2011, Behavior research methods.

[30]  Radhika Santhanam,et al.  Improving End-User Proficiency: Effects of Conceptual Training and Nature of Interaction , 1994, Inf. Syst. Res..

[31]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[32]  Chaelynne M. Wolak Assessing User Competence: Conceptualization and Measurement , 2000 .

[33]  Kyung Hwan Baik Two‐Player Asymmetric Contests with Ratio‐Form Contest Success Functions , 2004 .

[34]  Radhika Santhanam,et al.  Toward an Integrative Understanding of Information Technology Training Research across Information Systems and Human-Computer Interaction: A Comprehensive Review , 2013 .

[35]  J. Harackiewicz,et al.  The effects of cooperation and competition on intrinsic motivation and performance. , 2004, Journal of personality and social psychology.

[36]  Juan C. Burguillo,et al.  Using game theory and Competition-based Learning to stimulate student motivation and performance , 2010, Comput. Educ..

[37]  R. Santhanam Towards Meaningful Engagement : A Framework for Design and , 2016 .

[38]  Jane Webster,et al.  Validation of a Multidimensional Measure of Goal Orientation. , 2004 .

[39]  Frederik Cornillie,et al.  Concepts and Mechanics for Educational Mini-Games A Human-Centred Conceptual Design Approach involving Adolescent Learners and Domain Experts , 2012 .

[40]  Jennifer A. Epstein,et al.  Winning is Not Enough: The Effects of Competition and Achievement Orientation on Intrinsic Interest , 1992 .

[41]  Roger Azevedo,et al.  Learning With Computer-Based Learning Environments: A Literature Review of Computer Self-Efficacy , 2009 .

[42]  Mengze Shi,et al.  Designing Optimal Sales Contests: A Theoretical Perspective , 2001 .

[43]  Timothy Paul Cronan,et al.  Comparing Objective Measures and Perceptions of Cognitive Learning in an ERP Simulation Game , 2012 .

[44]  L. Festinger A Theory of Social Comparison Processes , 1954 .

[45]  S. Engeser,et al.  Flow, performance and moderators of challenge-skill balance , 2008 .

[46]  Radhika Santhanam,et al.  Digital Games and Beyond: What Happens When Players Compete , 2013, MIS Q..

[47]  Petra Kaufmann The Gamification Of Learning And Instruction Fieldbook Ideas Into Practice , 2016 .

[48]  Thomas W. Malone,et al.  Toward a Theory of Intrinsically Motivating Instruction , 1981, Cogn. Sci..

[49]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[50]  Abraham P. Buunk,et al.  Social Comparison in the Classroom: A Review , 2008 .

[51]  M. Csíkszentmihályi Beyond boredom and anxiety , 1975 .

[52]  I. E. Allen,et al.  Going the Distance: Online Education in the United States, 2011. , 2011 .

[53]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[54]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[55]  John Brown,et al.  Gamification » Blog Archive » Gartner Says by 2014, 80 Percent of Current Gamified Applications Will Fail to Meet Business Objectives Primarily Due to Poor Design , 2014 .

[56]  A. J. Faria Business Simulation Games: Current Usage Levels—An Update , 1998 .

[57]  Richard D. Johnson,et al.  Research Report: The Role of Behavioral Modeling in Computer Skills Acquisition: Toward Refinement of the Model , 2000, Inf. Syst. Res..

[58]  Nathan W. Twyman,et al.  Taking "Fun and Games" Seriously: Proposing the Hedonic-Motivation System Adoption Model (HMSAM) , 2012, J. Assoc. Inf. Syst..

[59]  Jiming Wu,et al.  Effects of Extrinsic and Intrinsic Motivators on Using Utilitarian, Hedonic, and Dual-Purposed Information Systems: A Meta-Analysis , 2013, J. Assoc. Inf. Syst..

[60]  Martin Oliver,et al.  How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? , 2006, Comput. Educ..

[61]  Fred D. Davis,et al.  Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition , 2003, Inf. Syst. Res..

[62]  Richard N. Van Eck Digital Game-Based Learning: It's Not Just the Digital Natives Who Are Restless. , 2006 .

[63]  Jincheul Jang,et al.  Effects of Alternative Coding Strategies on Computer Software Training: Imagery Coding and Procedural Coding , 2012 .