GAMESIT: A gamified system for information technology training

Abstract Gamified learning systems can enhance both learning outcomes and engagement, but research findings on the effectiveness of such systems are mixed, and there is inadequate attention to theory-grounded designs of gamified learning systems. We address these gaps by conducting a theory-grounded design, development, and evaluation of a gamified e-training system for technology learning. Called GAMESIT, this e-training system has an added gamification layer. Drawing upon Malone's theory of intrinsically motivating instruction, we choose and design gamification elements (e.g., levels, avatar evolution, and distinct visuals) to create appropriate motivational drivers, namely, challenge, curiosity, and fantasy, for learning tasks. We follow a design science framework to iteratively develop GAMESIT and evaluate its effectiveness. In a laboratory experiment, participants using GAMESIT, when compared to those using the non-gamified e-training system, showed improvement in learning outcomes, measured as learners' knowledge comprehension and task performance, and higher engagement, captured through learners' cognitive effort.

[1]  P. Ackerman,et al.  Motivation and cognitive abilities: an integrative/aptitude-treatment interaction approach to skill acquisition , 1989 .

[2]  Radhika Santhanam,et al.  Using Self-Regulatory Learning to Enhance E-Learning-Based Information Technology Training , 2008, Inf. Syst. Res..

[3]  Joseph J. Martocchio,et al.  Microcomputer playfulness: development of a measure with workplace implications , 1992 .

[4]  Patrick Buckley,et al.  Individualising gamification: An investigation of the impact of learning styles and personality traits on the efficacy of gamification using a prediction market , 2017, Comput. Educ..

[5]  Joaquim A. Jorge,et al.  Studying student differentiation in gamified education: A long-term study , 2017, Comput. Hum. Behav..

[6]  Joseph Jay Williams,et al.  A Playful Game Changer: Fostering Student Retention in Online Education with Social Gamification , 2015, L@S.

[7]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[8]  Edward L. Deci,et al.  Elements of the Competitive Situation that Affect Intrinsic Motivation , 1996 .

[9]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[10]  Radhika Santhanam,et al.  Digital Games and Beyond: What Happens When Players Compete , 2013, MIS Q..

[11]  M. Csíkszentmihályi Beyond boredom and anxiety , 1975 .

[12]  Richard D. Johnson,et al.  The Multilevel and Multifaceted Character of Computer Self-Efficacy: Toward Clarification of the Construct and an Integrative Framework for Research , 1998, Inf. Syst. Res..

[13]  Lili Liu,et al.  The Effects of Game Dynamics on User Engagement in Gamified Systems , 2015, 2015 48th Hawaii International Conference on System Sciences.

[14]  Alan R. Hevner,et al.  POSITIONING AND PRESENTING DESIGN SCIENCE RESEARCH FOR MAXIMUM IMPACT 1 , 2013 .

[15]  W D FURNEAUX Neuroticism, extraversion, drive, and suggestibility. , 1961, The International journal of clinical and experimental hypnosis.

[16]  Izak Benbasat,et al.  The Use of Explanations in Knowledge-Based Systems: Cognitive Perspective and a Process-Tracing Analysis , 2000, J. Manag. Inf. Syst..

[17]  Radhika Santhanam,et al.  Toward an Integrative Understanding of Information Technology Training Research across Information Systems and Human-Computer Interaction: A Comprehensive Review , 2013 .

[18]  Juho Hamari,et al.  How to design gamification? A method for engineering gamified software , 2017, Inf. Softw. Technol..

[19]  P. Costa,et al.  Four ways five factors are basic , 1992 .

[20]  Lu Ding,et al.  Studies of student engagement in gamified online discussions , 2017, Comput. Educ..

[21]  Ian Glover,et al.  Play As You Learn: Gamification as a Technique for Motivating Learners , 2013 .

[22]  Galia Angelova,et al.  Gamification in Education: A Systematic Mapping Study , 2015, J. Educ. Technol. Soc..

[23]  Ming-Shiou Kuo,et al.  How gamification motivates visits and engagement for online academic dissemination - An empirical study , 2016, Comput. Hum. Behav..

[24]  Amon Rapp,et al.  A Qualitative Investigation of Gamification: Motivational Factors in Online Gamified Services and Applications , 2015, Int. J. Technol. Hum. Interact..

[25]  Radhika Santhanam,et al.  Improving End-User Proficiency: Effects of Conceptual Training and Nature of Interaction , 1994, Inf. Syst. Res..

[26]  I. E. Allen,et al.  Going the Distance: Online Education in the United States, 2011. , 2011 .

[27]  E. Deci,et al.  The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior , 2000 .

[28]  Juho Hamari,et al.  Gamification of education and learning: A review of empirical literature , 2018, GamiFIN.

[29]  Radhika Santhanam,et al.  Research Note - Gamification of Technology-Mediated Training: Not All Competitions Are the Same , 2016, Inf. Syst. Res..

[30]  Muhammad Ovais Ahmad,et al.  Student perceptions and attitudes towards the software factory as a learning environment , 2014, 2014 IEEE Global Engineering Education Conference (EDUCON).

[31]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[32]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[33]  G. Loewenstein The psychology of curiosity: A review and reinterpretation. , 1994 .

[34]  Ivica Boticki,et al.  Examining competitive, collaborative and adaptive gamification in young learners' math learning , 2018, Comput. Educ..

[35]  Fred D. Davis,et al.  Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition , 2003, Inf. Syst. Res..

[36]  Peter C. Wright,et al.  Funology: from usability to enjoyment , 2005 .

[37]  Deborah I. Fels,et al.  Gamification in theory and action: A survey , 2015, Int. J. Hum. Comput. Stud..

[38]  Thomas W. Malone,et al.  Toward a Theory of Intrinsically Motivating Instruction , 1981, Cogn. Sci..

[39]  Timothy Paul Cronan,et al.  Comparing Objective Measures and Perceptions of Cognitive Learning in an ERP Simulation Game , 2012 .

[40]  Jesse Fox,et al.  Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance , 2015, Comput. Educ..

[41]  Lennart E. Nacke,et al.  The maturing of gamification research , 2017, Comput. Hum. Behav..

[42]  Federica Cena,et al.  Strengthening gamification studies: Current trends and future opportunities of gamification research , 2019, Int. J. Hum. Comput. Stud..

[43]  Richard N. Landers,et al.  Enhancing instructional outcomes with gamification: An empirical test of the Technology-Enhanced Training Effectiveness Model , 2017, Comput. Hum. Behav..

[44]  Bieke Zaman,et al.  Need-supporting gamification in education: An assessment of motivational effects over time , 2018, Comput. Educ..

[45]  Robert P. Bostrom,et al.  End-user training methods: what we know, need to know , 2010, Data Base.

[46]  Khe Foon Hew,et al.  Engaging Asian students through game mechanics: Findings from two experiment studies , 2016, Comput. Educ..

[47]  Radhika Santhanam,et al.  Toward Meaningful Engagement: A Framework for Design and Research of Gamified Information Systems , 2017, MIS Q..

[48]  Joseph J. Martocchio,et al.  Turning Work into Play: Implications for Microcomputer Software Training , 1993 .

[49]  E. Deci,et al.  A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. , 1999, Psychological bulletin.

[50]  Jay F. Nunamaker,et al.  Systems Development in Information Systems Research , 1990, J. Manag. Inf. Syst..

[51]  Gillian B. Yeo,et al.  Subjective cognitive effort: a model of states, traits, and time. , 2008, The Journal of applied psychology.

[52]  Nicole C. Krämer,et al.  To gamify or not to gamify? An experimental field study of the influence of badges on motivation, activity, and performance in an online learning course , 2018, Comput. Educ..

[53]  A. Paivio,et al.  Dual coding theory and education , 1991 .

[54]  Raquel Benbunan-Fich,et al.  Using protocol analysis to evaluate the usability of a commercial web site , 2001, Inf. Manag..

[55]  Mark R. Lepper,et al.  Effects of fantasy contexts on children's learning and motivation: making learning more fun. , 1992 .

[56]  M. Lepper,et al.  Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. , 1996 .

[57]  John D. Murphy,et al.  Avatars, People, and Virtual Worlds: Foundations for Research in Metaverses , 2009, J. Assoc. Inf. Syst..

[58]  Donald E. Broadbent,et al.  Effect of Noise on an "Intellectual" Task , 1958 .

[59]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[60]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[61]  Amon Rapp,et al.  From Games to Gamification: A Classification of Rewards in World of Warcraft for the Design of Gamified Systems , 2017 .

[62]  Eva García,et al.  On the effectiveness of game-like and social approaches in learning: Comparing educational gaming, gamification & social networking , 2016, Comput. Educ..