Gamification Science, Its History and Future: Definitions and a Research Agenda

Background. Definitions of gamification tend to vary by person, both in industry and within academia. One particularly popular lay interpretation, introduced and popularized by Ian Bogost, and reiterated by Jan Klabbers, is that gamification is “bullshit” and “exploitationware.” They describe gamification as a marketing term or business practice invented to sell products rather than to represent a real and unique phenomenon relevant to a nascent game science. However, this view is an oversimplification, one which ignores a growing body of theory development and empirical research on gamification within a post-positivist epistemology. In fact, because gamification is so much more outcome-focused than general game design, current gamification research in many ways has a stronger footing in modern social science than much games research does. Aim. In this article, to address common misunderstandings like these, we describe the philosophical underpinnings of modern gamification research, define the relationship between games and gamification, define and situate gamification science as a subdiscipline of game science, and explicate a six-element framework of major concerns within gamification science: predictor constructs, criterion constructs, mediator constructs, moderator constructs, design processes, and research methods. This framework is also presented diagrammatically as a causal path model. Conclusion. Gamification science refers to the development of theories of gamification design and their empirical evaluation within a post-positivist epistemology. The goal of gamification scientist-practitioners should be to understand how to best meet organizational goals through the design of gamification interventions, drawing upon insights derived from both gamification science and games research more broadly.

[1]  Carole L Kimberlin,et al.  Validity and reliability of measurement instruments used in research. , 2008, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[2]  Keith Conley,et al.  Gamification: The Measurement of Benefits , 2015 .

[3]  David R. Flatla,et al.  Calibration games: making calibration tasks enjoyable by adding motivating game elements , 2011, UIST.

[4]  Jan H. G. Klabbers,et al.  On the Architecture of Game Science , 2018 .

[5]  Mary Flanagan,et al.  Exploring the Creative Potential of Values Conscious Design: Students' Experiences with the Values at Play Curriculum , 2010 .

[6]  Heinz Mandl,et al.  How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction , 2017, Comput. Hum. Behav..

[7]  Derek Chapman,et al.  Gamifying the employee recruitment process , 2013, Gamification.

[8]  John L. Sherry,et al.  Orientations to Video Games Among Gender and Age Groups , 2010 .

[9]  Heidi P. K. Enwald,et al.  Effect of tailored, gamified, mobile physical activity intervention on life satisfaction and self-rated health in young adolescent men: A population-based, randomized controlled trial (MOPO study) , 2017, Comput. Hum. Behav..

[10]  Neal M. Ashkanasy,et al.  Organizational culture and climate , 2002 .

[11]  Kristopher J Preacher,et al.  Please Scroll down for Article Multivariate Behavioral Research Quantifying and Testing Indirect Effects in Simple Mediation Models When the Constituent Paths Are Nonlinear , 2022 .

[12]  David T. Goomas,et al.  Business Activity Monitoring: Real-Time Group Goals and Feedback Using an Overhead Scoreboard in a Distribution Center , 2011 .

[13]  Tracy Fullerton,et al.  Game Design Workshop: A Playcentric Approach to Creating Innovative Games, Third Edition , 2014 .

[14]  Richard N. Landers,et al.  Enhancing instructional outcomes with gamification: An empirical test of the Technology-Enhanced Training Effectiveness Model , 2017, Comput. Hum. Behav..

[15]  Paul A. Cairns,et al.  Assessing the Core Elements of the Gaming Experience , 2015, Game User Experience Evaluation.

[16]  Juho Hamari,et al.  Do badges increase user activity? A field experiment on the effects of gamification , 2017, Comput. Hum. Behav..

[17]  R. Landers,et al.  An Evaluation of Gamified Training: Using Narrative to Improve Reactions and Learning , 2017 .

[18]  Amanda J. Fairchild,et al.  Evaluating mediation and moderation effects in school psychology: a presentation of methods and review of current practice. , 2010, Journal of school psychology.

[19]  Paul A. Cairns,et al.  Assessing the Core Elements of the Gaming Experience , 2010, Evaluating User Experience in Games.

[20]  David R. Millen,et al.  Removing gamification from an enterprise SNS , 2012, CSCW.

[21]  Julia Eichmann,et al.  Challenges For Game Designers , 2016 .

[22]  Sarah-Kristin Thiel,et al.  "I'm too old for this!": influence of age on perception of gamified public participation , 2016, MUM.

[23]  Staffan Björk,et al.  Patterns In Game Design , 2004 .

[24]  Regina Bernhaupt,et al.  Introduction to this Special Issue on HCI and Games , 2015, Hum. Comput. Interact..

[25]  T. L. Taylor,et al.  The Assemblage of Play , 2009, Games Cult..

[26]  Alexandru Iosup,et al.  Procedural content generation for games: A survey , 2013, TOMCCAP.

[27]  D. Whetten What Constitutes a Theoretical Contribution , 1989 .

[28]  P. Thorndyke Cognitive structures in comprehension and memory of narrative discourse , 1977, Cognitive Psychology.

[29]  R. Dodhia A Review of Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (3rd ed.) , 2005 .

[30]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[31]  C. Ferguson The Good, The Bad and the Ugly: A Meta-analytic Review of Positive and Negative Effects of Violent Video Games , 2007, Psychiatric Quarterly.

[32]  Ethan Mollick,et al.  Mandatory Fun: Consent, Gamification and the Impact of Games at Work , 2014 .

[33]  Julian Togelius,et al.  Towards Automatic Personalized Content Generation for Platform Games , 2010, AIIDE.

[34]  F. H. Kanfer The scientist-practitioner connection : a bridge in need of constant attention , 1990 .

[35]  Scott E. Caplan,et al.  Looking for Gender: Gender Roles and Behaviors Among Online Gamers , 2009 .

[36]  Kara L. Orvis,et al.  Relationships Between Game Attributes and Learning Outcomes , 2009 .

[37]  M. Korman National conference on levels and patterns of professional training in psychology: The major themes. , 1974 .

[38]  T. Guin,et al.  Myths and Realities of Respondent Engagement in Online Surveys , 2012 .

[39]  Deborah I. Fels,et al.  Gamification in theory and action: A survey , 2015, Int. J. Hum. Comput. Stud..

[40]  Susanne Robra-Bissantz,et al.  Gamification of online idea competitions: insights from an explorative case , 2011, GI-Jahrestagung.

[41]  Jan H. G. Klabbers,et al.  The magic circle : principles of gaming & simulation , 2006 .

[42]  Padmini Srinivasan,et al.  Quality through flow and immersion: gamifying crowdsourced relevance assessments , 2012, SIGIR '12.

[43]  Robert Zubek,et al.  MDA : A Formal Approach to Game Design and Game Research , 2004 .

[44]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[45]  Rachel C. Callan,et al.  Training Evaluation in Virtual Worlds: Development of a Model , 2012 .

[46]  Alexandre N. Tuch,et al.  Towards understanding the effects of individual gamification elements on intrinsic motivation and performance , 2017, Comput. Hum. Behav..

[47]  N LandersRichard,et al.  An Empirical Test of the Theory of Gamified Learning , 2014 .

[48]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[49]  Christopher Cheong,et al.  Quick Quiz: A Gamified Approach for Enhancing Learning , 2013, PACIS.

[50]  Roger Tourangeau,et al.  Should I Stay or Should I go: The Effects of Progress Feedback, Promised Task Duration, and Length of Questionnaire on Completing Web Surveys , 2011 .

[51]  Eduardo Salas,et al.  Toward a Taxonomy Linking Game Attributes to Learning , 2012 .

[52]  Francisco Rebelo,et al.  A Review of Gamification for Health-Related Contexts , 2014, HCI.

[53]  Joseph Jay Williams,et al.  A Playful Game Changer: Fostering Student Retention in Online Education with Social Gamification , 2015, L@S.

[54]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[55]  Mary Flanagan,et al.  Exploring the Creative Potential of Values Conscious Game Design: Students’ Experiences with the VAP Curriculum , 2010, Eludamos: Journal for Computer Game Culture.

[56]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[57]  Radhika Santhanam,et al.  Gamified Technology-Mediated Learning: the Role of Individual differences , 2016, PACIS.

[58]  Richard N. Landers,et al.  An Inconvenient Truth: Arbitrary Distinctions Between Organizational, Mechanical Turk, and Other Convenience Samples , 2015, Industrial and Organizational Psychology.

[59]  Cécile Paris,et al.  Gamification for Online Communities: A Case Study for Delivering Government Services , 2014, Int. J. Cooperative Inf. Syst..

[60]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[61]  Juho Hamari,et al.  Demographic differences in perceived benefits from gamification , 2014, Comput. Hum. Behav..

[62]  Robert-Jan Sips,et al.  Work and Play: An Experiment in Enterprise Gamification , 2016, CSCW.

[63]  Paul Denny,et al.  The effect of virtual achievements on student engagement , 2013, CHI.

[64]  Richard N. Landers,et al.  Correcting Misconceptions About Gamification of Assessment: More Than SJTs and Badges , 2016, Industrial and Organizational Psychology.

[65]  K. Popper,et al.  Conjectures and refutations;: The growth of scientific knowledge , 1972 .

[66]  N LandersRichard Developing a Theory of Gamified Learning , 2014 .

[67]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[68]  Soledad Ballesteros,et al.  Video game training enhances cognition of older adults: a meta-analytic study. , 2014, Psychology and aging.

[69]  Katherine Isbister,et al.  Heuristic Evaluation of Games , 2008 .

[70]  Sebastian Deterding,et al.  The Lens of Intrinsic Skill Atoms: A Method for Gameful Design , 2015, Hum. Comput. Interact..

[71]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[72]  João Porto de Albuquerque,et al.  A Gamification-based Social Collaborative Architecture to increase resilience against natural disasters , 2014, SBSI.