Gamification and serious games: A literature meta-analysis and integrative model

Abstract In recent years we have witnessed a growing number of companies and institutions embedding game mechanics and game design techniques in all types of information systems, applications, and services. Following this trend, it is possible to find an increasing number of publications studying these subjects. With this meta-analysis we synthesise and integrate all the earlier literature and information available on gamification and serious games, assessing the current state-of-the-art in the field, filling a literature gap on this subject. We calculated meta-analysis effects from a total of 54 studies and 59 datasets collected from the literature. Attitude, enjoyment, and usefulness are the most relevant predictors of intention to use gamification. Intention, enjoyment, and usefulness are the most relevant predictors of the brand attitude towards gamification. Our results allow us to present a theoretical model that will be of value to future gamification studies.

[1]  Scott Nicholson.  A User-Centered Theoretical Framework for Meaningful Gamification , 2012 .

[2]  Alexander Maedche,et al.  How games induce cooperation? A study on the relationship between game features and we-intentions in an augmented reality game , 2017, Comput. Hum. Behav..

[3]  Joseph Macey,et al.  Investigating relationships between video gaming, spectating esports, and gambling , 2018, Comput. Hum. Behav..

[4]  Gilad Ravid,et al.  Gender Moderation in Gamification: Does One Size Fit All? , 2017, HICSS.

[5]  Tomasz Oleksy,et al.  Catch them all and increase your place attachment! The role of location-based augmented reality games in changing people - place relations , 2017, Comput. Hum. Behav..

[6]  I. Ajzen.  The theory of planned behavior , 1991 .

[7]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[8]  Fred D. Davis,et al.  Extrinsic and Intrinsic Motivation to Use Computers in the Workplace1 , 1992 .

[9]  Luís Filipe Rodrigues,et al.  Playing seriously - How gamification and social cues influence bank customers to use gamified e-business applications , 2016, Comput. Hum. Behav..

[10]  Alexandre N. Tuch,et al.  Towards understanding the effects of individual gamification elements on intrinsic motivation and performance , 2017, Comput. Hum. Behav..

[11]  Luís Filipe Rodrigues,et al.  Does ease-of-use contributes to the perception of enjoyment? A case of gamification in e-banking , 2016, Comput. Hum. Behav..

[12]  Joana Dias,et al.  Teaching operations research to undergraduate management students: The role of gamification , 2017 .

[13]  Tibert Verhagen,et al.  Health empowerment through activity trackers: An empirical smart wristband study , 2016, Comput. Hum. Behav..

[14]  Konstantinos Chorianopoulos,et al.  Citizen science for pedestrian cartography: collection and moderation of walkable routes in cities through mobile gamification , 2017, Human-centric Computing and Information Sciences.

[15]  Dirk Schneckenberg,et al.  The Ludic Drive as Innovation Driver: Introduction to the Gamification of Innovation , 2015 .

[16]  Juho Hamari,et al.  "Working out for likes": An empirical study on social influence in exercise gamification , 2015, Comput. Hum. Behav..

[17]  Alan R. Dennis,et al.  Understanding Fit and Appropriation Effects in Group Support Systems via Meta-Analysis , 2001, MIS Q..

[18]  Jodi Asbell-Clarke,et al.  Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning , 2016, Comput. Hum. Behav..

[19]  Mikko Rajanen,et al.  Usability benefits in gamification , 2017, GamiFIN.

[20]  Rafael Ramírez,et al.  Air violin: a machine learning approach to fingering gesture recognition , 2017, MIE@ICMI.

[21]  Juho Hamari,et al.  Demographic differences in perceived benefits from gamification , 2014, Comput. Hum. Behav..

[22]  Paola Salomoni,et al.  From gamification to pervasive game in mapping urban accessibility , 2015, CHItaly.

[23]  Shervin Shirmohammadi,et al.  Effects of serious games on perceived team cohesiveness in a multi-user virtual environment , 2016, Comput. Hum. Behav..

[24]  Charlotte L. Beard,et al.  Gaming-contingent self-worth, gaming motivation, and Internet Gaming Disorder , 2016, Comput. Hum. Behav..

[25]  Juho Hamari,et al.  International Journal of Information Management Why Do People Use Gamification Services? , 2022 .

[26]  Rory Mulcahy,et al.  Designing gamified transformative and social marketing services: An investigation of serious m-games , 2018 .

[27]  Cleo Pappas,et al.  Grey Literature: Its Emerging Importance , 2011 .

[28]  Pedro F. Hernández-Ramos,et al.  How do presence, flow, and character identification affect players' empathy and interest in learning from a serious computer game? , 2016, Comput. Hum. Behav..

[29]  Barbara Lockee,et al.  Students’ Perception of Gamification in Learning and Education , 2018 .

[30]  Alexander Schill,et al.  Workplace Psychology and Gamification: Theory and Application , 2015 .

[31]  Jian Tang,et al.  Points, stories, worlds, and diegesis: Comparing player experiences in two citizen science games , 2015, Comput. Hum. Behav..

[32]  Alexander Serenko,et al.  User acceptance of hedonic digital artifacts: A theory of consumption values perspective , 2010, Inf. Manag..

[33]  Albert L. Lederer,et al.  A Meta-Analysis of the Role of Environment-Based Voluntariness in Information Technology Acceptance , 2009, MIS Q..

[34]  Leonard A. Annetta,et al.  A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using serious educational games, serious games, and simulations , 2018, Comput. Hum. Behav..

[35]  Annapaola Marconi,et al.  Using gamification to incentivize sustainable urban mobility , 2015, 2015 IEEE First International Smart Cities Conference (ISC2).

[36]  Adarsh Kumar Kakar.  How do Perceived Enjoyment and Perceived Usefulness of a Software Product Interact over Time to Impact Technology Acceptance? , 2017, Interact. Comput..

[37]  Saerom Lee,et al.  Antecedents and consequences of perceived knowledge update in the context of an ERP simulation game: A multi-level perspective , 2016, Comput. Educ..

[38]  Dimitris Mavridis,et al.  How to interpret meta-analysis models: fixed effect and random effects meta-analyses , 2014, Evidence-Based Mental Health.

[39]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[40]  Han-Chao Chang,et al.  The effect of flow experience on player loyalty in mobile game application , 2016, Comput. Hum. Behav..

[41]  Rob Law,et al.  Be a “Superhost”: The importance of badge systems for peer-to-peer rental accommodations , 2017 .

[42]  Tiago Oliveira,et al.  A weight and a meta-analysis on mobile banking acceptance research , 2016, Comput. Hum. Behav..

[43]  Wen-Chi Vivian Wu,et al.  Technological acceptance of LINE in flipped EFL oral training , 2017, Comput. Hum. Behav..

[44]  Susanne Strahringer,et al.  Gamification of ERP Systems – Exploring Gamification Effects on User Acceptance Constructs , 2012, MKWI 2012.

[45]  Fred D. Davis,et al.  Disentangling behavioral intention and behavioral expectation , 1985 .

[46]  Martin Valcke,et al.  Acceptance of game-based learning by secondary school teachers , 2013, Comput. Educ..

[47]  Ken Kelley,et al.  Sample-Size Planning for More Accurate Statistical Power: A Method Adjusting Sample Effect Sizes for Publication Bias and Uncertainty , 2017, Psychological science.

[48]  Robin L. Wakefield,et al.  How website socialness leads to website use , 2011, Eur. J. Inf. Syst..

[49]  Dion Hoe-Lian Goh,et al.  Learning efficacy and user acceptance of a game-based social skills learning environment , 2016, Int. J. Child Comput. Interact..

[50]  Viswanath Venkatesh,et al.  Unified Theory of Acceptance and Use of Technology: A Synthesis and the Road Ahead , 2016, J. Assoc. Inf. Syst..

[51]  Hannah R Rothstein,et al.  A basic introduction to fixed‐effect and random‐effects models for meta‐analysis , 2010, Research synthesis methods.

[52]  Timothy Jung,et al.  An Ethical Perspective of the use of AR Technology in the Tourism Industry , 2018 .

[53]  Jason Bennett Thatcher,et al.  Looking Toward the Future of IT-Business Strategic Alignment through the Past: A Meta-Analysis , 2014, MIS Q..

[54]  Rainer Alt,et al.  Increasing Intranet Usage through Gamification -- Insights from an Experiment in the Banking Industry , 2015, 2015 48th Hawaii International Conference on System Sciences.

[55]  Matthew K. O. Lee,et al.  Understanding compulsive smartphone use: An empirical test of a flow-based model , 2017, Int. J. Inf. Manag..

[56]  José Martí-Parreño,et al.  Education Students’ Attitude towards the Use of Gamification for Competencies Development , 2017 .

[57]  John Andy Wood,et al.  Methodology for Dealing With Duplicate Study Effects in a Meta-Analysis , 2008 .

[58]  D. Teensma,et al.  Social motivations to use gamification: an empirical study of gamifying in relation to generational differences , 2016 .

[59]  Ghada R. El Said,et al.  Exploring the factors affecting MOOC retention: A survey study , 2016, Comput. Educ..

[60]  LiGuo Huang,et al.  A Software Gamification Model for Cross-Cultural Software Development Teams , 2017, ICMSS '17.

[61]  Youngkyun Baek,et al.  Exploring how individual traits influence enjoyment in a mobile learning game , 2017, Comput. Hum. Behav..

[62]  Jerry C. Olson,et al.  Are Product Attribute Beliefs the Only Mediator of Advertising Effects on Brand Attitude? , 1981 .

[63]  Viswanath Venkatesh,et al.  Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology , 2012, MIS Q..

[64]  Juho Hamari,et al.  Why do people buy virtual goods: A meta-analysis , 2017, Comput. Hum. Behav..

[65]  Jing Zhu,et al.  A meta-analysis of mobile commerce adoption and the moderating effect of culture , 2012, Comput. Hum. Behav..

[66]  Yu-Ju Chen,et al.  Using the saliency-based model to design a digital archaeological game to motivate players' intention to visit the digital archives of Taiwan's natural science museum , 2013, Comput. Educ..

[67]  Juho Hamari,et al.  A definition for gamification: anchoring gamification in the service marketing literature , 2016, Electronic Markets.

[68]  Juho Hamari,et al.  How to design gamification? A method for engineering gamified software , 2017, Inf. Softw. Technol..

[69]  J. Bittner,et al.  Motivational effects and age differences of gamification in product advertising , 2014 .

[70]  Katia Passerini,et al.  Computer-supported team-based learning: The impact of motivation, enjoyment and team contributions on learning outcomes , 2010, Comput. Educ..

[71]  Isabel Buil,et al.  Do clickers enhance learning? A control-value theory approach , 2016, Comput. Educ..

[72]  Chetan S. Sankar,et al.  Using Serious Games in Data Communications and Networking Management Course , 2018, J. Comput. Inf. Syst..

[73]  Milena M. Head,et al.  Understanding the role of competition in video gameplay satisfaction , 2017, Inf. Manag..

[74]  Hongxiu Li,et al.  Understanding the effects of gratifications on the continuance intention to use WeChat in China: A perspective on uses and gratifications , 2018, Comput. Hum. Behav..

[75]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[76]  G. Ravid,et al.  Academic Course Gamification: The Art of Perceived Playfulness. , 2014 .

[77]  Anand Jeyaraj,et al.  A review of the predictors, linkages, and biases in IT innovation adoption research , 2006, J. Inf. Technol..

[78]  G. Geetha,et al.  CAPTCHINO - A Gamification of Image-Based CAPTCHAs to Evaluate Usability Issues , 2012, 2012 International Conference on Computing Sciences.

[79]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[80]  Thomas D. Cook,et al.  Meta-analysis: Its potential for causal description and causal explanation within program evaluation , 1991 .

[81]  Fevzi Okumus,et al.  International Journal of Hospitality Management , 2022 .

[82]  Patrick Buckley,et al.  Individualising gamification: An investigation of the impact of learning styles and personality traits on the efficacy of gamification using a prediction market , 2017, Comput. Educ..

[83]  Luís Filipe Rodrigues,et al.  How does the web game design influence the behavior of e-banking users? , 2017, Comput. Hum. Behav..

[84]  Luís Filipe Rodrigues,et al.  How gamification can influence the web design and the customer to use the e-banking systems , 2014, ISDOC.

[85]  Mustafa Güler,et al.  Gamifying an ICT course: Influences on engagement and academic performance , 2017, Comput. Hum. Behav..

[86]  Tiago Oliveira,et al.  Why so serious? Gamification impact in the acceptance of mobile banking services , 2017, Internet Res..

[87]  Yogesh Kumar Dwivedi,et al.  A meta-analysis of existing research on citizen adoption of e-government , 2013, Information Systems Frontiers.

[88]  Mathijs F. G. Lucassen,et al.  Serious Games and Gamification for Mental Health: Current Status and Promising Directions , 2017, Frontiers in psychiatry.

[89]  Ying Yu,et al.  Gamification artifacts and crowdsourcing participation: Examining the mediating role of intrinsic motivations , 2018, Comput. Hum. Behav..

[90]  Antonio García-Cabot,et al.  Social network analysis of a gamified e-learning course: Small-world phenomenon and network metrics as predictors of academic performance , 2016, Comput. Hum. Behav..

[91]  Byung Cho Kim,et al.  Voter Intention to Use E-Voting Technologies: Security, Technology Acceptance, Election Type, and Political Ideology , 2012 .

[92]  Kai-Yu Tang,et al.  On the post-acceptance of mobile movie-themed games , 2016, Electron. Commer. Res. Appl..

[93]  Radhika Santhanam,et al.  Toward Meaningful Engagement: A Framework for Design and Research of Gamified Information Systems , 2017, MIS Q..

[94]  Pascal Lessel,et al.  Expense Control: A Gamified, Semi-Automated, Crowd-Based Approach For Receipt Capturing , 2016, IUI.

[95]  Yen-Chun Chen,et al.  Do website features matter in an online gamification context? Focusing on the mediating roles of user experience and attitude , 2017, Telematics Informatics.

[96]  Joseph W. LaBrie,et al.  PNF 2.0? Initial evidence that gamification can increase the efficacy of brief, web-based personalized normative feedback alcohol interventions. , 2017, Addictive behaviors.

[97]  Charles Chowa,et al.  Information System Success: Individual and Organizational Determinants , 2006, Manag. Sci..

[98]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[99]  Yulin Fang,et al.  The effects of peer intrinsic and extrinsic motivation on MMOG game-based collaborative learning , 2012, Inf. Manag..

[100]  Tammy Schellens,et al.  Students' perceptions about the use of video games in the classroom , 2010, Comput. Educ..

[101]  Daniel Nunan,et al.  Gamification and the online retail experience , 2014 .

[102]  Paulo Henrique de Souza Bermejo,et al.  Open Innovation and Social Participation: A Case Study in Public Security in Brazil , 2015, EGOVIS.

[103]  Eva van de Sande,et al.  The role of executive control in young children's serious gaming behavior , 2015, Comput. Educ..

[104]  Kamel Rouibah,et al.  The Effects of Perceived Enjoyment and Perceived Risks on Trust Formation and Intentions to Use Online Payment Systems: New Perspectives from an Arab Country , 2016, Electron. Commer. Res. Appl..

[105]  Richard N. Landers,et al.  Gamification of task performance with leaderboards: A goal setting experiment , 2017, Comput. Hum. Behav..

[106]  Nancy J. Church,et al.  The Future of Marketing: Staying competitive in a competitive world , 2018 .

[107]  Chih-Chung Wang,et al.  Continued use of an interactive computer game-based visual perception learning system in children with developmental delay , 2017, Int. J. Medical Informatics.

[108]  William R. King,et al.  A meta-analysis of the technology acceptance model , 2006, Inf. Manag..

[109]  Juho Hamari,et al.  Why do people play games? A meta-analysis , 2017, Int. J. Inf. Manag..

[110]  John E. Hunter,et al.  Fixed Effects vs. Random Effects Meta‐Analysis Models: Implications for Cumulative Research Knowledge , 2000 .

[111]  Yogesh Kumar Dwivedi,et al.  Examining the impact of gamification on intention of engagement and brand attitude in the marketing context , 2017, Comput. Hum. Behav..