Success factors for serious games to enhance learning: a systematic review

There is no doubt that an abundance of factors exists that makes learning with serious games successful. Research articles reporting on these factors, however, tend to focus on select serious game elements and do not combine all salient factors for successful learning with serious games. Addressing this gap is a necessity for the success of serious games and may even alleviate long-standing debates about pedagogy over enjoyment, how much realism is enough or whether artificial intelligence is worth the cost. This article examines existing academic literature from 2000 to 2015, extracting shared serious game success factors that have had an encouraging impact on gameful learning experiences. As such, we subsequently aim to withdraw the field from a perpetual spiral of does-my-game-work research toward more worthwhile why-does-my-game-not-work research. Qualitative content analysis through the constant comparison method (CCM) analyzed a total of 63 articles from a variety of recognized electronic libraries and databases. Through this analysis, we reveal five central serious game themes: backstory and production; realism; artificial intelligence and adaptivity; interaction; and feedback and debriefing, all of which require deliberate intertwining with pedagogical content to ensure successful learning. This review unravels each of the five themes into their constituent factors and consequently presents the factors as practical guidelines that serious games producers should strive to include in their game productions. Applying these recommendations whenever serious games are considered will provide a foundation for effective gameful learning experiences.

[1]  N. Newton,et al.  A systematic review of computerised serious educational games about alcohol and other drugs for adolescents. , 2014, Drug and alcohol review.

[2]  Yvonne Steinert,et al.  Online learning for faculty development: A review of the literature , 2013, Medical teacher.

[3]  Alessandro De Gloria,et al.  Enhancing the educational value of video games , 2009, CIE.

[4]  James Minogue,et al.  Safe science classrooms: Teacher training through serious educational games , 2014, Inf. Sci..

[5]  Cyril Brom,et al.  Implementing digital game-based learning in schools: augmented learning environment of ‘Europe 2045’ , 2010, Multimedia Systems.

[6]  Wilfried Admiraal,et al.  Gender-inclusive game-based learning in secondary education , 2014 .

[7]  Traci Sitzmann A META-ANALYTIC EXAMINATION OF THE INSTRUCTIONAL EFFECTIVENESS OF COMPUTER-BASED SIMULATION GAMES , 2011 .

[8]  Jason H. Szostek,et al.  Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis , 2013, Medical teacher.

[9]  Iván Martínez-Ortiz,et al.  Integration and Deployment of Educational Games in e-Learning Environments: The Learning Object Model Meets Educational Gaming , 2009, J. Educ. Technol. Soc..

[10]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[11]  Carl Machover,et al.  Virtual reality , 1994, IEEE Computer Graphics and Applications.

[12]  Michele D. Dickey Murder on Grimm Isle: The impact of game narrative design in an educational game‐based learning environment , 2011 .

[13]  Christian Sebastian Loh,et al.  Audial engagement: Effects of game sound on learner engagement in digital game-based learning environments , 2015, Comput. Hum. Behav..

[14]  T. Baranowski,et al.  Video game play, child diet, and physical activity behavior change a randomized clinical trial. , 2011, American journal of preventive medicine.

[15]  Luca Chittaro,et al.  Evaluation of a 3D serious game for advanced life support retraining , 2013, Int. J. Medical Informatics.

[16]  William L. Romine,et al.  Learning Biology Through Innovative Curricula: A Comparison of Game- and Nongame-Based Approaches , 2015 .

[17]  Kurt Squire,et al.  Video Game–Based Learning: An Emerging Paradigm for Instruction , 2008 .

[18]  Roland Klemke,et al.  Putting yourself in someone else's shoes: The impact of a location-based, collaborative role-playing game on behaviour , 2015, Comput. Educ..

[19]  Geoff Norman,et al.  The minimal relationship between simulation fidelity and transfer of learning , 2012, Medical education.

[20]  Patrick McAndrew,et al.  The Gaming Involvement and Informal Learning Framework , 2014 .

[21]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[22]  Kristian Kiili,et al.  Exerbraining for Schools: Combining Body and Brain Training , 2012, VS-GAMES.

[23]  Jon-Chao Hong,et al.  Comparing animated and static modes in educational gameplay on user interest, performance and gameplay anxiety , 2015, Comput. Educ..

[24]  J. Gee Good video games and good learning , 2007 .

[25]  Mario Soflano,et al.  An application of adaptive games-based learning based on learning style to teach SQL , 2015, Comput. Educ..

[26]  Marina Papastergiou,et al.  Exploring the potential of computer and video games for health and physical education: A literature review , 2009, Comput. Educ..

[27]  Hans W. Giessen,et al.  Serious Games Effects: An Overview☆ , 2015 .

[28]  A. H. van der Hulst,et al.  Hoe realistisch moet een serious game zijn? Op zoek naar de optimale fidelity , 2012 .

[29]  HwangGwo-Jen,et al.  A concept map-embedded educational computer game for improving students' learning performance in natural science courses , 2013 .

[30]  ChengMeng-Tzu,et al.  Learning through playing Virtual Age , 2015 .

[31]  Kingkarn Sookhanaphibarn,et al.  Serious Game for Fire Safety Evacuation Plan , 2014 .

[32]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[33]  Sasha A. Barab,et al.  Game-based curriculum and transformational play: Designing to meaningfully positioning person, content, and context , 2012, Comput. Educ..

[34]  Leonard A. Annetta,et al.  Students’ learning outcomes and learning experiences through playing a Serious Educational Game , 2012 .

[35]  Maria Kordaki,et al.  Design and evaluation of a computer game for the learning of Information and Communication Technologies (ICT) concepts by physical education and sport science students , 2011, Education and Information Technologies.

[36]  Lilit Gulyan,et al.  The real estate market of Norway: a Threat of a Bubble , 2016 .

[37]  Luca Chittaro,et al.  Assessing Knowledge Retention of an Immersive Serious Game vs. a Traditional Education Method in Aviation Safety , 2015, IEEE Transactions on Visualization and Computer Graphics.

[38]  Thomas Hainey,et al.  Games and Simulations in Online Learning: Research and Development Frameworks, D. Gibson, C. Aldrich, M. Prensky (Eds.). Information Science Publishing (2007), ISBN: 1-59904304-1 , 2007, Int. J. Inf. Manag..

[39]  Deborah I Thompson,et al.  Serious Video Games for Health: How Behavioral Science Guided the Development of a Serious Video Game , 2010, Simulation & gaming.

[40]  Clark C. Abt,et al.  Serious games , 2016, Springer International Publishing.

[41]  David Gibson,et al.  Games And Simulations in Online Learning: Research and Development Frameworks , 2006 .

[42]  Cyril Brom,et al.  Are educational computer micro-games engaging and effective for knowledge acquisition at high-schools? A quasi-experimental study , 2011, Comput. Educ..

[43]  Muhammad Al-Qurishi,et al.  Evaluating the impact of a cloud-based serious game on obese people , 2014, Comput. Hum. Behav..

[44]  James Minogue,et al.  Investigating the impact of video games on high school students' engagement and learning about genetics , 2009, Comput. Educ..

[45]  James Paul Gee Games for Learning , 2013 .

[46]  Gwo-Jen Hwang,et al.  A knowledge engineering approach to developing educational computer games for improving students' differentiating knowledge , 2013, Br. J. Educ. Technol..

[47]  K. Osterman,et al.  Using Constructivism and Reflective Practice To Bridge the Theory/Practice Gap. , 1998 .

[48]  Roland Klemke,et al.  The impact of coupled games on the learning experience of learners at-risk: An empirical study , 2014, Pervasive Mob. Comput..

[49]  Fengfeng Ke,et al.  A case study of computer gaming for math: Engaged learning from gameplay? , 2008, Comput. Educ..

[50]  Hugh M. Cannon,et al.  Constructs of Simulation Evaluation , 2002 .

[51]  H. Boeije A Purposeful Approach to the Constant Comparative Method in the Analysis of Qualitative Interviews , 2002 .

[52]  Deborah I Thompson,et al.  A meta-analysis of serious digital games for healthy lifestyle promotion. , 2014, Preventive medicine.

[53]  Wong Seng Yue,et al.  Design and evaluation of history Digital Game Based Learning (DGBL) software , 2013 .

[54]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[55]  Mario Soflano,et al.  Learning style analysis in adaptive GBL application to teach SQL , 2015, Comput. Educ..

[56]  G H Hines The role of psychology. , 1973, The New Zealand nursing journal. Kai tiaki.

[57]  Carina González-González,et al.  Designing social videogames for educational uses , 2012, Comput. Educ..

[58]  Richard N. Van Eck The effect of contextual pedagogical advisement and competition on middle-school students’ attitude toward mathematics using a computer-based simulation game , 2006 .

[59]  Jon-Chao Hong,et al.  A comparative study of the learning effectiveness of a blended and embodied interactive video game for kindergarten students , 2013, Interact. Learn. Environ..

[60]  Hsiao-Ching She,et al.  Learning through playing Virtual Age: Exploring the interactions among student concept learning, gaming performance, in-game behaviors, and the use of in-game characters , 2015, Comput. Educ..

[61]  Cornelia Amon Learning through playing , 2012 .

[62]  Panagiotis Petridis,et al.  Learning cultural heritage by serious games , 2014 .

[63]  Nicola Whitton Encouraging Engagement in Game-Based Learning , 2011, Int. J. Game Based Learn..

[64]  O. Celik,et al.  Systematic review of Kinect applications in elderly care and stroke rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[65]  David R. Michael,et al.  Serious Games: Games That Educate, Train, and Inform , 2005 .

[66]  Gwo-Jen Hwang,et al.  A contextual game-based learning approach to improving students' inquiry-based learning performance in social studies courses , 2015, Comput. Educ..

[67]  Simon Cooper,et al.  Educational gaming in the health sciences: systematic review. , 2009, Journal of advanced nursing.

[68]  Luca Chittaro,et al.  Serious games for emergency preparedness: Evaluation of an interactive vs. a non-interactive simulation of a terror attack , 2015, Comput. Hum. Behav..

[69]  Rob Nadolski,et al.  Serious games for higher education: a framework for reducing design complexity , 2008, J. Comput. Assist. Learn..

[70]  M. Csíkszentmihályi Flow: The Psychology of Optimal Experience , 1990 .

[71]  John L. Sherry,et al.  The challenge of audience reception: a developmental model for educational game engagement. , 2013, New directions for child and adolescent development.

[72]  M. McHugh Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[73]  Dietrich Albert,et al.  Micro-adaptivity: protecting immersion in didactically adaptive digital educational games , 2010, J. Comput. Assist. Learn..

[74]  Anne Deane Berman Interview with Anne and Steve Berman (UCSB and UCLA) , 2009, CIE.

[75]  Elie A Akl,et al.  Educational games for health professionals. , 2013, The Cochrane database of systematic reviews.

[76]  Ashley Davis Why so serious , 2014 .

[77]  Petar Spalević,et al.  Pedagogical agent in Multimedia Interactive Modules for Learning - MIMLE , 2012, Expert Syst. Appl..

[78]  Josef Wiemeyer Serious Games - the Challenges for Computer Science in Sport , 2010, Int. J. Comput. Sci. Sport.

[79]  Hyungsup Yoon A study on an Analysis of Success Factors of a Serious Game: In Case of "Anti-Aging Village" , 2014, MUE 2014.

[80]  Maurice Hendrix,et al.  The development approach of a pedagogically-driven serious game to support Relationship and Sex Education (RSE) within a classroom setting , 2013, Comput. Educ..

[81]  Fengfeng Ke,et al.  Games for engaged learning of middle school children with special learning needs , 2013, Br. J. Educ. Technol..

[82]  Wim Westera,et al.  A quest for meta-learning gains in a physics serious game , 2014, Education and Information Technologies.

[83]  Mark McMahon,et al.  Enhancing nutritional learning outcomes within a simulation and pervasive game-based strategy , 2011 .

[84]  Thomas M. Connolly,et al.  The role of psychology in understanding the impact of computer games , 2011, Entertain. Comput..

[85]  P. Wouters,et al.  A meta-analysis of the cognitive and motivational effects of serious games , 2013 .

[86]  C. Adams,et al.  Educational games for mental health professionals: a Cochrane review. , 2007, The international journal of psychiatric nursing research.

[87]  D. Jonassen Thinking Technology: Toward a Constructivist Design Model , 1994 .

[88]  Michael Zyda,et al.  From visual simulation to virtual reality to games , 2005, Computer.

[89]  Georgia Groztidou,et al.  Digital Game-Based Learning in High School , 2018 .

[90]  Mark Stansfield,et al.  An alternate reality game for language learning: ARGuing for multilingual motivation , 2011, Comput. Educ..

[91]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[92]  Dusan Starcevic,et al.  Modelling Knowledge and Game Based Learning: Model Driven Approach , 2011, J. Univers. Comput. Sci..

[93]  Pearl Brereton,et al.  Protocol for a Tertiary study of Systematic Literature Reviews and Evidence-based Guidelines in IT and Software Engineering , 2009 .

[94]  Nicola Whitton,et al.  Games for Learning , 2013 .

[95]  Tarja Susi,et al.  Serious Games : An Overview , 2007 .

[96]  D. Gentner,et al.  Reasoning and learning by analogy. , 1997, The American psychologist.

[97]  J. U. Hense,et al.  Theory-oriented evaluation for the design of and research in gaming and simulation , 2006 .

[98]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[99]  Chin-Chung Tsai,et al.  Development of a personalized educational computer game based on students’ learning styles , 2012, Educational Technology Research and Development.

[100]  Richard N. Van Eck Digital Game-Based Learning: It's Not Just the Digital Natives Who Are Restless. , 2006 .

[101]  Wilfried Admiraal,et al.  Mobile game-based learning in secondary education: engagement, motivation and learning in a mobile city game , 2009, J. Comput. Assist. Learn..

[102]  Ian Dunwell,et al.  An Engine Selection Methodology for High Fidelity Serious Games , 2010, 2010 Second International Conference on Games and Virtual Worlds for Serious Applications.

[103]  Eduardo Salas,et al.  Toward a Taxonomy Linking Game Attributes to Learning , 2012 .

[104]  Dr.Moh Muzaki.M.Si MODEL KOMUNIKASI POLITIK HOMOHETEROFILI DALAM PROYEK SUMBER AIR UMBULAN , 2017 .

[105]  Mary Jo Dondlinger,et al.  Educational Video Game Design: A Review of the Literature , 2007 .

[106]  César A. Collazos,et al.  Design and analysis of collaborative interactions in social educational videogames , 2014, Comput. Hum. Behav..

[107]  David Crookall,et al.  Engaging (in) Gameplay and (in) Debriefing , 2014 .

[108]  Simon Niedenthal,et al.  What We Talk About When We Talk About Game Aesthetics , 2009, DiGRA Conference.

[109]  Gwo-Jen Hwang,et al.  A concept map-embedded educational computer game for improving students' learning performance in natural science courses , 2013, Comput. Educ..

[110]  K. Kiili Content creation challenges and flow experience in educational games: The IT-Emperor case , 2005, Internet High. Educ..

[111]  Cheryl I. Johnson,et al.  Applying the self-explanation principle to multimedia learning in a computer-based game-like environment , 2010, Comput. Hum. Behav..

[112]  I. Kickbusch,et al.  Introduction to the journal , 1986 .

[113]  Spencer Benson,et al.  Learning with Invisible Others: Perceptions of Online Presence and their Relationship to Cognitive and Affective Learning , 2005, J. Educ. Technol. Soc..

[114]  Maria Virvou,et al.  On the usability and likeability of virtual reality games for education: The case of VR-ENGAGE , 2008, Comput. Educ..

[115]  KreijnsKarel,et al.  Putting yourself in someone else's shoes , 2015 .

[116]  Robert Zubek,et al.  MDA : A Formal Approach to Game Design and Game Research , 2004 .

[117]  James F. Knight,et al.  Serious gaming technology in major incident triage training: a pragmatic controlled trial. , 2010, Resuscitation.

[118]  Baltasar Fernández-Manjón,et al.  Application of Learning Analytics in educational videogames , 2014, Entertain. Comput..

[119]  Diane Jass Ketelhut,et al.  Introduction for the Journal of Information Sciences special issue on serious games , 2014, Inf. Sci..

[120]  Geert Vissers,et al.  A Simple Classification Model for Debriefing Simulation Games , 2004 .

[121]  Miguel Nussbaum,et al.  A framework for the design and integration of collaborative classroom games , 2011, Comput. Educ..

[122]  Gary Bente,et al.  Why so serious? On the relation of serious games and learning , 2010, Eludamos: Journal for Computer Game Culture.

[123]  J. Mayo USING ANALOGIES TO TEACH CONCEPTUAL APPLICATIONS OF DEVELOPMENTAL THEORIES , 2001 .

[124]  Leonard A. Annetta,et al.  Bridging Realty to Virtual Reality: Investigating gender effect and student engagement on learning through video game play in an elementary school classroom , 2009 .

[125]  D. Gentner,et al.  Reasoning and learning by analogy. , 1997, The American psychologist.

[126]  Sylke Vandercruysse,et al.  Game-Based Learning: A Review on the Effectiveness of Educational Games , 2012 .

[127]  M. McDaniel,et al.  Use of analogy in learning scientific concepts. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[128]  Chi-Chang Chen,et al.  An online game approach for improving students' learning performance in web-based problem-solving activities , 2012, Comput. Educ..

[129]  Maria Virvou,et al.  Combining Software Games with Education: Evaluation of its Educational Effectiveness , 2005, J. Educ. Technol. Soc..

[130]  Raija Hämäläinen,et al.  Using a game environment to foster collaborative learning: a design‐based study , 2011 .

[131]  Brendan R. Watson,et al.  Analyzing Media Messages , 2023 .

[132]  Yu-Ju Chen,et al.  Using the saliency-based model to design a digital archaeological game to motivate players' intention to visit the digital archives of Taiwan's natural science museum , 2013, Comput. Educ..

[133]  Alessandro De Gloria,et al.  A serious game model for cultural heritage , 2012, JOCCH.

[134]  Harri Ketamo,et al.  Conceptual Change Takes Time: Game Based Learning Cannot be Only Supplementary Amusement , 2010 .

[135]  Raija Hämäläinen,et al.  Designing and evaluating collaboration in a virtual game environment for vocational learning , 2008, Comput. Educ..

[136]  Barbara L. Grabowski,et al.  Gameplaying for maths learning: cooperative or not? , 2007, Br. J. Educ. Technol..

[137]  Meng-Tzu Cheng,et al.  An educational game for learning human immunology: What do students learn and how do they perceive? , 2014, Br. J. Educ. Technol..

[138]  Roland Klemke,et al.  Attuning a mobile simulation game for school children using a design-based research approach , 2015, Comput. Educ..

[139]  John-Jules Ch. Meyer,et al.  Introducing surprising events can stimulate deep learning in a serious game , 2013, Br. J. Educ. Technol..

[140]  Cynthia Barounis,et al.  “Why so serious?”: Cripping Camp Performance in Christopher Nolan’s The Dark Knight , 2013 .

[141]  Baltasar Fernández-Manjón,et al.  Towards a low cost adaptation of educational games for people with disabilities , 2014, Comput. Sci. Inf. Syst..

[142]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.