Digital Games, Design, and Learning

In this meta-analysis, we systematically reviewed research on digital games and learning for K–16 students. We synthesized comparisons of game versus nongame conditions (i.e., media comparisons) and comparisons of augmented games versus standard game designs (i.e., value-added comparisons). We used random-effects meta-regression models with robust variance estimates to summarize overall effects and explore potential moderator effects. Results from media comparisons indicated that digital games significantly enhanced student learning relative to nongame conditions ( g ¯ = 0.33, 95% confidence interval [0.19, 0.48], k = 57, n = 209). Results from value-added comparisons indicated significant learning benefits associated with augmented game designs ( g ¯ = 0.34, 95% confidence interval [0.17, 0.51], k = 20, n = 40). Moderator analyses demonstrated that effects varied across various game mechanics characteristics, visual and narrative characteristics, and research quality characteristics. Taken together, the results highlight the affordances of games for learning as well as the key role of design beyond medium.

[1]  M. Honey,et al.  Learning Science through Computer Games and Simulations. , 2011 .

[2]  Yasmin B. Kafai,et al.  Investigating the ‘‘Why’’ in Whypox , 2009, Games Cult..

[3]  Sandra Jo Wilson,et al.  The comparative effectiveness of outpatient treatment for adolescent substance abuse: a meta-analysis. , 2013, Journal of substance abuse treatment.

[4]  Hyungsung Park,et al.  Relationship between Motivation and Student's Activity on Educational Game , 2012 .

[5]  Kamran Sedig,et al.  Toward operationalization of 'flow' in mathematics learnware , 2007, Comput. Hum. Behav..

[6]  M. Borenstein.  Effect sizes for continuous data. , 2009 .

[7]  David W. Bustard,et al.  Experiences of Promoting Student Engagement Through Game-Enhanced Learning , 2011, Serious Games and Edutainment Applications.

[8]  S. Dehaene,et al.  Computer-Assisted Intervention for Children with Low Numeracy Skills , 2009 .

[9]  Maria Virvou,et al.  Combining Software Games with Education: Evaluation of its Educational Effectiveness , 2005, J. Educ. Technol. Soc..

[10]  Dirk Ifenthaler,et al.  Dynamic Modeling as a Cognitive Regulation Scaffold for Developing Complex Problem-Solving Skills in an Educational Massively Multiplayer Online Game Environment , 2011 .

[11]  Noah S. Podolefsky.  Learning science through computer games and simulations , 2012 .

[12]  Hua Wang,et al.  Multimodality and Interactivity: Connecting Properties of Serious Games with Educational Outcomes , 2009, Cyberpsychology Behav. Soc. Netw..

[13]  R. Clark.  Media will never influence learning , 1994 .

[14]  Brian C. Nelson,et al.  Digital games and the US National Research Council’s science proficiency goals , 2013 .

[15]  Douglas G. Altman,et al.  Special Topics in Statistics , 2008 .

[16]  A. Lu.  Video Games and Learning: Teaching and Participatory Culture in the Digital Age , 2013 .

[17]  L. Hedges.  Effect Sizes in Cluster-Randomized Designs , 2007 .

[18]  Alvin C. M. Kwan,et al.  Online vocabulary games as a tool for teaching and learning English vocabulary , 2006 .

[19]  M. Borenstein,et al.  Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments , 2006 .

[20]  Chee-Kit Looi,et al.  Utilizing a Collaborative Cross Number Puzzle Game to Develop the Computing Ability of Addition and Subtraction , 2012, J. Educ. Technol. Soc..

[21]  Leonard Fontana,et al.  Childhood Violence Prevention Education Using Video Games , 2004 .

[22]  Yasmin B. Kafai.  Learning Design by Making Games: Children's Development of Design Strategies in the Creation of a Complex Computational Artifact , 2012 .

[23]  M. P. Jacob Habgood,et al.  Motivating Children to Learn Effectively: Exploring the Value of Intrinsic Integration in Educational Games , 2011 .

[24]  Lee Sheldon,et al.  The Multiplayer Classroom: Designing Coursework as a Game , 2011 .

[25]  Fengfeng Ke,et al.  A Qualitative Meta-Analysis of Computer Games as Learning Tools , 2009 .

[26]  Lynae E. Sakshaug,et al.  The Role of Playing Games in Developing Algebraic Reasoning, Spatial Sense, and Problem-Solving , 2004 .

[27]  Keith K. Millis,et al.  Operation ARA: A computerized learning game that teaches critical thinking and scientific reasoning , 2012 .

[28]  Shana Smith,et al.  Using immersive game-based virtual reality to teach fire-safety skills to children , 2009, Virtual Reality.

[29]  Chung-Yuan Hsu,et al.  Facilitating Third Graders’ Acquisition of Scientific Concepts through Digital Game-Based Learning: The Effects of Self-Explanation Principles , 2012 .

[30]  Kazuhiko Kawamura,et al.  Tests of Concepts About Different Kinds of Minds: Predictions About the Behavior of Computers, Robots, and People , 2012, Hum. Comput. Interact..

[31]  Miguel Nussbaum,et al.  The atomic intrinsic integration approach: A structured methodology for the design of games for the conceptual understanding of physics , 2012, Comput. Educ..

[32]  Y. Kafai.  Playing and Making Games for Learning , 2006, Games Cult..

[33]  Eliane Segers,et al.  Long-term effects of computer training of phonological awareness in kindergarten , 2005, J. Comput. Assist. Learn..

[34]  D. Ketelhut.  The Impact of Student Self-efficacy on Scientific Inquiry Skills: An Exploratory Investigation in River City, a Multi-user Virtual Environment , 2007 .

[35]  Daniel L. Schwartz,et al.  The Emergence of Abstract Representations in Dyad Problem Solving , 1995 .

[36]  Larry V. Hedges,et al.  Intraclass Correlations for Planning Group Randomized Experiments in Rural Education , 2007 .

[37]  Michelle F. Wright,et al.  Computer Gaming and Interactive Simulations for Learning: A Meta-Analysis , 2006 .

[38]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[39]  J. Pratt,et al.  Playing an Action Video Game Reduces Gender Differences in Spatial Cognition , 2007, Psychological science.

[40]  D. Schunk,et al.  Risk Taking: Theoretical, Empirical, and Educational Considerations , 1991 .

[41]  Yao-Ting Sung,et al.  Designing multimedia games for young children's taxonomic concept development , 2008, Comput. Educ..

[42]  Richard E. Mayer,et al.  Multimedia learning and games. , 2011 .

[43]  J. Pellegrino,et al.  Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century , 2013 .

[44]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[45]  Traci Sitzmann.  A META-ANALYTIC EXAMINATION OF THE INSTRUCTIONAL EFFECTIVENESS OF COMPUTER-BASED SIMULATION GAMES , 2011 .

[46]  David J. Miller,et al.  Educational benefits of using game consoles in a primary classroom: A randomised controlled trial , 2011, Br. J. Educ. Technol..

[47]  Atsusi Hirumi,et al.  The effects of modern mathematics computer games on mathematics achievement and class motivation , 2010, Comput. Educ..

[48]  Kurt Squire,et al.  Augmented Reality Simulations on Handheld Computers , 2007 .

[49]  Jeffrey Mervis,et al.  Adding a T to the Three R's , 2009, Science.

[50]  Elizabeth Tipton,et al.  Robust variance estimation with dependent effect sizes: practical considerations including a software tutorial in Stata and spss , 2014, Research synthesis methods.

[51]  Robert L. Goldstone,et al.  Transformational Play as a Curricular Scaffold: Using Videogames to Support Science Education , 2009 .

[52]  Elizabeth Tipton,et al.  Robust variance estimation in meta‐regression with binary dependent effects , 2013, Research synthesis methods.

[53]  Junjie Shang,et al.  Learning Online: A Comparative Study of a Situated Game-Based Approach and a Traditional Web-Based Approach , 2006, Edutainment.

[54]  Krestina L. Amon,et al.  Can children with AD/HD learn relaxation and breathing techniques through biofeedback video games? , 2008 .

[55]  Cengiz Tüysüz.  Effect of the computer based game on pre-service teachers' achievement, attitudes, metacognition and motivation in chemistry , 2009 .

[56]  LeeAnn M. Sutherland,et al.  Effects of game technology on elementary student learning in mathematics , 2012, Br. J. Educ. Technol..

[57]  Ina Blau,et al.  Scaffolding game-based learning: Impact on learning achievements, perceived learning, and game experiences , 2014, Comput. Educ..

[58]  H. Pashler,et al.  Distributed practice in verbal recall tasks: A review and quantitative synthesis. , 2006, Psychological bulletin.

[59]  Wolfgang Viechtbauer,et al.  Publication bias in meta-analysis: Prevention, assessment and adjustments , 2007, Psychometrika.

[60]  Richard Van Eck,et al.  The effect of contextual pedagogical advisement and competition on middle-school students’ attitude toward mathematics using a computer-based simulation game , 2006 .

[61]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[62]  S. W. Kim,et al.  Effectiveness of MMORPG-based instruction in elementary English education in Korea , 2010, J. Comput. Assist. Learn..

[63]  Clint A. Bowers,et al.  Using Virtual Reality with and without Gaming Attributes for Academic Achievement , 2006 .

[64]  Joey J. Lee,et al.  Gamification in Education: What, How, Why Bother? , 2011 .

[65]  Ana van Meegen,et al.  How Serious Do We Need to Be? Improving Information Literacy Skills through Gaming and Interactive Elements , 2010 .

[66]  P. Wouters,et al.  A meta-analysis of the cognitive and motivational effects of serious games , 2013 .

[67]  Fengfeng Ke.  Computer games application within alternative classroom goal structures: cognitive, metacognitive, and affective evaluation , 2008 .

[68]  R. Moreno,et al.  Do Multiple Representations Need Explanations? The Role of Verbal Guidance and Individual Differences in Multimedia Mathematics Learning , 2004 .

[69]  KebritchiMansureh,et al.  The effects of modern mathematics computer games on mathematics achievement and class motivation , 2010 .

[70]  Mark W. Lipsey,et al.  Dropout Prevention and Intervention Programs: Effects on School Completion and Dropout Among School-Aged Children and Youth: A Systematic Review , 2010 .

[71]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[72]  Miguel Nussbaum,et al.  Exploring different technological platforms for supporting co-located collaborative games in the classroom , 2012, Comput. Hum. Behav..

[73]  Magnus Jahre,et al.  Experimental Validation of the Learning Effect for a Pedagogical Game on Computer Fundamentals , 2009, IEEE Transactions on Education.

[74]  John O’Rourke,et al.  ‘New Directions for Traditional Lessons’: Can Handheld Game Consoles Enhance Mental Mathematics Skills? , 2011 .

[75]  Eliane Segers,et al.  Effects of vocabulary training by computer in kindergarten , 2003, J. Comput. Assist. Learn..

[76]  R. Tweedie,et al.  A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis , 2000 .

[77]  James Minogue,et al.  Investigating the impact of video games on high school students' engagement and learning about genetics , 2009, Comput. Educ..

[78]  Mitchel Resnick,et al.  Constructionism in Practice: Designing, Thinking, and Learning in A Digital World , 1996 .

[79]  Daniel T. Hickey,et al.  Designing Assessments and Assessing Designs in Virtual Educational Environments , 2009 .

[80]  P. Pintrich.  A Motivational Science Perspective on the Role of Student Motivation in Learning and Teaching Contexts. , 2003 .

[81]  L. K. Bartholomew,et al.  Watch, Discover, Think, and Act: evaluation of computer-assisted instruction to improve asthma self-management in inner-city children. , 2000, Patient education and counseling.

[82]  Hanoch Hauptman,et al.  Enhancement of spatial thinking with Virtual Spaces 1.0 , 2010, Comput. Educ..

[83]  T. S. Hasselbring,et al.  Anchored Instruction: Why We Need It and How Technology Can Help , 2012 .

[84]  Chi-Chang Chen,et al.  An online game approach for improving students' learning performance in web-based problem-solving activities , 2012, Comput. Educ..

[85]  S. Herring,et al.  Situationally embodied curriculum: Relating formalisms and contexts , 2007 .

[86]  Jean Écalle,et al.  Serious games as new educational tools: how effective are they? A meta-analysis of recent studies , 2013, J. Comput. Assist. Learn..

[87]  Wei Peng,et al.  Design and Evaluation of a Computer Game to Promote a Healthy Diet for Young Adults , 2009, Health communication.

[88]  David J. Miller,et al.  Using a games console in the primary classroom: Effects of 'Brain Training' programme on computation and self-esteem , 2010, Br. J. Educ. Technol..

[89]  Barbara J. Fox,et al.  The effects of computer software for developing phonological awareness in low‐progress readers , 2001 .

[90]  Michael Barnett,et al.  Using Video Games to Support Pre-Service Elementary Teachers Learning of Basic Physics Principles , 2011 .

[91]  Michael F. Young,et al.  Our Princess Is in Another Castle , 2012 .

[92]  Daniel Wendel,et al.  The Simulation Cycle: Combining Games, Simulations, Engineering and Science Using StarLogo TNG , 2009 .

[93]  Kuo-En Chang,et al.  Embedding game-based problem-solving phase into problem-posing system for mathematics learning , 2012, Comput. Educ..

[94]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[95]  Wei Pan,et al.  Assessing the effectiveness of a 3-D instructional game on improving mathematics achievement and motivation of middle school students , 2012, Br. J. Educ. Technol..

[96]  Chun-Yen Chang,et al.  The Idea Storming Cube: Evaluating the Effects of Using Game and Computer Agent to Support Divergent Thinking , 2010, J. Educ. Technol. Soc..

[97]  Gwo‐Jen Hwang,et al.  A GAME-BASED LEARNING APPROACH TO IMPROVING STUDENTS' LEARNING ACHIEVEMENTS IN A NUTRITION COURSE , 2011 .

[98]  Chin-Chung Tsai,et al.  Development of a personalized educational computer game based on students’ learning styles , 2012, Educational Technology Research and Development.

[99]  Sean C. Duncan,et al.  Scientific Habits of Mind in Virtual Worlds , 2008 .

[100]  Ya-Ting Carolyn Yang,et al.  Building virtual cities, inspiring intelligent citizens: Digital games for developing students' problem solving and learning motivation , 2012, Comput. Educ..

[101]  Neha Mahajan,et al.  Seven-Month-Old Infants Selectively Reproduce the Goals of Animate But Not Inanimate Agents. , 2009, Infancy : the official journal of the International Society on Infant Studies.

[102]  C. Atman,et al.  How people learn. , 1985, Hospital topics.

[103]  Michele D. Dickey.  Game Design Narrative for Learning: Appropriating Adventure Game Design Narrative Devices and Techniques for the Design of Interactive Learning Environments , 2006 .

[104]  Yao-Ting Sung,et al.  Developing geometry thinking through multimedia learning activities , 2007, Comput. Hum. Behav..

[105]  Fengfeng Ke,et al.  Alternative goal structures for computer game-based learning , 2008, Int. J. Comput. Support. Collab. Learn..

[106]  Ruth Stevens,et al.  Improving children's working memory and classroom performance , 2010 .

[107]  Gwo-Jen Hwang,et al.  A cognitive component analysis approach for developing game-based spatial learning tools , 2012, Comput. Educ..

[108]  Daniel T. Levin,et al.  Analyzing Action for Agents with Varying Cognitive Capacities , 2011 .

[109]  Elizabeth Tipton,et al.  Robust variance estimation in meta‐regression with dependent effect size estimates , 2010, Research synthesis methods.

[110]  GeeJames Paul.  What video games have to teach us about learning and literacy , 2003 .

[111]  Mehmet Turan,et al.  Designing a collaborative learning game: Its validation with a turn- taking control scheme in a primary science unit Kubaşik Bir Öğrenme Oyunu Tasarimi: Tasarimin İlköğretim Fen Bilgisi Ünitesinde Sirali Arayüz Kontrolüyle Geçerlenmesi , 2012 .

[112]  Harold Pashler,et al.  Journal of Experimental Psychology : Learning , Memory , and Cognition Effects of Spaced Versus Massed Training in Function Learning , 2013 .

[113]  Sasha A. Barab,et al.  Game-based curriculum and transformational play: Designing to meaningfully positioning person, content, and context , 2012, Comput. Educ..

[114]  F. Paas,et al.  How to Optimize Learning From Animated Models: A Review of Guidelines Based on Cognitive Load , 2008 .

[115]  Michael Eagle,et al.  Experimental evaluation of an educational game for improved learning in introductory computing , 2009, SIGCSE '09.

[116]  Zeynel Kablan.  The Effect of Using Exercise-Based Computer Games during the Process of Learning on Academic Achievement among Education Majors. , 2010 .

[117]  Margaret Corbit,et al.  Leveraging Game-Play in a 3D World: A Comparative Study in a Biology Classroom , 2009, Int. J. Gaming Comput. Mediat. Simulations.

[118]  R. Spiro,et al.  The Art of Multimedia and the State of Education@@@Cognition, Education, and Multimedia: Exploring Ideas in High Technology , 1992 .

[119]  R. Mayer,et al.  Narrative games for learning: Testing the discovery and narrative hypotheses. , 2012 .

[120]  Jose Luis Saorin,et al.  DO VIDEO GAMES IMPROVE SPATIAL ABILITIES OF ENGINEERING STUDENTS , 2014 .

[121]  C S Green,et al.  Action-Video-Game Experience Alters the Spatial Resolution of Vision , 2007, Psychological science.

[122]  Jerry Wellington,et al.  America's lab report: Investigations in high school science , 2007 .

[123]  Lina Yordanova,et al.  Gamification in education , 2014 .

[124]  R. Kozma.  Will media influence learning? Reframing the debate , 1994 .

[125]  Kurt Squire,et al.  Mad City Mystery: Developing Scientific Argumentation Skills with a Place-based Augmented Reality Game on Handheld Computers , 2007 .

[126]  S. M. Sawtelle,et al.  A Study of the Effectiveness of Cognitive Skill Therapy Delivered in a Video-Game Format , 2007 .

[127]  Tsung-Yu Liu,et al.  Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation , 2010, Comput. Educ..

[128]  Mariano Alcañiz Raya,et al.  Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project , 2010, Comput. Educ..

[129]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[130]  Claudia Schrader,et al.  The influence of virtual presence: Effects on experienced cognitive load and learning outcomes in educational computer games , 2012, Comput. Hum. Behav..

[131]  Hans van der Meij,et al.  Learning from games: Does collaboration help? , 2011, Br. J. Educ. Technol..

[132]  Wim Van den Noortgate,et al.  Assessing meta‐regression methods for examining moderator relationships with dependent effect sizes: A Monte Carlo simulation , 2017, Research synthesis methods.

[133]  M. Egger,et al.  The hazards of scoring the quality of clinical trials for meta-analysis. , 1999, JAMA.

[134]  Jie Chi Yang,et al.  Integrating video-capture virtual reality technology into a physically interactive learning environment for English learning , 2010, Comput. Educ..

[135]  W. Montague,et al.  Aptitude, Learning, and Instruction , 1980 .

[136]  Michael J. Sanger,et al.  The Rainbow Wheel and Rainbow Matrix: Two Effective Tools for Learning Ionic Nomenclature , 2006 .

[137]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[138]  Douglas B. Clark,et al.  Digital games for learning: A systematic review and meta-analysis , 2013 .

[139]  Julie I. Cohen,et al.  Effect of action video games on the spatial distribution of visuospatial attention. , 2006, Journal of experimental psychology. Human perception and performance.

[140]  F. Heider,et al.  An experimental study of apparent behavior , 1944 .

[141]  A. Bandura.  Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[142]  Manuel Contero,et al.  Do Video Games Improve Spatial Abilities of Engineering Students , 2009 .

[143]  E. Dieterle,et al.  Neomillennial Learning Styles and River City , 2023, Children, Youth and Environments.

[144]  Lloyd P. Rieber,et al.  Games, simulations, and visual metaphors in education: antagonism between enjoyment and learning , 2008 .

[145]  Ingram Olkin,et al.  Stochastically dependent effect sizes. , 1994 .

[146]  L. Hedges.  Distribution Theory for Glass's Estimator of Effect size and Related Estimators , 1981 .

[147]  Cher Ping Lim.  Global citizenship education, school curriculum and games: Learning Mathematics, English and Science as a global citizen , 2008, Comput. Educ..

[148]  I. Cherney.  Mom, Let Me Play More Computer Games: They Improve My Mental Rotation Skills , 2008 .

[149]  Stephen W. Raudenbush,et al.  Analyzing effect sizes: Random-effects models. , 2009 .

[150]  Andrew Moshirnia,et al.  The Educational Efficacy of Distinct Information Delivery Systems in Modified Video Games , 2010 .