Does Computer Game Design and Programming Benefit Children? A Meta-Synthesis of Research

It is widely believed that there are educational benefits to making computer games, but there is no systematic review of research on this topic. This article describes a meta-synthesis of research on children designing and programming computer games that investigates the extent to which there is evidence of benefits for computer science learning and motivation. Over 400 articles were identified, and 68 articles met the inclusion criteria. A systematic analysis and synthesis across studies showed some evidence that computer game design and programming can lead to changes in programming knowledge, problem solving, and computer science attitudes and confidence. However, most of the evidence described engagement in computing-related practices and did not measure learning. The findings were mostly positive, although several studies noted more negative attitudes toward programming after making games. The results were similar across different pedagogical approaches, although social interaction may provide unique opportunities for computer science learning. The synthesis resulted in a list of design elements for studying computer game design and programming activities; these can be used to increase the availability of evidence about learning. The article concludes with the identification of gaps in the research and suggestions for additional research.

[1]  M. Chiu,et al.  Formal and informal context factors as contributors to student engagement in a guided discovery-based program of game design learning , 2013 .

[2]  Jill Denner,et al.  Pair Programming: Under What Conditions Is It Advantageous for Middle School Students? , 2014 .

[3]  Alexander Repenning,et al.  Broadening participation through scalable game design , 2008, SIGCSE '08.

[4]  B.R. Maxim,et al.  Work in progress - Introducing information technology through game design , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[5]  Ahmet Baytak,et al.  An Investigation of the Artifacts, Outcomes, and Processes of Constructing Computer Games about Environmental Science in a Fifth Grade Science Classroom. , 2009 .

[6]  Marios C. Angelides,et al.  Decade of Game Making for Learning: From Tools to Communities , 2014 .

[7]  Phillip Dawson,et al.  On the Effectiveness of Supplemental Instruction , 2014 .

[8]  Y. Kafai Playing and Making Games for Learning , 2006, Games Cult..

[9]  Ville Isomöttönen,et al.  Five years of game programming outreach: understanding student differences , 2014, SIGCSE '14.

[10]  Judy Robertson The influence of a game-making project on male and female learners’ attitudes to computing , 2013, Comput. Sci. Educ..

[11]  S. Papert The children's machine: rethinking school in the age of the computer , 1993 .

[12]  Jill Denner,et al.  The fairy performance assessment: measuring computational thinking in middle school , 2012, SIGCSE '12.

[13]  Jesper Juul Half-Real: Video Games between Real Rules and Fictional Worlds , 2005 .

[14]  Brian Cusack,et al.  Kodu game lab: improving the motivation for learning programming concepts , 2011, FDG.

[15]  Mete Akcaoglu,et al.  Learning problem-solving through making games at the game design and learning summer program , 2014, Educational Technology Research and Development.

[16]  Fengfeng Ke,et al.  An implementation of design-based learning through creating educational computer games: A case study on mathematics learning during design and computing , 2014, Comput. Educ..

[17]  Jill Denner,et al.  Computer games created by middle school girls: Can they be used to measure understanding of computer science concepts? , 2012, Comput. Educ..

[18]  R. Whittemore,et al.  The integrative review: updated methodology. , 2005, Journal of advanced nursing.

[19]  M. Sandelowski,et al.  Using qualitative metasummary to synthesize qualitative and quantitative descriptive findings. , 2007, Research in nursing & health.

[20]  Jill Denner,et al.  Children learning computer science concepts via Alice game-programming , 2012, SIGCSE '12.

[21]  T. Koole,et al.  The BERA/SAGE Handbook of Educational Research , 2017 .

[22]  Xun Ge,et al.  Fostering 21st Century Skill Development by Engaging Students in Authentic Game Design Projects in a High School Computer Programming Class , 2011 .

[23]  Thomas Connolly,et al.  Evaluation of Computer Games Developed by Primary School Children to Gauge Understanding of Programming Concepts , 2012 .

[24]  Jeffrey Edgington,et al.  Using game creation for teaching computer programming to high school students and teachers , 2009, ITiCSE '09.

[25]  Alexander Repenning,et al.  Using scalable game design to teach computer science from middle school to graduate school , 2010, ITiCSE '10.

[26]  Katie Salen,et al.  Quest to Learn: Developing the School for Digital Kids , 2010 .

[27]  Magy Seif El-Nasr,et al.  Building Virtual Spaces , 2007, Virtuality and Virtualization.

[28]  A. Harden,et al.  Methods for the thematic synthesis of qualitative research in systematic reviews , 2008, BMC medical research methodology.

[29]  Aron Shlonsky,et al.  Systematic Synthesis of Qualitative Research , 2012 .

[30]  David Clarke,et al.  Advancements in Research Synthesis Methods: From a Methodologically Inclusive Perspective , 2009 .

[31]  M. Savin-Baden,et al.  Integration of qualitative evidence: towards construction of academic knowledge in social science and professional fields , 2011 .

[32]  Jill Denner,et al.  Can middle-schoolers use Storytelling Alice to make games?: results of a pilot study , 2009, FDG.

[33]  Elliot Soloway,et al.  Simulating Student Programmers , 1989, IJCAI.

[34]  Ya-Ting Carolyn Yang,et al.  Empowering students through digital game authorship: Enhancing concentration, critical thinking, and academic achievement , 2013, Comput. Educ..

[35]  Jill Denner,et al.  Approaches to Reviewing Research in Education , 2017 .

[36]  Li-Chun Wang,et al.  Learning Programming Concepts through Game Design: A PCT Perspective , 2010, 2010 Third IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[37]  Elisabeth Gee,et al.  Video Game Making and Modding , 2015 .

[38]  John Maloney,et al.  Alice, Greenfoot, and Scratch -- A Discussion , 2010, TOCE.

[39]  Qing Li Digital game building: learning in a participatory culture , 2010 .

[40]  Mário A. M. Guimarães Game development with Game Maker, Flash and Unity , 2011, ACM-SE '11.

[41]  Yasmin B. Kafai,et al.  Minds In Play: Computer Game Design as a Context for Children''s , 1994 .

[42]  D. Buckingham,et al.  Game Design as Textual Poaching: Media Literacy, Creativity and Game-Making , 2010 .

[43]  Yasmin B. Kafai,et al.  Constructionist Gaming: Understanding the Benefits of Making Games for Learning , 2015, Educational psychologist.

[44]  Harris Cooper,et al.  Research Synthesis and Meta-Analysis: A Step-by-Step Approach , 2009 .

[45]  Joel C. Adams,et al.  What do students learn about programming from game, music video, and storytelling projects? , 2012, SIGCSE '12.

[46]  Jill Denner,et al.  Computer Programming in Middle School: How Pairs Respond to Challenges , 2007 .

[47]  Elisabeth R. Hayes,et al.  Making Computer Games and Design Thinking , 2008, Games Cult..

[48]  Kevin Clark,et al.  How scientific inquiry emerges from game design , 2009 .

[49]  H. Suri Towards Methodologically Inclusive Research Syntheses: Expanding possibilities , 2017 .

[50]  Magy Seif,et al.  Middle-to-High School Girls as Game Designers - What are the Implications? , 2007 .

[51]  Jeffrey Earp GAME MAKING FOR LEARNING: A SYSTEMATIC REVIEW OF THE RESEARCH LITERATURE , 2015 .

[52]  Li-Chun Wang,et al.  The Relationships of Social Economic Status and Learners' Motivation and Performance in Learning from a Game-Design Project , 2011, 2011 IEEE 11th International Conference on Advanced Learning Technologies.

[53]  William R. Watson,et al.  Juvenile Offenders: Developing Motivation, Engagement, and Meaning-Making through Video Game Creation , 2013, Int. J. Game Based Learn..

[54]  Ryan M. Patton,et al.  Games as an Artistic Medium: Investigating Complexity Thinking in Game-Based Art Pedagogy , 2013 .

[55]  Ming Ming Chiu,et al.  Contribution of Motivational Orientations to Student Outcomes in a Discovery-Based Program of Game Design Learning , 2012, ICLS.

[56]  Yasmin B. Kafai,et al.  Connected Gaming: What Making Video Games Can Teach Us about Learning and Literacy , 2016 .

[57]  Alexander Ivan Games,et al.  Exploring adolescent's STEM learning through scaffolded game design , 2011, FDG.

[58]  Catherine S. Ashcraft,et al.  Assessing Girls' Interest, Confidence, and Participation in Computing Activities: Results for Globaloria in West Virginia , 2012 .

[59]  Kathy Sanford,et al.  Recognizing New Literacies: Teachers and Students Negotiating the Creation of Video Games in School , 2007, DiGRA Conference.

[60]  Mark Guzdial,et al.  Using game development to reveal programming competency , 2012, FDG.

[61]  David C. Webb,et al.  AgentCubes: Incremental 3D end-user development , 2009, J. Vis. Lang. Comput..

[62]  Jeremy V. Ernst,et al.  Fundamental Computer Science Conceptual Understandings for High School Students Using Original Computer Game Design , 2012 .

[63]  Allan Fowler,et al.  Enriching Student Learning Programming Through Using Kodu , 2012 .

[64]  David C. Webb,et al.  Toward an emergent theory of broadening participation in computer science education , 2012, SIGCSE '12.

[65]  Jeannette M. Wing An introduction to computer science for non-majors using principles of computation , 2007, SIGCSE.

[66]  Jill Denner,et al.  The Girl Game Company: Engaging Latina Girls in Information Technology. , 2009 .

[67]  Roxana Hadad,et al.  Using Game Design as a Means to Make Computer Science Accessible to Adolescents , 2013 .

[68]  Ming-Puu Chen,et al.  The effects of goal specificity and scaffolding on programming performance and self-regulation in game design , 2014, Br. J. Educ. Technol..

[69]  Mete Akcaoglu Cognitive and motivational impacts of learning game design on middle school children , 2013 .

[70]  N. Chen,et al.  Improving learning achievements, motivations and problem-solving skills through a peer assessment-based game development approach , 2014 .

[71]  William R. Penuel,et al.  Studying science and engineering learning in practice , 2016 .

[72]  Jonathan Schaeffer,et al.  Computer-game construction: A gender-neutral attractor to Computing Science , 2010, Comput. Educ..

[73]  Eric Rosenbaum,et al.  Scratch: programming for all , 2009, Commun. ACM.

[74]  Vicki S Conn,et al.  Beyond MEDLINE for literature searches. , 2003, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[75]  Thomas Connolly,et al.  Evaluation of Introducing Programming to Younger School Children Using a Computer Game Making Tool , 2011 .