Testing the Impact of a Pre-instructional Digital Game on Middle-Grade Students’ Understanding of Photosynthesis

Abstract Rigorous studies of the impact of digital games on student learning remain relatively rare, as do studies of games as supports for learning difficult, core curricular concepts in the context of normal classroom practices. This study uses a blocked, cluster randomized controlled trial design to test the impact of a digital game, played as homework prior to instruction, and associated supplemental instructional activities, on middle grade students’ understanding of the process of photosynthesis. The role of the teacher as a potential moderator of the game’s impact on student outcomes was also investigated, using Classroom Assessment Scoring System-Secondary Edition (CLASS-S) observations as a measure of instructional quality. Study findings demonstrate that the intervention did not have a significant impact on student understanding of photosynthesis. The interaction of treatment teachers’ CLASS-S scores and students’ average photosynthesis assessment scores approached significance. This study suggests that when digital games are used as a step in the process of learning difficult conceptual material, teachers may need support and guidance to make productive connections between in-game experiences and the target concepts.

[1]  Dedre Gentner,et al.  Bootstrapping the Mind: Analogical Processes and Symbol Systems , 2010, Cogn. Sci..

[2]  Mark Stansfield,et al.  Towards the Development of a Games-Based Learning Evaluation Framework , 2009 .

[3]  Michael Barnett,et al.  Electromagnetism Supercharged! Learning Physics with Digital Simulation Games , 2004, ICLS.

[4]  B. Hamre,et al.  Classroom assessment scoring system. , 2008 .

[5]  Debbie Denise Reese,et al.  First steps and beyond: Serious games as preparation for future learning , 2007 .

[6]  Diane Jass Ketelhut,et al.  Teachers and game-based learning: Improving understanding of how to increase efficacy of adoption , 2011, Comput. Educ..

[7]  Jesper Juul,et al.  The game, the player, the world: looking for a heart of gameness , 2010, DiGRA Conference.

[8]  Chris Dede,et al.  Immersive Interfaces for Engagement and Learning , 2009, Science.

[9]  H. Bloom,et al.  Using Covariates to Improve Precision for Studies That Randomize Schools to Evaluate Educational Interventions , 2007 .

[10]  Rebecca Herman,et al.  Critical Issues and Common Pitfalls in Designing and Conducting Impact Studies in Education , 2010 .

[11]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[12]  Stella Vosniadou,et al.  Reframing the Classical Approach to Conceptual Change: Preconceptions, Misconceptions and Synthetic Models , 2012 .

[13]  Stella Vosniadou,et al.  International handbook of research on conceptual change , 2013 .

[14]  Sasha A. Barab,et al.  Developing Critical Implementations of Technology-Rich Innovations: A Cross-Case Study of the Implementation of Quest Atlantis , 2009 .

[15]  F. Williams.  Measuring the Information Society , 1988 .

[16]  Ayush Gupta,et al.  On Static and Dynamic Intuitive Ontologies , 2011 .

[17]  Alexandra Rankin Macgill,et al.  Teens, Video Games, and Civics: Teens' Gaming Experiences Are Diverse and Include Significant Social Interaction and Civic Engagement. , 2008 .

[18]  Kenneth Tobin,et al.  Second international handbook of science education , 2012 .

[19]  Richard E. Ferdig,et al.  Handbook of Research on Effective Electronic Gaming in Education , 2009 .

[20]  Stephanie Cronen,et al.  Experimenting With Teacher Professional Development: Motives and Methods , 2008 .

[21]  J. Roschelle,et al.  Misconceptions Reconceived: A Constructivist Analysis of Knowledge in Transition , 1994 .

[22]  L. Cameron.  Metaphors in the learning of science: a discourse focus , 2002 .

[23]  Jeremy Roschelle,et al.  From New Technological Infrastructures to Curricular Activity Systems: Advanced Designs for Teaching and Learning , 2010 .

[24]  Ayush Gupta,et al.  The Case for Dynamic Models of Learners' Ontologies in Physics , 2010 .

[25]  Douglas B. Clark,et al.  Digital games for learning: A systematic review and meta-analysis , 2013 .

[26]  Craig K. Enders,et al.  Missing Data in Educational Research: A Review of Reporting Practices and Suggestions for Improvement , 2004 .

[27]  James D. Slotta,et al.  Misconceived Causal Explanations for Emergent Processes , 2012, Cogn. Sci..

[28]  Daniel L. Schwartz,et al.  Chapter 3: Rethinking Transfer: A Simple Proposal With Multiple Implications , 1999 .

[29]  D. Hestenes,et al.  Force concept inventory , 1992 .

[30]  D. Reese.  STRUCTURE MAPPING THEORY AS A FORMALISM FOR INSTRUCTIONAL GAME DESIGN AND ASSESSMENT , 2009 .

[31]  Deborah Holland,et al.  Motivation for Achievement: Possibilities for Teaching and Learning , 1999 .

[32]  Michael F. Young,et al.  Our Princess Is in Another Castle , 2012 .

[33]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[34]  Grady Venville.  Knowledge Acquisition as Conceptual Change: The Case of a Theory of Biology , 2008 .

[35]  Craig K. Enders,et al.  Applied Missing Data Analysis , 2010 .

[36]  Daniel P. Mayer.  Measuring Instructional Practice: Can Policymakers Trust Survey Data? , 1999 .

[37]  Annemarie S. Palincsar,et al.  Social constructivist perspectives on teaching and learning. , 1998, Annual review of psychology.

[38]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[39]  R. Eynon,et al.  Digital natives: where is the evidence? , 2010 .

[40]  L. Malmberg,et al.  Changes in student teachers' agency beliefs during a teacher education year, and relationships with observed classroom quality, and day-to-day experiences. , 2009, The British journal of educational psychology.

[41]  Marcia C. Linn,et al.  Internet Environments for Science Education , 2004 .

[42]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[43]  V. Rideout,et al.  Generation M2: Media in the Lives of 8- to 18-Year-Olds , 2010 .

[44]  R. Driver,et al.  Making sense of secondary science , 1994 .

[45]  André Maurois,et al.  A Private Universe , 1932 .

[46]  P. Pintrich.  The role of motivation in promoting and sustaining self-regulated learning , 1999 .

[47]  M. Chi.  Three Types of Conceptual Change: Belief Revision, Mental Model Transformation, and Categorical Shift , 2009 .

[48]  Peter Reimann,et al.  Designs for Learning Environments of the Future , 2010 .

[49]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[50]  Martin Oliver,et al.  How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? , 2006, Comput. Educ..

[51]  M. Chi,et al.  Assessing Students' Misclassifications of Physics Concepts: An Ontological Basis for Conceptual Change , 1995 .

[52]  Jan A Pettersen.  Youth Media Democracy: Perceptions of New Literacies , 2009 .

[53]  Fengfeng Ke,et al.  A Qualitative Meta-Analysis of Computer Games as Learning Tools , 2009 .

[54]  Wolff-Michael Roth,et al.  On Meaning and Mental Representation , 2013 .

[55]  Daniel L. Schwartz,et al.  Inventing to Prepare for Future Learning: The Hidden Efficiency of Encouraging Original Student Production in Statistics Instruction , 2004 .

[56]  Jan Hawkins,et al.  “I'm the thinkist, you're the typist”: The Interaction of Technology and the Social Life of Classrooms , 1984 .

[57]  Sue Betka,et al.  National Center for Education Evaluation and Regional Assistance , 2015 .

[58]  B. Hamre,et al.  Conceptualization, Measurement, and Improvement of Classroom Processes: Standardized Observation Can Leverage Capacity , 2009 .

[59]  J. Brophy.  Motivating Students To Learn , 1987 .

[60]  K. Holyoak,et al.  Cognitive Supports for Analogies in the Mathematics Classroom , 2007, Science.

[61]  James D. Slotta,et al.  Helping Students Understand Challenging Topics in Science Through Ontology Training , 2006 .

[62]  S. Raudenbush,et al.  Empirical Issues in the Design of Group-Randomized Studies to Measure the Effects of Interventions for Children , 2008 .