Digital Games as Multirepresentational Environments for Science Learning: Implications for Theory, Research, and Design

Environments in which learning involves coordinating multiple external representations (MERs) can productively support learners in making sense of complex models and relationships. Educational digital games provide an increasing popular medium for engaging students in manipulating and exploring such models and relationships. This article applies cognitive science research on MERs to a range of popular educational and recreational games that focus on the interpretation and manipulation of models. We leverage the literatures on embodied cognition, adaptive scaffolding, science education, and dynamic visualizations to address the challenges, trade-offs, and questions highlighted by the research. We apply these research-derived design considerations to analyze (a) the extent and forms through which the design considerations are reflected in the design of the games, (b) the implications for designing effective model-based games for learning, and (c) the implications for future research on MERs.

[1]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[2]  Alan Bell,et al.  The Interpretation of Graphs Representing Situations. , 1981 .

[3]  Barbara Y. White,et al.  Designing Computer Games to Help Physics Students Understand Newton's Laws of Motion , 1984 .

[4]  J. Mokros,et al.  The impact of microcomputer‐based labs on children's ability to interpret graphs , 1987 .

[5]  Heather Brasell,et al.  The effect of real‐time laboratory graphing on learning graphic representations of distance and velocity , 1987 .

[6]  M. Csíkszentmihályi.  Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[7]  Andra A. DiSessa.  Inventing Graphing: Meta­ Representational Expertise in Children , 1991 .

[8]  Claude Janvier,et al.  A Study of the Interpretation of Trends in Multiple Curve Graphs of Ecological Situations. , 1992 .

[9]  B. White.  ThinkerTools: Causal Models, Conceptual Change, and Science Education , 1993 .

[10]  M. Just,et al.  Constructing mental models of machines from text and diagrams. , 1993 .

[11]  Stephen J. Payne,et al.  Internalizing and the Use Specificity of Device Knowledge , 1993, Hum. Comput. Interact..

[12]  A. Collins,et al.  Epistemic forms and Epistemic Games: Structures and Strategies to Guide Inquiry , 1993 .

[13]  David Hammer,et al.  Dynaturtle Revisited: Learning Physics Through Collaborative Design of a Computer Model , 1993, Interact. Learn. Environ..

[14]  R. Stevens,et al.  Making Space: A Comparison of Mathematical Work in School and Professional Design Practices , 1994 .

[15]  Laurie D. Edwards,et al.  Microworlds as Representations , 1995 .

[16]  Richard Catrambone,et al.  Aiding subgoal learning: Effects on transfer. , 1995 .

[17]  Jon Oberlander,et al.  A Cognitive Theory of Graphical and Linguistic Reasoning: Logic and Implementation , 1995, Cogn. Sci..

[18]  Rolf Ploetzner,et al.  The construction and coordination of complementary problem representations in physics , 1995 .

[19]  C. O'Malley,et al.  Design of a computer‐augmented curriculum for mechanics , 1995 .

[20]  Jiajie Zhang,et al.  A representational analysis of relational information displays , 1996, Int. J. Hum. Comput. Stud..

[21]  Lorraine Sherry,et al.  Epistemic Forms and Epistemic Games. , 1996 .

[22]  P. Chandler,et al.  The Role of Visual Indicators in Dual Sensory Mode Instruction , 1997 .

[23]  Paul Chandler,et al.  Levels of Expertise and Instructional Design , 1998, Hum. Factors.

[24]  David Wood,et al.  There is more than one way to solve a problem: Evaluating a learning environment that supports the development of children's multiplication skills , 1998 .

[25]  Roy D. Pea,et al.  Addressing the Challenges of Inquiry-Based Learning Through Technology and Curriculum Design , 1999 .

[26]  F. Reif,et al.  Teaching scientific thinking skills: Students and computers coaching each other , 1999 .

[27]  Daniel L. Schwartz,et al.  Chapter 3: Rethinking Transfer: A Simple Proposal With Multiple Implications , 1999 .

[28]  Daniel L. Schwartz,et al.  Rethinking transfer: A simple proposal with multiple implica-tions , 1999 .

[29]  Sara Jones,et al.  Diagram Representation: A Comparison of Animated and Static Formats , 1999 .

[30]  Shaaron Ainsworth,et al.  The functions of multiple representations , 1999, Comput. Educ..

[31]  Andrea A. diSessa,et al.  Changing Minds: Computers, Learning, and Literacy , 2000 .

[32]  Paul Cobb,et al.  Symbolizing, Modeling, and Instructional Design , 2000 .

[33]  Richard E. Mayer,et al.  Signaling as a Cognitive Guide in Multimedia Learning , 2001 .

[34]  R. Mayer,et al.  When learning is just a click away: Does simple user interaction foster deeper understanding of multimedia messages? , 2001 .

[35]  Richard Lehrer,et al.  Symbolizing Space into Being , 2002 .

[36]  Scotty D. Craig,et al.  Animated Pedagogical Agents in Multimedia Educational Environments: Effects of Agent Properties, Picture Features, and Redundancy , 2002 .

[37]  L. Schauble,et al.  Symbolic communication in mathematics and science: Co-constituting inscription and thought. , 2002 .

[38]  Patricia D. Mautone,et al.  Pictorial aids for learning by doing in a multimedia geology simulation game. , 2002 .

[39]  N. Nersessian.  The Cognitive Basis of Science: The cognitive basis of model-based reasoning in science , 2002 .

[40]  Celia Hoyles,et al.  Rethinking the Microworld Idea , 2002 .

[41]  Lieven Verschaffel,et al.  Symbolizing, modeling and tool use in mathematics education , 2002 .

[42]  Richard Lowe,et al.  Animation and learning: selective processing of information in dynamic graphics , 2003 .

[43]  Richard E. Mayer,et al.  Multimedia learning in an interactive self-explaining environment: What works in the design of agent , 2003 .

[44]  Mary Hegarty,et al.  The Roles of Mental Animations and External Animations in Understanding Mechanical Systems , 2003 .

[45]  Hans Spada,et al.  The Active Integration of Information during Learning with Dynamic and Interactive Visualisations , 2004 .

[46]  Mary Hegarty,et al.  Constructing and Revising Mental Models of a Mechanical System: The role of domain knowledge in understanding external visualizations , 2004 .

[47]  William V. Wright,et al.  A Theory of Fun for Game Design , 2004 .

[48]  M. Hegarty.  Dynamic visualizations and learning: getting to the difficult questions , 2004 .

[49]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[50]  Michelene T. H. Chi,et al.  The Cambridge Handbook of Multimedia Learning: The Self-Explanation Principle in Multimedia Learning , 2005 .

[51]  Kristian Kiili,et al.  On Educational Game Design: Building Blocks of Flow Experience , 2005 .

[52]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[53]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Principles for Reducing Extraneous Processing in Multimedia Learning : Coherence, Signaling, Redundancy, Spatial Contiguity, and Temporal Contiguity Principles , 2005 .

[54]  Noel Enyedy.  Inventing Mapping: Creating Cultural Forms to Solve Collective Problems , 2005 .

[55]  R. Mayer,et al.  Role of guidance, reflection, and interactivity in an agent-based multimedia game , 2005 .

[56]  John B. Black,et al.  Direct-manipulation animation: incorporating the haptic channel in the learning process to support middle school students in science learning and mental model acquisition , 2006 .

[57]  T. Jong,et al.  Supporting students' learning with multiple representations in a dynamic simulation-based learning environment , 2006 .

[58]  S. Ainsworth.  DeFT: A Conceptual Framework for Considering Learning with Multiple Representations. , 2006 .

[59]  Robert K. Atkinson,et al.  Animated pedagogical agents: does their degree of embodiment impact learning from static or animated worked examples? , 2007 .

[60]  B. Rittle-Johnson,et al.  Does comparing solution methods facilitate conceptual and procedural knowledge? An experimental study on learning to solve equations. , 2007 .

[61]  F. Paas,et al.  Attention Cueing as a Means to Enhance Learning from an Animation , 2007 .

[62]  Béatrice S. Hasler,et al.  Learner Control, Cognitive Load and Instructional Animation , 2007 .

[63]  H. Schweingruber,et al.  TAKING SCIENCE TO SCHOOL: LEARNING AND TEACHING SCIENCE IN GRADES K-8 , 2007 .

[64]  J. Gee.  Good video games and good learning , 2007 .

[65]  Orit Parnafes.  What Does “Fast” Mean? Understanding the Physical World Through Computational Representations , 2007 .

[66]  L. Barsalou.  Grounded cognition. , 2008, Annual review of psychology.

[67]  Nancy J. Nersessian,et al.  Creating Scientific Concepts , 2008 .

[68]  R. Lehrer,et al.  Technology and mathematics education , 2008 .

[69]  Alexander Renkl,et al.  Assisting self-explanation prompts are more effective than open prompts when learning with multiple representations , 2009 .

[70]  R. Catrambone,et al.  The Impact of Learner Characteristics on Information Utilization Strategies, Cognitive Load Experienced, and Performance in Hypermedia Learning , 2009 .

[71]  Lawrence W. Barsalou,et al.  Grounded Cognition: Past, Present, and Future , 2010, Top. Cogn. Sci..

[72]  T. Gog,et al.  A Theoretical Analysis of How Segmentation of Dynamic Visualizations Optimizes Students' Learning , 2010 .

[73]  J. B. Black.  An Embodied/Grounded Cognition Perspective on Educational Technology , 2010 .

[74]  Susan Jang,et al.  Embodied Cognition and Virtual Reality in Learning to Visualize Anatomy , 2010 .

[75]  Cheryl I. Johnson,et al.  Adding Instructional Features That Promote Learning in a Game-Like Environment , 2010 .

[76]  Issa M. Saleh,et al.  NEW SCIENCE OF LEARNING: COGNITION, COMPUTERS AND COLLABORATION IN EDUCATION , 2010 .

[77]  Kurt VanLehn,et al.  Empirically evaluating the application of reinforcement learning to the induction of effective and adaptive pedagogical strategies , 2011, User Modeling and User-Adapted Interaction.

[78]  Daniel L. Schwartz,et al.  Practicing versus inventing with contrasting cases: The effects of telling first on learning and transfer. , 2011 .

[79]  David N. Rapp,et al.  Models and modeling in science learning , 2011 .

[80]  Mike Stieff,et al.  Identifying Representational Competence With Multi-Representational Displays , 2011 .

[81]  K. VanLehn.  The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems , 2011 .

[82]  Allan Collins.  A Study of Expert Theory Formation: The Role of Different Model Types and Domain Frameworks , 2011 .

[83]  Ton de Jong,et al.  The effects of directive self-explanation prompts to support active processing of multiple representations in a simulation-based learning environment , 2011, J. Comput. Assist. Learn..

[84]  M. P. Jacob Habgood,et al.  Motivating Children to Learn Effectively: Exploring the Value of Intrinsic Integration in Educational Games , 2011 .

[85]  P. Shawn Irvin,et al.  Student learning in science simulations: Design features that promote learning gains† , 2011 .

[86]  Loretta L. Jones,et al.  The role of multiple representations in the understanding of ideal gas problems , 2011 .

[87]  Mitchell J. Nathan.  Rethinking Formalisms in Formal Education , 2012 .

[88]  Mason Wright,et al.  From Agents to Continuous Change via Aesthetics: Learning Mechanics with Visual Agent-based Computational Modeling , 2012, Technol. Knowl. Learn..

[89]  Wied Ruijssenaars,et al.  Encyclopedia of the Sciences of Learning , 2012 .

[90]  Pratim Sengupta,et al.  Learning kinematics in elementary grades using agent-based computational modeling: a visual programming-based approach , 2012, IDC '12.

[91]  Douglas B. Clark,et al.  Games, Learning, and Society: Prediction and Explanation as Design Mechanics in Conceptually Integrated Digital Games to Help Players Articulate the Tacit Understandings They Build through Game Play , 2012 .

[92]  Chung-Yuan Hsu,et al.  Facilitating Third Graders’ Acquisition of Scientific Concepts through Digital Game-Based Learning: The Effects of Self-Explanation Principles , 2012 .

[93]  M. Hegarty,et al.  Representational Translation With Concrete Models in Organic Chemistry , 2012 .

[94]  B. Rittle-Johnson,et al.  Developing procedural flexibility: are novices prepared to learn from comparing procedures? , 2012, The British journal of educational psychology.

[95]  Randy L. Bell,et al.  Computer Simulations to Support Science Instruction and Learning: A critical review of the literature , 2012 .

[96]  Kathryn Ley,et al.  National Convention of the Association for Educational Communications and Technology , 2012 .

[97]  Noah S. Podolefsky.  Learning science through computer games and simulations , 2012 .

[98]  A. Telier,et al.  Drawing things together , 2012, INTR.

[99]  Daniel L. Schwartz,et al.  Measuring What Matters Most: Choice-Based Assessments for the Digital Age , 2013 .

[100]  Christopher J. Harris,et al.  Simulations for STEM Learning : Systematic Review and Meta-Analysis Report Overview , 2013 .

[101]  Emily B. Moore,et al.  Insights from Using PhET’s Design Principles for Interactive Chemistry Simulations , 2013 .

[102]  Sten R. Ludvigsen,et al.  Student sensemaking with science diagrams in a computer-based setting , 2013, Int. J. Comput. Support. Collab. Learn..

[103]  Richard E. Mayer,et al.  Cognitive Theory of Multimedia Learning , 2021, The Cambridge Handbook of Multimedia Learning.

[104]  S. Ainsworth.  The Cambridge Handbook of Multimedia Learning: The Multiple Representation Principle in Multimedia Learning , 2014 .

[105]  Douglas B. Clark,et al.  Integrating self-explanation functionality into a complex game environment: Keeping gaming in motion , 2014, Comput. Educ..

[106]  Arthur Francis Corvo.  Utilizing the National Research Council's (NRC) Conceptual Framework for the Next Generation Science Standards (NGSS): A Self-Study in my Science, Engineering, and Mathematics Classroom , 2014 .

[107]  Ruth Wylie,et al.  The Self-Explanation Principle in Multimedia Learning , 2014 .

[108]  Logan Fiorella,et al.  Principles for Reducing Extraneous Processing in Multimedia Learning: Coherence, Signaling, Redundancy, Spatial Contiguity and Temporal Contiguity Principles. , 2014 .

[109]  Douglas B. Clark,et al.  Learning to Deflect: Conceptual Change in Physics During Digital Game Play , 2015 .

[110]  Mason Wright,et al.  Programming in K-12 science classrooms , 2015, Commun. ACM.

[111]  Douglas B. Clark,et al.  Disciplinary integration of digital games for science learning , 2015, International Journal of STEM Education.

[112]  Pratim Sengupta,et al.  Playing Modeling Games in the Science Classroom: The Case for Disciplinary Integration , 2016, 1607.05094.

[113]  Douglas B. Clark,et al.  Digital Games, Design, and Learning , 2016, Review of educational research.

[114]  Anne Kuefer,et al.  Explaining Science A Cognitive Approach , 2016 .