The Enactive equation: Exploring How Multiple External Representations are Integrated, Using a Fully Controllable Interface and Eye-Tracking

Representational competence (RC), defined as "the ability to simultaneously process and integrate multiple external representations (MERs) in a domain", is a marker of expertise in science and engineering. However, the cognitive mechanisms underlying this ability and how this ability develops in learners, is poorly understood. In this paper, we report a fully controllable interface, designed to help school students develop RC. Further, as the design emerged from the application of distributed and embodied cognition theory to the RC problem, the design also seeks to shed light on the cognitive mechanisms underlying the integration of MERs. Here we report a preliminary eye and mouse tracking study, which sought to develop a detailed understanding of how students interacted with our interface, under self and text-guided exploration conditions. We also examined how the interaction process related to students' ability to integrate the representations in the interface. Results highlighted several desirable student behaviors, and potential points of modification of the interface to improve integration of MERs.

[1]  Hans Spada,et al.  The Active Integration of Information during Learning with Dynamic and Interactive Visualisations , 2004 .

[2]  Micah S. Stohlmann,et al.  Modeling in Engineering: The Role of Representational Fluency in Students' Conceptual Understanding , 2013 .

[3]  C. Wieman,et al.  PhET: Interactive Simulations for Teaching and Learning Physics , 2006 .

[4]  Martin H. Fischer,et al.  A hierarchical view of grounded, embodied, and situated numerical cognition , 2012, Cognitive Processing.

[5]  Andra A. DiSessa.  Inventing Graphing: Meta­ Representational Expertise in Children , 1991 .

[6]  A. Johnstone.  Why is science difficult to learn? Things are seldom what they seem , 1991 .

[7]  Bruce L Sherin,et al.  How Students Understand Physics Equations , 2001 .

[8]  P. Shah,et al.  Exploring visuospatial thinking in chemistry learning , 2004 .

[9]  Janet Metcalfe,et al.  From the Revolution to Embodiment , 2013, Perspectives on psychological science : a journal of the Association for Psychological Science.

[10]  E. Knuth.  Student Understanding of the Cartesian Connection: An Exploratory Study , 2000 .

[11]  Dorothea P. Simon,et al.  Expert and Novice Performance in Solving Physics Problems , 1980, Science.

[12]  S. Ainsworth.  DeFT: A Conceptual Framework for Considering Learning with Multiple Representations. , 2006 .

[13]  C. Tsui,et al.  Genetics Reasoning with Multiple External Representations , 2003 .

[14]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[15]  Iliada Elia,et al.  Relations Between Secondary Pupils’ Conceptions About Functions and Problem Solving in Different Representations , 2007 .

[16]  Nancy J. Nersessian,et al.  Kinesthetic pathways: a tabletop visualization to support discovery in systems biology , 2011, C&C '11.

[17]  Robert B. Kozma,et al.  The Cambridge Handbook of Multimedia Learning: Multimedia Learning of Chemistry , 2005 .

[18]  Anna Wilder,et al.  Supporting Representational Competence in High School Biology With Computer-Based Biomolecular Visualizations , 2007 .

[19]  Mike Stieff,et al.  Connected Chemistry—Incorporating Interactive Simulations into the Chemistry Classroom , 2003 .

[20]  Orkun S. Soyer,et al.  The roles of integration in molecular systems biology. , 2012, Studies in history and philosophy of biological and biomedical sciences.

[21]  N. Finkelstein,et al.  Patterns of multiple representation use by experts and novices during physics problem solving , 2008 .

[22]  A. Maravita,et al.  Tools for the body (schema) , 2004, Trends in Cognitive Sciences.

[23]  Martin Reisslein,et al.  Teaching with Concrete and Abstract Visual Representations: Effects on Students' Problem Solving, Problem Representations, and Learning Perceptions. , 2011 .

[24]  Jan T. van der Veen,et al.  The learning effects of computer simulations in science education , 2012, Comput. Educ..

[25]  Aditya Johri,et al.  Framework for improving engineering representational literacy by using pen-based computing , 2011 .

[26]  Mike Stieff,et al.  Identifying Representational Competence With Multi-Representational Displays , 2011 .

[27]  Sanjay Chandrasekharan,et al.  Building to Discover: A Common Coding Model , 2009, Cogn. Sci..

[28]  R. Kozma.  The material features of multiple representations and their cognitive and social affordances for science understanding , 2003 .

[29]  Ton de Jong,et al.  Scientific Discovery Learning with Computer Simulations of Conceptual Domains , 1998 .

[30]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[31]  David Kirsh,et al.  Thinking with external representations , 2010, AI & SOCIETY.

[32]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[33]  Aditya Johri,et al.  The Role of Representations in Engineering Practices: Taking a Turn towards Inscriptions , 2013 .

[34]  T. Jong,et al.  Supporting students' learning with multiple representations in a dynamic simulation-based learning environment , 2006 .

[35]  U. Netlogo Wilensky,et al.  Center for Connected Learning and Computer-Based Modeling , 1999 .

[36]  R. Kozma,et al.  Multimedia and understanding: Expert and novice responses to different representations of chemical phenomena , 1997 .