Learning symbols from permanent and transient visual presentations: Don't overplay the hand

Instructional dynamic pictures (animations and videos) contain transient visual information. Consequently, when learning from dynamic pictures, students must process in working memory the current images while trying to remember the images that left the screen. This additional activity in working memory may lead dynamic pictures to be less suitable instructional materials than comparable static pictures, which are more permanent. In order to directly show the influence of transient visual information on dynamic learning environments, we designed a well-matched comparison between a permanent and a transient presentation of an abstract-symbol memory task on the computer. In the task, 104 university students (50% females) had to memorize the type, color, and position of the symbols in a rectangular configuration. In addition, an embodied cognition factor was included where the symbols in the task were either shown with a precision grasping static hand or not. We also assessed how individual characteristics (spatial ability, spatial memory span, and gender) influenced performance. Results showed that (a) permanent outperformed transient presentations, (b) observing hands hindered learning, and (c) high spatial ability and high spatial memory span were beneficial, but gender did not affect performance.

[1]  R. Mayer.  Incorporating motivation into multimedia learning , 2014 .

[2]  Katharina Scheiter,et al.  Can differences in learning strategies explain the benefits of learning from static and dynamic visualizations? , 2011, Comput. Educ..

[3]  Aurélia Bugaiska,et al.  Animates are better remembered than inanimates: further evidence from word and picture stimuli , 2014, Memory & cognition.

[4]  F. Paas.  Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[5]  Fred Paas,et al.  Making instructional animations more effective: a cognitive load approach , 2007 .

[6]  Mary Hegarty,et al.  When static media promote active learning: annotated illustrations versus narrated animations in multimedia instruction. , 2005, Journal of experimental psychology. Applied.

[7]  Amanda H. Waterman,et al.  How does enactment affect the ability to follow instructions in working memory? , 2015, Memory & cognition.

[8]  Laura E. Thomas,et al.  Grasp Posture Alters Visual Processing Biases Near the Hands , 2015, Psychological science.

[9]  D. Lubinski,et al.  Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. , 2009 .

[10]  James D. Klein,et al.  The effect of audio and animation in multimedia instruction , 2004 .

[11]  Fred Paas,et al.  Animations showing Lego manipulative tasks: Three potential moderators of effectiveness , 2015, Comput. Educ..

[12]  Susan D. Voyer,et al.  Magnitude of sex differences in spatial abilities: a meta-analysis and consideration of critical variables. , 1995, Psychological bulletin.

[13]  Shaun P. Vecera,et al.  Differential effect of one versus two hands on visual processing , 2014, Cognition.

[14]  Fred Paas,et al.  Preschool Children’s Foreign Language Vocabulary Learning by Embodying Words Through Physical Activity and Gesturing , 2015 .

[15]  S. Goldin-Meadow,et al.  Learning from Gesture: How Our Hands Change Our Minds , 2015, Educational Psychology Review.

[16]  R. Mayer,et al.  Eight Ways to Promote Generative Learning , 2016 .

[17]  J. Sweller,et al.  Cognitive load theory, the transient information effect and e-learning , 2012 .

[18]  Wolfgang Schnotz,et al.  Learning from Static and Dynamic Visualizations: What Kind of Questions Should We Ask? , 2017 .

[19]  John Sweller,et al.  Cognitive Load Theory , 2020, Encyclopedia of Education and Information Technologies.

[20]  Thomas Andre,et al.  Spatial ability and the impact of visualization/ animation on learning electrochemistry , 2003 .

[21]  Sandra Berney,et al.  Does animation enhance learning? A meta-analysis , 2016, Comput. Educ..

[22]  R. Kessels,et al.  The Corsi Block-Tapping Task: Standardization and Normative Data , 2000, Applied neuropsychology.

[23]  R. Mayer,et al.  Effects of Observing the Instructor Draw Diagrams on Learning from Multimedia Messages. , 2016 .

[24]  John Sweller,et al.  The Cambridge Handbook of Multimedia Learning: The Redundancy Principle in Multimedia Learning , 2005 .

[25]  J. Brockmole,et al.  A bias to detail: how hand position modulates visual learning and visual memory , 2012, Memory & cognition.

[26]  Natalie Ruiz.  Cognitive load measurement in multimodal interfaces , 2011 .

[27]  Fred Paas,et al.  Comparing apples and oranges? A critical look at research on learning from statics versus animations , 2016, Comput. Educ..

[28]  D. Grossi,et al.  Effects of Age, Education and Sex on Two Tests of Immediate Memory: A Study of Normal Subjects from 20 to 99 Years of Age , 1986, Perceptual and motor skills.

[29]  Wing-Chee So,et al.  Gesture is More Effective than Spatial Language in Encoding Spatial Information , 2015, Quarterly journal of experimental psychology.

[30]  Fred Paas,et al.  Learning from observing hands in static and animated versions of non-manipulative tasks , 2014 .

[31]  Jennifer Wiley,et al.  Sex differences in science learning: Closing the gap through animations , 2010 .

[32]  J. Sweller.  Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load , 2010 .

[33]  D. Uttal,et al.  The malleability of spatial skills: a meta-analysis of training studies. , 2013, Psychological bulletin.

[34]  Peter Gerjets,et al.  Watching corresponding gestures facilitates learning with animations by activating human mirror-neurons: An fNIRS study , 2015 .

[35]  D. Leutner,et al.  Instructional animation versus static pictures: A meta-analysis , 2007 .

[36]  David A. Rettinger,et al.  How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis. , 2001, Journal of experimental psychology. General.

[37]  B. Milner,et al.  Interhemispheric differences in the localization of psychological processes in man. , 1971, British medical bulletin.

[38]  F. Paas,et al.  An Evolutionary Upgrade of Cognitive Load Theory: Using the Human Motor System and Collaboration to Support the Learning of Complex Cognitive Tasks , 2012 .

[39]  Terhi Mustonen,et al.  Mapping the identity of a viewed hand in the motor system: evidence from stimulus-response compatibility. , 2011, Journal of experimental psychology. Human perception and performance.

[40]  Hubert D Zimmer,et al.  Think spatial: the representation in mental rotation is nonvisual. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[41]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Principles for Reducing Extraneous Processing in Multimedia Learning : Coherence, Signaling, Redundancy, Spatial Contiguity, and Temporal Contiguity Principles , 2005 .

[42]  Björn B. de Koning,et al.  Facilitating Understanding of Movements in Dynamic Visualizations: an Embodied Perspective , 2011 .

[43]  Richard K. Lowe.  Extracting information from an animation during complex visual learning , 1999 .

[44]  Richard Catrambone,et al.  Making the abstract concrete: Visualizing mathematical solution procedures , 2006, Comput. Hum. Behav..

[45]  Robert Krikorian,et al.  Corsi Block-Tapping Task Performance as a Function of Path Configuration , 2005, Journal of clinical and experimental neuropsychology.

[46]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[47]  Martin H Fischer,et al.  Please Scroll down for Article the Quarterly Journal of Experimental Psychology Grasp Cueing Shows Obligatory Attention to Action Goals Grasp Cueing Shows Obligatory Attention to Action Goals , 2022 .

[48]  Joachim Wirth,et al.  The role of process information in narrations while learning with animations and static pictures , 2017, Comput. Educ..

[49]  Greg L. West,et al.  Hand position alters vision by biasing processing through different visual pathways , 2012, Cognition.

[50]  Lih-Juan ChanLin.  Formats and prior knowledge on learning in a computer-based lesson , 2001, J. Comput. Assist. Learn..

[51]  Robert K. Atkinson,et al.  Using animations and visual cueing to support learning of scientific concepts and processes , 2011, Comput. Educ..

[52]  Rolf Plötzner,et al.  A systematic characterisation of expository animations , 2012, Comput. Hum. Behav..

[53]  T. Höffler.  Spatial Ability: Its Influence on Learning with Visualizations—a Meta-Analytic Review , 2010 .

[54]  Richard Lowe,et al.  Animation principles in multimedia learning , 2014 .

[55]  Katharina Scheiter,et al.  Learning about locomotion patterns from visualizations: Effects of presentation format and realism , 2011, Comput. Educ..

[56]  Bruce Bridgeman,et al.  Improved change detection with nearby hands , 2011, Experimental Brain Research.

[57]  Paul Chandler,et al.  Effects of Integrated Physical Exercises and Gestures on Preschool Children’s Foreign Language Vocabulary Learning , 2015, Educational Psychology Review.

[58]  Richard E. Mayer,et al.  When graphics improve liking but not learning from online lessons , 2012, Comput. Hum. Behav..

[59]  Ruth N. Schwartz,et al.  Effects of pacing and cognitive style across dynamic and non-dynamic representations , 2011, Comput. Educ..

[60]  Jennifer Wiley,et al.  The role of dynamic spatial ability in geoscience text comprehension , 2014 .

[61]  Alan M. MacEachren,et al.  A Comparison of Animated Maps with Static Small-Multiple Maps for Visually Identifying Space-Time Clusters , 2006 .

[62]  David Lester Neumann,et al.  Sex Differences in Mathematics and Science Achievement: A Meta-Analysis of National Assessment of Educational Progress Assessments. , 2014 .

[63]  Marcia C. Linn,et al.  Can Dynamic Visualizations Improve Middle School Students' Understanding of Energy in Photosynthesis? , 2012 .

[64]  Pierre Feyereisen,et al.  Enactment effects and integration processes in younger and older adults’ memory for actions , 2009, Memory.

[65]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[66]  Fred Paas,et al.  The Potential of Embodied Cognition to Improve STEAM Instructional Dynamic Visualizations , 2015 .

[67]  Jay Pratt,et al.  Altered visual perception near the hands: A critical review of attentional and neurophysiological models , 2015, Neuroscience & Biobehavioral Reviews.

[68]  John Sweller,et al.  The Redundancy Principle in Multimedia Learning , 2005, The Cambridge Handbook of Multimedia Learning.

[69]  Fred Paas,et al.  Gender Effects When Learning Manipulative Tasks From Instructional Animations and Static Presentations , 2015, J. Educ. Technol. Soc..

[70]  R. Mayer,et al.  How Seductive Details Do Their Damage: A Theory of Cognitive Interest in Science Learning , 1998 .

[71]  John B. Black,et al.  Direct manipulation is better than passive viewing for learning anatomy in a three-dimensional virtual reality environment , 2017, Comput. Educ..

[72]  Eyad Elyan,et al.  The cognitive benefits of dynamic representations in the acquisition of spatial navigation skills , 2014, Comput. Hum. Behav..

[73]  M. S. Masters,et al.  The gender difference on the Mental Rotations test is not due to performance factors , 1998, Memory & cognition.

[74]  M. Hegarty.  Mental animation: inferring motion from static displays of mechanical systems. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[75]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..