Gestures in Instructional Animations: A Helping Hand to Understanding Non-human Movements?

Summary Recent research on dynamic visualizations suggests that these visualizations are effective for learning human movements such as knot tying or paper folding. Using embodied theories of cognition, this study investigated whether learning non-human movements from a dynamic visualization can also be enhanced by grounding these movements in the learner's motor system. University students viewed an animation on lightning formation, and followed the animation's movements with gestures, saw an on-screen human hand follow the movements or saw an arrow follow the movements. Results showed that observing an on-screen human hand following the movements in the animation, but not actually performing these movements, enhanced retention and transfer performance compared with watching the animation without gestures. This suggests that observation of human hand movement in animation-based instruction, which plays an important role in learning of procedural-motor tasks, can also improve people's learning from other dynamic systems. Copyright © 2013 John Wiley & Sons, Ltd.

[1]  Susan Goldin-Meadow,et al.  Illuminating Mental Representations Through Speech and Gesture , 1999 .

[2]  John Sweller,et al.  Instructional animations can be superior to statics when learning human motor skills , 2009, Comput. Hum. Behav..

[3]  Á. Pascual-Leone,et al.  Motor facilitation while observing hand actions: specificity of the effect and role of observer's orientation. , 2002, Journal of neurophysiology.

[4]  Wolff‐Michael Roth,et al.  From activity to gestures and scientific language , 2001 .

[5]  Arthur M. Glenberg,et al.  Improving Native American children's listening comprehension through concrete representations. , 2007 .

[6]  Cheryl I. Johnson,et al.  A Testing Effect with Multimedia Learning , 2009 .

[7]  M. Alibali,et al.  Gesture-Speech Mismatch and Mechanisms of Learning: What the Hands Reveal about a Child′s State of Mind , 1993, Cognitive Psychology.

[8]  Autumn B. Hostetter,et al.  When do gestures communicate? A meta-analysis. , 2011, Psychological bulletin.

[9]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[10]  L. Fadiga,et al.  Active perception: sensorimotor circuits as a cortical basis for language , 2010, Nature Reviews Neuroscience.

[11]  M. Louwerse,et al.  The linguistic and embodied nature of conceptual processing , 2010, Cognition.

[12]  G. Kuhn,et al.  Look away! Eyes and arrows engage oculomotor responses automatically , 2009, Attention, perception & psychophysics.

[13]  D. Leutner,et al.  Instructional animation versus static pictures: A meta-analysis , 2007 .

[14]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[15]  Alejandro Lleras,et al.  Swinging into thought: Directed movement guides insight in problem solving , 2009, Psychonomic bulletin & review.

[16]  F. Paas,et al.  Towards a Framework for Attention Cueing in Instructional Animations: Guidelines for Research and Design , 2009 .

[17]  Susan Goldin-Meadow,et al.  Doing gesture promotes learning a mental transformation task better than seeing gesture. , 2012, Developmental science.

[18]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[19]  Lawrence W. Barsalou,et al.  Language and simulation in conceptual processing , 2008 .

[20]  Michael P. Kaschak,et al.  Activity and Imagined Activity Can Enhance Young Children's Reading Comprehension. , 2004 .

[21]  T. Hodgson,et al.  Giving Subjects the Eye and Showing Them the Finger: Socio-Biological Cues and Saccade Generation in the Anti-Saccade Task , 2012, Perception.

[22]  Björn B. de Koning,et al.  Facilitating Understanding of Movements in Dynamic Visualizations: an Embodied Perspective , 2011 .

[23]  Koen Lamberts,et al.  The encoding–retrieval relationship: retrieval as mental simulation , 2008, Trends in Cognitive Sciences.

[24]  John Sweller,et al.  The Mirror Neuron System and Observational Learning: Implications for the Effectiveness of Dynamic Visualizations , 2009 .

[25]  Neil W. Mulligan,et al.  Enactment and retrieval , 2010, Memory & cognition.

[26]  Jay Pratt,et al.  It’s Alive! , 2010, Psychological science.

[27]  Susan Goldin-Meadow,et al.  Children Learn When Their Teacher's Gestures and Speech Differ , 2005, Psychological science.

[28]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[29]  S. Goldin-Meadow,et al.  Gesturing makes learning last , 2008, Cognition.

[30]  S. Goldin-Meadow,et al.  Making children gesture brings out implicit knowledge and leads to learning. , 2007, Journal of experimental psychology. General.