The Role of Gestures in Mental Animation

We examined the use of hand gestures while people solved spatial reasoning problem in which they had to infer motion from static diagrams (mental animation problems). In Experiment 1, participants were asked to think aloud while solving mental animation problems. They gestured on more than 90% of problems, and most gestures expressed information about the component motions that was not stated in words. Two further experiments examined whether the gestures functioned in the mechanical inference process, or whether they merely served functions of expressing or communicating the results of this process. In these experiments, we examined the effects of instructions to think aloud, restricting participants' hand motions, and secondary tasks on mental animation performance. Although participants who were instructed to think aloud gestured more than control groups, some gestures occurred even in control conditions. A concurrent spatial tapping task impaired performance on mechanical reasoning, whereas a simple tapping task and restricting hand motions did not. These results indicate that gestures are a natural way of expressing the results of mental animation processes and suggest that spatial working memory and premotor representations are involved in mental animation. They provide no direct evidence that gestures are functional in the thought process itself, but do not rule out a role for overt gestures in this type of spatial thinking.

[1]  G. S. Hanna Differential Aptitude Tests. , 1974 .

[2]  Martha W. Alibali,et al.  Gesture in Spatial Cognition: Expressing, Communicating, and Thinking About Spatial Information , 2005, Spatial Cogn. Comput..

[3]  M. Studdert-Kennedy Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[4]  R. Krauss,et al.  PSYCHOLOGICAL SCIENCE Research Article GESTURE, SPEECH, AND LEXICAL ACCESS: The Role of Lexical Movements in Speech Production , 2022 .

[5]  Susan Goldin-Meadow,et al.  Illuminating Mental Representations Through Speech and Gesture , 1999 .

[6]  K. Emmorey,et al.  Gesture, Thought, and Spatial Language , 2001 .

[7]  Susan Goldin-Meadow,et al.  Gesture offers insight into problem-solving in adults and children , 2002, Cogn. Sci..

[8]  Sotaro Kita,et al.  What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking , 2003 .

[9]  A. Wohlschläger,et al.  Mental and manual rotation. , 1998, Journal of experimental psychology. Human perception and performance.

[10]  D. Schwartz,et al.  Tool use and the effect of action on the imagination. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[11]  M. Alibali,et al.  Effects of Visibility between Speaker and Listener on Gesture Production: Some Gestures Are Meant to Be Seen , 2001 .

[12]  M M Smyth,et al.  Working Memory for Movements , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[13]  Adam Kendon,et al.  Language and Gesture: Language and gesture: unity or duality? , 2000 .

[14]  Jennifer M. Shephard,et al.  Imagined rotations of self versus objects: an fMRI study , 2005, Neuropsychologia.

[15]  Daniel L. Schwartz,et al.  Analog Imagery in Mental Model Reasoning: Depictive Models , 1996, Cognitive Psychology.

[16]  S. Kosslyn Image and Brain: The Resolution of the Imagery Debate , 1994, Journal of Cognitive Neuroscience.

[17]  J. G. Quinn,et al.  Movement and Attention in Visual Working Memory , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[18]  M. Hegarty Mechanical reasoning by mental simulation , 2004, Trends in Cognitive Sciences.

[19]  M. Smyth,et al.  Movement and Working Memory: Patterns and Positions in Space , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[20]  Daniel L. Schwartz,et al.  Shuttling Between Depictive Models and Abstract Rules: Induction and Fallback , 1996, Cogn. Sci..

[21]  M Hegarty,et al.  Mental animation in the visuospatial sketchpad: Evidence from dual-task studies , 1997, Memory & cognition.

[22]  M. Hegarty,et al.  Individual differences in mental animation during mechanical reasoning , 1994, Memory & cognition.

[23]  M. Hegarty Mental animation: inferring motion from static displays of mechanical systems. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[24]  E. Farmer,et al.  Evidence for a Visuo-Spatial Scratch-Pad in Working Memory , 1986 .

[25]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[26]  M. Alibali,et al.  Transitions in concept acquisition: using the hand to read the mind. , 1993, Psychological review.

[27]  Sotaro Kita,et al.  How representational gestures help speaking , 2000 .

[28]  S. Kosslyn,et al.  Motor processes in mental rotation , 1998, Cognition.