Gesture is More Effective than Spatial Language in Encoding Spatial Information

The present research investigates whether producing gestures with and without speech facilitates route learning at different levels of route complexity and in learners with different levels of spatial skills. It also examines whether the facilitation effect of gesture is stronger than that of spatial language. Adults studied routes with 10, 13, and 16 steps and reconstructed them with sticks, either without rehearsal or after rehearsal by producing gestures with speech, gestures alone, or speech only. For all levels of route complexity and spatial skills, participants who were encouraged to gesture (with or without speech) during rehearsal had the best recall. Additionally, we found that number of steps rehearsed in gesture, but not that rehearsed in speech, predicted the recall accuracy. Thus, gesture is more effective than spatial language in encoding spatial information, and thereby enhancing spatial recall. These results further corroborate the beneficial nature of gesture in processing spatial information.

[1]  Mary Hegarty,et al.  The Role of Gestures in Mental Animation , 2005, Spatial Cogn. Comput..

[2]  Tad T. Brunyé,et al.  Representational flexibility and specificity following spatial descriptions of real-world environments , 2008, Cognition.

[3]  R. Kessels,et al.  Spatial memory impairment in patients after tumour resection: evidence for a double dissociation , 2000, Journal of neurology, neurosurgery, and psychiatry.

[4]  M. Coltheart,et al.  The quarterly journal of experimental psychology , 1985 .

[5]  D. Grossi,et al.  Effects of Age, Education and Sex on Two Tests of Immediate Memory: A Study of Normal Subjects from 20 to 99 Years of Age , 1986, Perceptual and motor skills.

[6]  R Wesp,et al.  Gestures maintain spatial imagery. , 2001, The American journal of psychology.

[7]  S. Levinson.  Space in language and cognition: Explorations in cognitive diversity , 2003 .

[8]  Susan Goldin-Meadow,et al.  Using the Hands to Identify Who Does What to Whom: Gesture and Speech Go Hand-in-Hand , 2009, Cogn. Sci..

[9]  S. Goldin-Meadow,et al.  Learning what children know about space from looking at their hands: the added value of gesture in spatial communication. , 2012, Journal of experimental child psychology.

[10]  S. Kita,et al.  Spontaneous gestures during mental rotation tasks: insights into the microdevelopment of the motor strategy. , 2008, Journal of experimental psychology. General.

[11]  C. Smith.  The emergence of ‘maps’ in European rock art: A prehistoric preoccupation with place 1 , 1982 .

[12]  Susan Goldin-Meadow,et al.  A word in the hand: action, gesture and mental representation in humans and non-human primates , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  Karen Emmorey,et al.  Using space to describe space: Perspective in speech, sign, and gesture , 2000, Spatial Cogn. Comput..

[14]  Ruth B. Ekstrom,et al.  Manual for kit of factor-referenced cognitive tests , 1976 .

[15]  Diana Adler,et al.  Using Multivariate Statistics , 2016 .

[16]  David H. Uttal,et al.  Comprehending and Learning from ‘Visualizations’: A Developmental Perspective , 2008 .

[17]  Stacy B. Ehrlich,et al.  The importance of gesture in children's spatial reasoning. , 2006, Developmental psychology.

[18]  Kenneth D. Forbus,et al.  Modeling Spatial Ability in Mental Rotation and Paper-Folding , 2013, CogSci.

[19]  S. Kita,et al.  Individual Differences in Frequency and Saliency of Speech-Accompanying Gestures: The Role of Cognitive Abilities and Empathy , 2013, Journal of experimental psychology. General.

[20]  B. Landau,et al.  Interaction between language and vision: It’s momentary, abstract, and it develops , 2013, Cognition.

[21]  M. Studdert-Kennedy.  Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[22]  Karen Emmorey,et al.  Evidence from an emerging sign language reveals that language supports spatial cognition , 2010, Proceedings of the National Academy of Sciences.

[23]  Susan Goldin-Meadow,et al.  The Seeds of Spatial Grammar in the Manual Modality , 2005, Cogn. Sci..

[24]  S. Coakes.  SPSS : analysis without anguish : version 20.0 for Windows , 2017 .

[25]  S. Kita,et al.  The nature of gestures ' beneficial role in spatial problem solving , 2013 .

[26]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[27]  Autumn B. Hostetter,et al.  Visible embodiment: Gestures as simulated action , 2008, Psychonomic bulletin & review.

[28]  D. Gentner,et al.  Relational language and relational thought , 2002 .

[29]  Daniel Y. Kimberg,et al.  Language, perception, and the schematic representation of spatial relations , 2012, Brain and Language.

[30]  M. Linn,et al.  Emergence and characterization of sex differences in spatial ability: a meta-analysis. , 1985, Child development.

[31]  S. Nobe.  Language and Gesture: Where do most spontaneous representational gestures actually occur with respect to speech? , 2000 .

[32]  J. Huttenlocher,et al.  Making Space: The Development of Spatial Representation and Reasoning , 2000 .

[33]  Kenneth D. Forbus,et al.  CogSketch: Sketch Understanding for Cognitive Science Research and for Education , 2011, Top. Cogn. Sci..

[34]  D. McNeill.  Gesture and Thought , 2005 .

[35]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[36]  Y. Agid,et al.  Spatio-Temporal Working Memory and Frontal Lesions in Man * * A subset of this data was presented at the XXVI International Congress of Psychology, Montreal, August 1996. , 1998, Cortex.

[37]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[38]  Martha W. Alibali,et al.  Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production , 2007 .

[39]  E S Johnson,et al.  Developmental patterns of spatial ability: an early sex difference. , 1987, Child development.

[40]  Dedre Gentner,et al.  Spatial language influences memory for spatial scenes , 2007, Memory & cognition.

[41]  D. Gentner,et al.  Relational language and the development of relational mapping , 2005, Cognitive Psychology.

[42]  R. C. Oldfield.  THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[43]  Dedre Gentner,et al.  Spatial Mapping in Preschoolers: Close Comparisons Facilitate Far Mappings , 2001 .

[44]  Wing Chee So,et al.  Producing Gestures Facilitates Route Learning , 2014, PloS one.

[45]  Marianella Casasola,et al.  Learning to form a spatial category of tight-fit relations: how experience with a label can give a boost. , 2009, Developmental psychology.

[46]  Esteban Rossi-Hansberg,et al.  Spatial Development , 2009 .

[47]  Susan M. Wagner,et al.  Probing the Mental Representation of Gesture: Is Handwaving Spatial?. , 2004 .