Gestures, but not meaningless movements, lighten working memory load when explaining math

Gesturing is ubiquitous in communication and serves an important function for listeners, who are able to glean meaningful information from the gestures they see. But gesturing also functions for speakers, whose own gestures reduce demands on their working memory. Here we ask whether gesture's beneficial effects on working memory stem from its properties as a rhythmic movement, or as a vehicle for representing meaning. We asked speakers to remember letters while explaining their solutions to math problems and producing varying types of movements. Speakers recalled significantly more letters when producing movements that coordinated with the meaning of the accompanying speech, i.e., when gesturing, than when producing meaningless movements or no movement. The beneficial effects that accrue to speakers when gesturing thus seem to stem not merely from the fact that their hands are moving, but from the fact that their hands are moving in coordination with the content of speech.

[1]  S. Goldin-Meadow,et al.  Making children gesture brings out implicit knowledge and leads to learning. , 2007, Journal of experimental psychology. General.

[2]  Rolf A. Zwaan,et al.  Language Comprehenders Mentally Represent the Shapes of Objects , 2002, Psychological science.

[3]  G. Lakoff,et al.  Where mathematics comes from : how the embodied mind brings mathematics into being , 2002 .

[4]  R. Krauss Why Do We Gesture When We Speak? , 1998 .

[5]  Matthew Flatt,et al.  PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers , 1993 .

[6]  Susan Goldin-Meadow,et al.  Action’s Influence on Thought: The Case of Gesture , 2010, Perspectives on psychological science : a journal of the Association for Psychological Science.

[7]  S. Goldin-Meadow,et al.  Why people gesture when they speak , 1998, Nature.

[8]  R. Guttentag,et al.  THE EFFECTS OF RESTRICTING HAND GESTURE PRODUCTION ON LEXICAL RETRIEVAL AND FREE RECALL , 1998 .

[9]  S. Kita,et al.  Spontaneous gestures during mental rotation tasks: insights into the microdevelopment of the motor strategy. , 2008, Journal of experimental psychology. General.

[10]  Simon Heywood,et al.  The effects of elimination of hand gestures and of verbal codability on speech performance , 1975 .

[11]  Rolf A. Zwaan,et al.  Moving words: dynamic representations in language comprehension , 2004 .

[12]  Heather Shovelton,et al.  Mapping the Range of Information Contained in the Iconic Hand Gestures that Accompany Spontaneous Speech , 1999 .

[13]  S Goldin-Meadow,et al.  What's communication got to do with it? Gesture in children blind from birth. , 1997, Developmental psychology.

[14]  L A Thompson,et al.  Evaluation and integration of speech and pointing gestures during referential understanding. , 1986, Journal of experimental child psychology.

[15]  P. Goolkasian,et al.  Bimodal format effects in working memory. , 2005, The American journal of psychology.

[16]  R. Krauss,et al.  Gesture, Speech, and Lexical Access: The Role of Lexical Movements in Speech Production , 1996 .

[17]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[18]  J. Whitall On the interaction of concurrent verbal and manual tasks: which initial task conditions produce interference? , 1996, Research quarterly for exercise and sport.

[19]  Michael T. Turvey,et al.  Concurrent Cognitive Task Modulates Coordination Dynamics , 2005, Cogn. Sci..

[20]  Susan Goldin-Meadow,et al.  From children's hands to adults' ears: gesture's role in the learning process. , 2003, Developmental psychology.

[21]  Pierre Feyereisen,et al.  Further investigation on the mnemonic effect of gestures: Their meaning matters , 2006 .

[22]  Susan M. Wagner,et al.  Probing the Mental Representation of Gesture: Is Handwaving Spatial?. , 2004 .

[23]  M. Alibali,et al.  Do you have to be right to redescribe? , 1994, Behavioral and Brain Sciences.

[24]  S Goldin-Meadow,et al.  Silence is liberating: removing the handcuffs on grammatical expression in the manual modality. , 1996, Psychological review.

[25]  S. Goldin-Meadow,et al.  Gesturing makes learning last , 2008, Cognition.

[26]  E. Klima The signs of language , 1979 .

[27]  A. Paivio,et al.  Cognitive and emotional determinants of speech. , 1968, Canadian journal of psychology.

[28]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[29]  Susan Goldin-Meadow,et al.  The role of gesture and mimetic representation in making language the province of speech. , 1999 .

[30]  Susan Goldin-Meadow,et al.  Gestures convey substantive information about a child’s thoughts to ordinary listeners , 1999 .

[31]  S. Ravizza,et al.  Movement and lexical access: Do noniconic gestures aid in retrieval? , 2003, Psychonomic bulletin & review.

[32]  H. Nusbaum,et al.  Analog acoustic expression in speech communication , 2006 .

[33]  D. McNeill,et al.  Speech-gesture mismatches: Evidence for one underlying representation of linguistic and nonlinguistic information , 1998 .

[34]  James E. Driskell,et al.  The Effect of Gesture on Speech Production and Comprehension , 2003, Hum. Factors.

[35]  S. Goldin-Meadow,et al.  Hearing Gesture: How Our Hands Help Us Think , 2003 .

[36]  S. Goldin-Meadow,et al.  Gesturing Gives Children New Ideas About Math , 2009, Psychological science.

[37]  Sian L. Beilock,et al.  Gesture Changes Thought by Grounding It in Action , 2010, Psychological science.

[38]  R. Engle Working Memory Capacity as Executive Attention , 2002 .

[39]  M. Studdert-Kennedy Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[40]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[41]  Karen Emmorey,et al.  Do signers gesture , 1999 .

[42]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[43]  SIGNED AND SPOKEN LANGUAGE - BIOLOGICAL CONSTRAINTS ON LINGUISTIC FORM - BELLUGI,U, STUDDERTKENNEDY,M , 1982 .

[44]  S. Goldin-Meadow,et al.  The resilience of gesture in talk: gesture in blind speakers and listeners , 2001 .

[45]  Margaret Gwendoline Riseborough,et al.  Physiographic gestures as decoding facilitators: Three experiments exploring a neglected facet of communication , 1981 .

[46]  Andrew R. A. Conway,et al.  On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes , 2005, Cognitive Psychology.

[47]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[48]  Susan Goldin-Meadow,et al.  Gesturing Saves Cognitive Resources When Talking About Nonpresent Objects , 2010, Cogn. Sci..

[49]  G. Hammond,et al.  Mutual interactions between speech and finger movements. , 1987, Journal of motor behavior.

[50]  Paul Treffner,et al.  Intentional and attentional dynamics of speech-hand coordination. , 2002, Human movement science.

[51]  Michael Studdert-Kennedy,et al.  Signed and spoken language--biological constraints on linguistic form : report of the Dahlem Workshop on Sign Language and Spoken Language--Biological Constraints on Linguistic Form, Berlin 1980, March 24-28 , 1980 .