Gesture highlights perceptually present information for speakers

Why do speakers produce gestures? This study tests the hypothesis that gesture facilitates the conceptual planning of speaking, and in particular, gesture promotes thinking about perceptually present information. This view implies that, when gesture is prohibited, people should be less likely to speak about such information. We tested this prediction among children (N = 50) who solved and explained Piagetian conservation tasks. For one set of conservation tasks, all children were allowed to gesture. For a second set of tasks, some children were prohibited from gesturing by wearing a cloth muff. When children were prohibited from gesturing, they expressed more non-present information and less perceptually present information in their explanations than when allowed to gesture. Thus, gesture production appears to highlight or lend salience to perceptually present information. We argue that gesture helps speakers decide what to attend to and therefore what to say.

[1]  Sotaro Kita,et al.  Competing conceptual representations trigger co-speech representational gestures , 2009 .

[2]  Ezequiel Morsella,et al.  The role of gestures in spatial working memory and speech. , 2004, The American journal of psychology.

[3]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[4]  B. Butterworth,et al.  Gesture, speech, and computational stages: a reply to McNeill. , 1989, Psychological review.

[5]  D. McNeill.  Gesture and Thought , 2005 .

[6]  S. Goldin-Meadow,et al.  Making children gesture brings out implicit knowledge and leads to learning. , 2007, Journal of experimental psychology. General.

[7]  M. Jeannerod.  Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[8]  Sotaro Kita,et al.  Conceptualisation load triggers gesture production , 2007 .

[9]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[10]  David I. Anderson,et al.  Travel Broadens the Mind. , 2000, Infancy : the official journal of the International Society on Infant Studies.

[11]  A. Burstein,et al.  Ideational gestures and speech in brain-damaged subjects , 1998 .

[12]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[13]  E. Gibson.  Gibson, James J. , 2006 .

[14]  Sotaro Kita,et al.  How representational gestures help speaking , 2000 .

[15]  R. Ellis,et al.  Micro-affordance: the potentiation of components of action by seen objects. , 2000, British journal of psychology.

[16]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[17]  Martha W. Alibali,et al.  Language, gesture, action! A test of the Gesture as Simulated Action framework , 2010 .

[18]  Bernard Rimé,et al.  Effects of relative immobilization on the speaker's nonverbal behavior and on the dialogue imagery level , 1984 .

[19]  Julia L. Evans,et al.  Understanding conservation delays in children with specific language impairment: task representations revealed in speech and gesture. , 2006, Journal of speech, language, and hearing research : JSLHR.

[20]  A. Kendon.  Do Gestures Communicate? A Review , 1994 .

[21]  Y. Tang,et al.  On the Tip of the Tongue , 2019, Lyric in its Times.

[22]  Daniel C. Richardson,et al.  Grounding Cognition: On the Perceptual-Motor and Image-Schematic Infrastructure of Language , 2005 .

[23]  Autumn B. Hostetter,et al.  Visible embodiment: Gestures as simulated action , 2008, Psychonomic bulletin & review.

[24]  G. Beattie,et al.  An experimental investigation of the role of iconic gestures in lexical access using the tip-of-the-tongue phenomenon. , 1999, British journal of psychology.

[25]  Susan Goldin-Meadow,et al.  Children Learn When Their Teacher's Gestures and Speech Differ , 2005, Psychological science.

[26]  M. Alibali,et al.  Gesture and the process of speech production: We think, therefore we gesture , 2000 .

[27]  S. Goldin-Meadow,et al.  The mismatch between gesture and speech as an index of transitional knowledge , 1986, Cognition.

[28]  Martha W. Alibali,et al.  I see it in my hands’ eye: Representational gestures reflect conceptual demands , 2007 .

[29]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[30]  A. Wohlschläger,et al.  Mental and manual rotation , 1998 .

[31]  Susan Goldin-Meadow,et al.  Transitional knowledge in the acquisition of concepts , 1988 .

[32]  R Wesp,et al.  Gestures maintain spatial imagery. , 2001, The American journal of psychology.

[33]  D. Schacter,et al.  On the Tip of the Tongue An Event-Related fMRI Study of Semantic Retrieval Failure and Cognitive Conflict , 2001, Neuron.

[34]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .

[35]  Martha W. Alibali,et al.  Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production , 2007 .

[36]  Susan Goldin-Meadow,et al.  Illuminating Mental Representations Through Speech and Gesture , 1999 .

[37]  R. Krauss,et al.  Nonverbal Behavior and Nonverbal Communication: What do Conversational Hand Gestures Tell Us? , 1996 .

[38]  R. Guttentag,et al.  THE EFFECTS OF RESTRICTING HAND GESTURE PRODUCTION ON LEXICAL RETRIEVAL AND FREE RECALL , 1998 .

[39]  M. Alibali,et al.  Transitions in concept acquisition: using the hand to read the mind. , 1993, Psychological review.

[40]  GEOFFREY BEATTIE,et al.  Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? An experimental investigation , 1999 .

[41]  Martha W. Alibali,et al.  Divergence of verbal expression and embodied knowledge: Evidence from speech and gesture in children with specific language impairment , 2001 .

[42]  R. Ellis,et al.  On the relations between seen objects and components of potential actions. , 1998, Journal of experimental psychology. Human perception and performance.

[43]  De Ruiter,et al.  Gesture and speech production , 1998 .

[44]  Rolf A. Zwaan,et al.  Grounding Cognition: Introduction to Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thinking , 2005 .

[45]  M. Alibali,et al.  Gesture-Speech Mismatch and Mechanisms of Learning: What the Hands Reveal about a Child′s State of Mind , 1993, Cognitive Psychology.

[46]  Susan Duncan,et al.  Growth points in thinking-for-speaking , 1998 .

[47]  Susan M. Wagner,et al.  Probing the Mental Representation of Gesture: Is Handwaving Spatial?. , 2004 .

[48]  S. Kita,et al.  Spontaneous gestures during mental rotation tasks: insights into the microdevelopment of the motor strategy. , 2008, Journal of experimental psychology. General.

[49]  Simon Heywood,et al.  The effects of elimination of hand gestures and of verbal codability on speech performance , 1975 .

[50]  Roger S. Brown,et al.  The "Tip of the Tongue" Phenomenon , 1966 .

[51]  Daniel L. Schwartz,et al.  Shuttling Between Depictive Models and Abstract Rules: Induction and Fallback , 1996, Cogn. Sci..

[52]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[53]  R. Krauss.  Why Do We Gesture When We Speak? , 1998 .

[54]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[55]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[56]  S. Goldin-Meadow,et al.  Gesturing makes learning last , 2008, Cognition.

[57]  S Goldin-Meadow,et al.  Knowledge conveyed in gesture is not tied to the hands. , 1998, Child development.

[58]  R. Krauss,et al.  PSYCHOLOGICAL SCIENCE Research Article GESTURE, SPEECH, AND LEXICAL ACCESS: The Role of Lexical Movements in Speech Production , 2022 .