Cognitive skills and gesture–speech redundancy: Formulation difficulty or communicative strategy?

Speakers sometimes convey information in their gestures that they do not convey in the accompanying speech. The present study examined whether individual differences in the production of non-redundant gesture–speech combinations are related to individual differences in speakers’ spatial and verbal skills. We classified speakers as spatial dominant, verbal dominant, or equally matched on the basis of the difference in their performance on a spatial visualization test and a verbal fluency test. We used the coding procedure developed by Alibali et al. (2009) to code speakers’ gesture–speech redundancy as they narrated an animated cartoon. Spatial-dominant speakers produced a higher proportion of non-redundant gesture–speech combinations than other speakers. The results suggest that some speakers may use non-redundant gesture–speech combinations as a communicative strategy that enables them to capitalize on their strong imagistic representations.

[1]  Autumn B Hostetter,et al.  Gesture-speech integration in narrative: Are children less redundant than adults? , 2009, Gesture.

[2]  Sotaro Kita,et al.  What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking , 2003 .

[3]  Susan Duncan,et al.  Growth points in thinking-for-speaking , 1998 .

[4]  Nicholas Christenfeld,et al.  Filled pauses and gestures: It's not coincidence , 1991 .

[5]  Willem J. M. Levelt,et al.  Gesture and the communicative intention of the speaker , 2005 .

[6]  Susan Goldin Hearing gesture : how our hands help us think , 2003 .

[7]  Erik D. Reichle,et al.  The Neural Bases of Strategy and Skill in Sentence–Picture Verification , 2000, Cognitive Psychology.

[8]  S. Goldin-Meadow,et al.  The mismatch between gesture and speech as an index of transitional knowledge , 1986, Cognition.

[9]  D. Kavanagh,et al.  Cognitive assessment in closed head injury : stability, validity and parallel forms for two neuropsychological measures of recovery , 1987 .

[10]  Justine Cassell,et al.  Communicative Effects of Speech-Mismatched Gestures , 1994 .

[11]  Wolff-Michael Roth,et al.  From action to discourse: The bridging function of gestures , 2002, Cognitive Systems Research.

[12]  C. Creider Hand and Mind: What Gestures Reveal about Thought , 1994 .

[13]  Earl Hunt,et al.  Individual Differences in the Verification of Sentence-Picture Relationships , 1978 .

[14]  Simon Heywood,et al.  The effects of elimination of hand gestures and of verbal codability on speech performance , 1975 .

[15]  Martha W. Alibali,et al.  Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production , 2007 .

[16]  D. McNeill Gesture and Thought , 2005 .

[17]  Janet Beavin Bavelas,et al.  Linguistic influences on gesture’s form , 2005 .

[18]  Autumn B. Hostetter,et al.  Visible embodiment: Gestures as simulated action , 2008, Psychonomic bulletin & review.

[19]  Mark Sadoski,et al.  Lexicons, Contexts, Events, and Images: Commentary on From the Perspective of Dual Coding Theory , 2010, Cogn. Sci..

[20]  R. Krauss,et al.  PSYCHOLOGICAL SCIENCE Research Article GESTURE, SPEECH, AND LEXICAL ACCESS: The Role of Lexical Movements in Speech Production , 2022 .

[21]  Melissa Singer,et al.  The Role of Gesture in Meaning Construction , 2008 .

[22]  A. Kendon Gesture: Visible Action as Utterance , 2004 .

[23]  Autumn B. Hostetter,et al.  When do gestures communicate? A meta-analysis. , 2011, Psychological bulletin.

[24]  Albert Postma,et al.  Strategic and automatic components in the processing of linguistic spatial relations. , 2005, Acta psychologica.

[25]  K. Emmorey,et al.  Gesture, Thought, and Spatial Language , 2001 .

[26]  Alex Martin,et al.  Word retrieval to letter and semantic cues: A double dissociation in normal subjects using interference tasks , 1994, Neuropsychologia.

[27]  Earl Hunt,et al.  Strategy choice and strategy training in sentence—picture verification , 1980 .

[28]  Susan Goldin-Meadow,et al.  Assessing knowledge conveyed in gesture : Do teachers have the upper hand ? , 1997 .

[29]  R. Krauss,et al.  The Role of Speech-Related Arm/Hand Gestures in Word Retrieval , 2001 .