The Semantic Specificity Hypothesis: When Gestures Do Not Depend Upon the Presence of a Listener

Humans gesture even when their gestures can serve no communicative function (e.g., when the listener cannot see them). This study explores the intrapersonal function of gestures, and the semantic content of the speech they accompany. Sixty-eight adults participated in pairs, communicating on an object description task. Visibility of partner was manipulated; participants completed half the task behind a screen. Participants produced iconic gestures significantly more for praxic items (i.e., items with physically manipulable properties) than non-praxic items, regardless of visibility of partner. These findings support the semantic specificity hypothesis, whereby a gesture is integrally associated with the semantic properties of the word it accompanies. Where those semantic properties include a high motor component the likelihood of a gesture being produced is increased, irrespective of communication demands.

[1]  Roel M. Willems,et al.  Neural evidence for the interplay between language, gesture, and action: A review , 2007, Brain and Language.

[2]  A. Garnham,et al.  The role of conversational hand gestures in a narrative task , 2007 .

[3]  S Goldin-Meadow,et al.  What's communication got to do with it? Gesture in children blind from birth. , 1997, Developmental psychology.

[4]  Ezequiel Morsella,et al.  The role of gestures in spatial working memory and speech. , 2004, The American journal of psychology.

[5]  N. Freedman.  Hands, Words, and Mind: On the Structuralization of Body Movements During Discourse and the Capacity for Verbal Representation , 1977 .

[6]  S. Goldin-Meadow,et al.  Hearing Gesture: How Our Hands Help Us Think , 2003 .

[7]  F. Dick,et al.  Language, gesture, and the developing brain. , 2002, Developmental psychobiology.

[8]  R. Krauss,et al.  PSYCHOLOGICAL SCIENCE Research Article GESTURE, SPEECH, AND LEXICAL ACCESS: The Role of Lexical Movements in Speech Production , 2022 .

[9]  S. Stoness,et al.  Proceedings of the 21st Annual Meeting of the Cognitive Science Society , 1999 .

[10]  GEOFFREY BEATTIE,et al.  Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? An experimental investigation , 1999 .

[11]  Sotaro Kita,et al.  Expressing manner and path in English and Turkish: Differences in speech, gesture, and conceptualization , 2020, Proceedings of the Twenty First Annual Conference of the Cognitive Science Society.

[12]  G. Beattie,et al.  What properties of talk are associated with the generation of spontaneous iconic hand gestures? , 2002, The British journal of social psychology.

[13]  Norbert Freedman,et al.  Communicative structures and psychic structures : a psychoanalytic interpretation of communication , 1977 .

[14]  R Wesp,et al.  Gestures maintain spatial imagery. , 2001, The American journal of psychology.

[15]  David Ostry,et al.  Language rhythms in baby hand movements , 2001, Nature.

[16]  M. Alibali,et al.  Effects of Visibility between Speaker and Listener on Gesture Production: Some Gestures Are Meant to Be Seen , 2001 .

[17]  Pierre Feyereisen,et al.  Mental Imagery and Production of Hand Gestures While Speaking in Younger and Older Adults , 1999 .

[18]  R. Guttentag,et al.  THE EFFECTS OF RESTRICTING HAND GESTURE PRODUCTION ON LEXICAL RETRIEVAL AND FREE RECALL , 1998 .

[19]  Ezequiel Morsella,et al.  Muscular Activity in the Arm during Lexical Retrieval: Implications for Gesture-Speech Theories , 2005, Journal of psycholinguistic research.

[20]  A. Kendon.  Gesticulation and Speech: Two Aspects of the Process of Utterance , 1981 .

[21]  S. Goldin-Meadow,et al.  The mismatch between gesture and speech as an index of transitional knowledge , 1986, Cognition.

[22]  R. Krauss,et al.  The Communicative Value of Conversational Hand Gesture , 1995 .

[23]  N. Freedman,et al.  On the development of communicative competence , 1986 .

[24]  R. Krauss.  Why Do We Gesture When We Speak? , 1998 .

[25]  Jacinta Douglas,et al.  The differential facilitatory effects of gesture and visualisation processes on object naming in aphasia , 2001 .

[26]  Mary Ritchie Key,et al.  The Relationship of Verbal and Nonverbal Communication , 1980 .

[27]  Sotaro Kita,et al.  How representational gestures help speaking , 2000 .

[28]  Alex Martin,et al.  A neural system for learning about object function. , 2006, Cerebral cortex.

[29]  David McNeill,et al.  Language and Gesture: Frontmatter , 2000 .

[30]  K. Pine,et al.  The effects of prohibiting gestures on children's lexical retrieval ability. , 2007, Developmental science.

[31]  Robert M. Krauss,et al.  Gesture and Speech in Spontaneous and Rehearsed Narratives , 1994 .

[32]  D. McNeill.  So you think gestures are nonverbal , 1985 .

[33]  Maurizio Gentilucci,et al.  Please Scroll down for Article the Quarterly Journal of Experimental Psychology Spoken Language and Arm Gestures Are Controlled by the Same Motor Control System , 2022 .