Gesture and the communicative intention of the speaker

This paper aims to determine whether iconic tracing gestures produced while speaking constitute part of the speaker’s communicative intention. We used a picture description task in which speakers must communicate the spatial and color information of each picture to an interlocutor. By establish ing the necessary minimal content of an intended message, we determined whether speech produced with concurrent gestures is less explicit than speech without gestures. We argue that a gesture must be communicatively intended if it expresses necessary information that was nevertheless omitted from speech. We found that speakers who produced iconic gestures repre senting spatial relations omitted more required spatial information from their descriptions than speakers who did not gesture. These results provide evidence that speakers intend these gestures to communicate. The results have implications for the cognitive architectures that underlie the production of gesture and speech.

[1]  Pierre Feyereisen,et al.  The Meaning of Gestures - What Can Be Understood Without Speech , 1988 .

[2]  R. Krauss,et al.  The Communicative Value of Conversational Hand Gesture , 1995 .

[3]  GEOFFREY BEATTIE,et al.  Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? An experimental investigation , 1999 .

[4]  Sotaro Kita,et al.  Does Gesture Help Processes of Speech Production? Evidence for Conceptual Level Facilitation , 2001 .

[5]  J. D. Ruiter.  The production of gesture and speech , 2000 .

[6]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[7]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[8]  Heather Shovelton,et al.  Mapping the Range of Information Contained in the Iconic Hand Gestures that Accompany Spontaneous Speech , 1999 .

[9]  Yihsiu Chen,et al.  Language and Gesture: Lexical gestures and lexical access: a process model , 2000 .

[10]  M. Argyle,et al.  A Cross-Cultural Study of the Communication of Extra-Verbal Meaning by Gesture , 1975 .

[11]  R. Krauss,et al.  PSYCHOLOGICAL SCIENCE Research Article GESTURE, SPEECH, AND LEXICAL ACCESS: The Role of Lexical Movements in Speech Production , 2022 .

[12]  Heather Shovelton,et al.  An experimental investigation of some properties of individual iconic gestures that mediate their communicative power. , 2002, British journal of psychology.

[13]  Willem J. M. Levelt,et al.  Perspective taking and ellipsis in spatial descriptions , 1996 .

[14]  Sotaro Kita,et al.  How representational gestures help speaking , 2000 .

[15]  D. McNeill,et al.  Speech-gesture mismatches: Evidence for one underlying representation of linguistic and nonlinguistic information , 1998 .

[16]  R. Krauss,et al.  Do conversational hand gestures communicate? , 1991, Journal of personality and social psychology.

[17]  Simon Heywood,et al.  The effects of elimination of hand gestures and of verbal codability on speech performance , 1975 .

[18]  A. Kendon.  Do Gestures Communicate? A Review , 1994 .

[19]  Anne H. Anderson,et al.  Dialogue despite difficulties: a study of communication between aphasic and unimpaired speakers , 1996 .

[20]  Akiba A. Cohen,et al.  The Communicative Functions of Hand I1lustrators , 1977 .

[21]  A. Cohen,et al.  Intentionality in the use of hand illustrators in face-to-face communication situations. , 1973 .

[22]  D. McNeill.  Hand and Mind , 1995 .

[23]  D. McNeill.  So you think gestures are nonverbal , 1985 .

[24]  G. Miller,et al.  Language and Perception , 1976 .

[25]  Janet Beavin Bavelas,et al.  An experimental study of when and how speakers use gestures to communicate , 2002 .

[26]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .