Communicating common ground: How mutually shared knowledge influences speech and gesture in a narrative task

Much research has been carried out into the effects of mutually shared knowledge (or common ground) on verbal language use. This present study investigates how common ground affects human communication when regarding language as consisting of both speech and gesture. A semantic feature approach was used to capture the range of information represented in speech and gesture. Overall, utterances were found to contain less semantic information when interlocutors had mutually shared knowledge, even when the information represented in both modalities, speech and gesture, was considered. However, when considering the gestures on their own, it was found that they represented only marginally less information. The findings also show that speakers gesture at a higher rate when common ground exists. It appears therefore that gestures play an important communicational function, even when speakers convey information which is already known to their addressee.

[1]  H. H. Clark,et al.  Speaking while monitoring addressees for understanding , 2004 .

[2]  Brian Butterworth,et al.  Hesitation and semantic planning in speech , 1975 .

[3]  Stefan Kopp,et al.  Verbal or Visual? How Information is Distributed across Speech and Gesture in Spatial Dialog , 2006 .

[4]  Adam Kendon,et al.  Language and Gesture: Language and gesture: unity or duality? , 2000 .

[5]  M. Alibali,et al.  Effects of Visibility between Speaker and Listener on Gesture Production: Some Gestures Are Meant to Be Seen , 2001 .

[6]  D. McNeill.  So you think gestures are nonverbal , 1985 .

[7]  Siobhan Chapman.  Logic and Conversation , 2005 .

[8]  H. H. Clark,et al.  References in Conversation Between Experts and Novices , 1987 .

[9]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[10]  Janet Beavin Bavelas,et al.  Linguistic influences on gesture’s form , 2005 .

[11]  Mary Ritchie Key,et al.  The Relationship of Verbal and Nonverbal Communication , 1980 .

[12]  D. Laplane.  Thought and language. , 1992, Behavioural neurology.

[13]  K. Pine,et al.  The effects of prohibiting gestures on children's lexical retrieval ability. , 2007, Developmental science.

[14]  B. Butterworth,et al.  Gesture, speech, and computational stages: a reply to McNeill. , 1989, Psychological review.

[15]  D. McNeill.  Gesture and Thought , 2005 .

[16]  GEOFFREY BEATTIE,et al.  Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? An experimental investigation , 1999 .

[17]  Marianne Gullberg,et al.  Handling Discourse: Gestures, Reference Tracking, and Communication Strategies in Early L2 , 2006 .

[18]  Judith Holler,et al.  How iconic gestures and speech interact in the representation of meaning: Are both aspects really integral to the process? , 2003 .

[19]  J. D. Ruiter.  The production of gesture and speech , 2000 .

[20]  Judith Holler,et al.  The interaction of iconic gesture and speech , 2004 .

[21]  Philip R. Cohen,et al.  Referring as a Collaborative Process , 2003 .

[22]  N. Freedman.  Hands, Words, and Mind: On the Structuralization of Body Movements During Discourse and the Capacity for Verbal Representation , 1977 .

[23]  R. Krauss,et al.  Do conversational hand gestures communicate? , 1991, Journal of personality and social psychology.

[24]  Asli Ozyurek.  Do Speakers Design Their Cospeech Gestures for Their Addressees? The Effects of Addressee Location on Representational Gestures , 2002 .

[25]  Judith Holler,et al.  A micro-analytic investigation of how iconic gestures and speech represent core semantic features in talk , 2002 .

[26]  B. Keysar,et al.  When do speakers take into account common ground? , 1996, Cognition.

[27]  A. Leroi‐Gourhan,et al.  Gesture and Speech , 1993 .

[28]  Yihsiu Chen,et al.  Language and Gesture: Lexical gestures and lexical access: a process model , 2000 .

[29]  J. Holler,et al.  The Effect of Common Ground on How Speakers Use Gesture and Speech to Represent Size Information , 2007 .

[30]  N. Furuyama.  Language and Gesture: Gestural interaction between the instructor and the learner in origami instruction , 2000 .

[31]  H. Garfinkel.  Studies in Ethnomethodology , 1968 .

[32]  Herbert H. Clark,et al.  Contributing to Discourse , 1989, Cogn. Sci..

[33]  Judith Holler,et al.  The Interaction of Iconic Gesture and Speech in Talk , 2003, Gesture Workshop.

[34]  Asli Ozyurek,et al.  The influence of addressee location on spatial language and representational gestures of direction , 2000 .

[35]  Martha W. Alibali,et al.  I see it in my hands’ eye: Representational gestures reflect conceptual demands , 2007 .

[36]  Susan R. Fussell,et al.  The effects of intended audience on message production and comprehension: Reference in a common ground framework , 1989 .

[37]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[38]  Sotaro Kita,et al.  What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking , 2003 .

[39]  Janet Beavin Bavelas,et al.  An experimental study of when and how speakers use gestures to communicate , 2002 .

[40]  Susan R. Fussell,et al.  Coordination of knowledge in communication: effects of speakers' assumptions about what others know. , 1992, Journal of personality and social psychology.

[41]  M. Studdert-Kennedy.  Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[42]  G. Beattie,et al.  Gestures, pauses and speech: An experimental investigation of the effects of changing social context on their precise temporal relationships , 2009 .

[43]  J. D. Ruiter,et al.  Primary and secondary pragmatic functions of pointing gestures , 2007 .

[44]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[45]  Heather Shovelton,et al.  Mapping the Range of Information Contained in the Iconic Hand Gestures that Accompany Spontaneous Speech , 1999 .

[46]  J. Holler,et al.  Gesture use in social interaction: how speakers' gestures can reflect listeners' thinking. , 2007 .

[47]  A. Kendon.  Gesticulation and Speech: Two Aspects of the Process of Utterance , 1981 .

[48]  Geoffrey Beattie,et al.  An experimental investigation of the role of different types of iconic gesture in communication: A semantic feature approach , 2003 .