Chapter 8 - Two Minds, One Dialog: Coordinating Speaking and Understanding

In this chapter, we consider communication as a joint activity in which two or more interlocutors share or synchronize aspects of their private mental states and act together in the world. We summarize key experimental evidence from our own and others' research on how speakers and addressees take one another into account while they are processing language. Under some circumstances, production and comprehension are adjusted to a partner's perspective or characteristics in the early moments of processing, in a flexible and probabilistic fashion. We advocate studying the coordination and integration of cognitive products and processes both between and within the minds of interlocutors. We then discuss recent evidence from electrophysiology and imaging studies (relevant to Theory of Mind and to mirroring) that has begun to illuminate brain networks that underlie the coordination of joint and individual processing during communication.

[1]  H. Bekkering,et al.  The mirror neuron system is more active during complementary compared with imitative action , 2007, Nature Neuroscience.

[2]  Steven H. Lewis,et al.  Listener Responsiveness and the Coordination of Conversation , 1982 .

[3]  R. Gerrig,et al.  Speakers’ experiences and audience design: knowing when and knowing how to adjust utterances to addressees☆ , 2002 .

[4]  S. Levinson,et al.  Brain Mechanisms Underlying Human Communication , 2009, Front. Hum. Neurosci..

[5]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[6]  Robert M. Krauss,et al.  The Role of the Listener: Addressee Influences on Message Formulation , 1987 .

[7]  Herbert H. Clark,et al.  Managing problems in speaking , 1994, Speech Communication.

[8]  Stephanie Kelter,et al.  Surface form and memory in question answering , 1982, Cognitive Psychology.

[9]  H. H. Clark,et al.  Understanding by addressees and overhearers , 1989, Cognitive Psychology.

[10]  C. Goodwin.  Conversational Organization: Interaction Between Speakers and Hearers , 1981 .

[11]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[12]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[13]  D. Barr,et al.  Anchoring Comprehension in Linguistic Precedents , 2002 .

[14]  Ma Conway,et al.  Handbook of perception and cognition , 1996 .

[15]  S. Krach,et al.  Are women better mindreaders? Sex differences in neural correlates of mentalizing detected with functional MRI , 2009, BMC Neuroscience.

[16]  H. Bekkering,et al.  Executive functioning and imitation: Increasing working memory load facilitates behavioural imitation , 2009, Neuropsychologia.

[17]  Noam Chomsky,et al.  Rules and representations , 1980, Behavioral and Brain Sciences.

[18]  Kathryn Mason,et al.  Word Duration in Monologue and Dialogue Speech , 1994 .

[19]  Jennifer E. Arnold,et al.  If you say thee uh you are describing something hard: the on-line attribution of disfluency during reference comprehension. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[20]  Susan R. Fussell,et al.  Coordination of knowledge in communication: effects of speakers' assumptions about what others know. , 1992, Journal of personality and social psychology.

[21]  K. Zilles,et al.  Mind Reading: Neural Mechanisms of Theory of Mind and Self-Perspective , 2001, NeuroImage.

[22]  Marcel Brass,et al.  The Inhibition of Imitative Response Tendencies , 2001, NeuroImage.

[23]  Norbert Wiener,et al.  Cybernetics: Control and Communication in the Animal and the Machine. , 1949 .

[24]  R Saxe,et al.  People thinking about thinking people The role of the temporo-parietal junction in “theory of mind” , 2003, NeuroImage.

[25]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[26]  Ronald M. Baecker,et al.  Readings in Groupware and Computer-Supported Cooperative Work: Assisting Human-Human Collaboration , 1992 .

[27]  H. H. Clark,et al.  Using uh and um in spontaneous speaking , 2002, Cognition.

[28]  Peter Hagoort,et al.  UvA-DARE (Digital Academic Repository) Unification of speaker and meaning in language comprehension: an fMRI study , 2022 .

[29]  Justina O. Ohaeri,et al.  Why do electronic conversations seem less polite? the costs and benefits of hedging , 1999, WACC.

[30]  S. Brennan,et al.  Collaborative recall in face-to-face and electronic groups , 2008, Memory.

[31]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[32]  M. Tanenhaus,et al.  The effects of common ground and perspective on domains of referential interpretation , 2003 .

[33]  Raymond H. Cuijpers,et al.  Joint Action: Neurocognitive Mechanisms Supporting Human Interaction , 2009, Top. Cogn. Sci..

[34]  D. Barr,et al.  Taking Perspective in Conversation: The Role of Mutual Knowledge in Comprehension , 2000, Psychological science.

[35]  C. Frith,et al.  “Hey John”: Signals Conveying Communicative Intention toward the Self Activate Brain Regions Associated with “Mentalizing,” Regardless of Modality , 2003, The Journal of Neuroscience.

[36]  S. Brennan,et al.  Addressees' needs influence speakers' early syntactic choices , 2002, Psychonomic bulletin & review.

[37]  Ben Shneiderman,et al.  Anthropomorphism: from Eliza to Terminator 2 , 1992, CHI.

[38]  B. Keysar,et al.  When do speakers take into account common ground? , 1996, Cognition.

[39]  Susan R. Fussell,et al.  Accuracy and bias in estimates of others' knowledge , 1991 .

[40]  H. H. Clark,et al.  On the Course of Answering Questions , 1993 .

[41]  S. Brennan,et al.  How Listeners Compensate for Disfluencies in Spontaneous Speech , 2001 .

[42]  C G Harding,et al.  Development of the intention to communicate. , 1982, Human development.

[43]  James K Rilling,et al.  The neural correlates of theory of mind within interpersonal interactions , 2004, NeuroImage.

[44]  E. Bard,et al.  Controlling the Intelligibility of Referring Expressions in Dialogue , 2000 .

[45]  William S. Horton,et al.  Conversational Common Ground and Memory Processes in Language Production , 2005 .

[46]  Natalie Sebanz,et al.  Prediction in Joint Action: What, When, and Where , 2009, Top. Cogn. Sci..

[47]  SUSAN E. BRENNAN,et al.  Conversation with and through computers , 1991, User Modeling and User-Adapted Interaction.

[48]  Frank Van Overwalle,et al.  Please Scroll down for Article Social Neuroscience Erp Time Course and Brain Areas of Spontaneous and Intentional Goal Inferences Erp Time Course and Brain Areas of Spontaneous and Intentional Goal Inferences , 2022 .

[49]  Susan Brennan,et al.  Partner-Specific Adaptation in Dialog , 2009, Top. Cogn. Sci..

[50]  J. Hart,et al.  Memory and the feeling-of-knowing experience. , 1965, Journal of educational psychology.

[51]  Herbert H. Clark,et al.  Contributing to Discourse , 1989, Cogn. Sci..

[52]  F. Machlup,et al.  The Study of Information: Interdisciplinary Messages , 1984 .

[53]  R. Gerrig,et al.  The impact of memory demands on audience design during language production , 2005, Cognition.

[54]  Melinda S. Jensen,et al.  When Three Heads Are Better Than Two , 2006 .

[55]  Masato Fukuda,et al.  Frontopolar activation during face-to-face conversation: An in situ study using near-infrared spectroscopy , 2010, Neuropsychologia.

[56]  S. Brennan,et al.  Speakers' eye gaze disambiguates referring expressions early during face-to-face conversation , 2007 .

[57]  S. Brennan.  Seeking and providing evidence for mutual understanding , 1990 .

[58]  Mary Susan Weldon,et al.  Collective memory: collaborative and individual processes in remembering. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[59]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[60]  Christopher D. Frith,et al.  Imaging the Intentional Stance in a Competitive Game , 2002, NeuroImage.

[61]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[62]  Boaz Keysar,et al.  Unconfounding common ground , 1997 .

[63]  Maryellen C. MacDonald,et al.  Probabilistic constraints and syntactic ambiguity resolution , 1994 .

[64]  Daniel C. Richardson,et al.  Conversation and Coordinative Structures , 2009, Top. Cogn. Sci..

[65]  Michael K. Tanenhaus,et al.  Pragmatic effects on reference resolution in a collaborative task: evidence from eye movements , 2004, Cogn. Sci..

[66]  G. Altmann,et al.  The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing , 2007 .

[67]  Susan R. Fussell,et al.  Understanding friends and strangers: The effects of audience design on message comprehension , 1989 .

[68]  R. Krauss,et al.  Referential communication in nursery school children: method and some preliminary findings. , 1966, Journal of experimental child psychology.

[69]  G. Jefferson.  A Case of Precision Timing in Ordinary Conversation: Overlapped Tag-Positioned Address Terms in Closing Sequences , 1973 .

[70]  Peter Hagoort,et al.  The Neural Integration of Speaker and Message , 2008, Journal of Cognitive Neuroscience.

[71]  Michael J. Reddy.  Metaphor and Thought: The conduit metaphor: A case of frame conflict in our language about language , 1993 .

[72]  A. Hollingshead.  Retrieval processes in transactive memory systems , 1998 .

[73]  Deanna Wilkes-Gibbs.  Collaborative processes of language use in conversation , 1986 .

[74]  H. Walter,et al.  The intentional network: How the brain reads varieties of intentions , 2007, Neuropsychologia.

[75]  M. Brass,et al.  The inhibition of imitative and overlearned responses: a functional double dissociation , 2005, Neuropsychologia.

[76]  Jennifer E. Arnold,et al.  The Old and Thee, uh, New , 2004, Psychological science.

[77]  Arthur G. Samuel,et al.  Articulation Quality Is Inversely Related to Redundancy When Children or Adults Have Verbal Control , 1998 .

[78]  S. Brennan.  Centering Attention in Discourse. , 1995 .

[79]  H. H. Clark,et al.  Conceptual pacts and lexical choice in conversation. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[80]  C. Frith,et al.  Functional imaging of ‘theory of mind’ , 2003, Trends in Cognitive Sciences.

[81]  M. Swerts,et al.  Audiovisual prosody and feeling of knowing , 2005 .

[82]  M. Tomasello,et al.  What's in a manner of speaking? Children's sensitivity to partner-specific referential precedents. , 2010, Developmental psychology.

[83]  Frank Van Overwalle,et al.  Understanding others' actions and goals by mirror and mentalizing systems: A meta-analysis , 2009, NeuroImage.

[84]  Janet E. Cahn,et al.  A Psychological Model of Grounding and Repair in Dialog , 1999 .

[85]  F. Van Overwalle,et al.  Electrophysiological time course and brain areas of spontaneous and intentional trait inferences. , 2007, Social cognitive and affective neuroscience.

[86]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[87]  S. Brown-Schmidt,et al.  The role of executive function in perspective taking during online language comprehension , 2009, Psychonomic bulletin & review.

[88]  F. Binkofski,et al.  Can Machines Think? Interaction and Perspective Taking with Robots Investigated via fMRI , 2008, PloS one.

[89]  V. Yngve.  On getting a word in edgewise , 1970 .

[90]  Timothy S. Paek,et al.  Definite Reference and Mutual Knowledge: Process Models of Common Ground in Comprehension , 1998 .

[91]  J. J. Gibson.  The theory of affordances , 1977 .

[92]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[93]  Daniel B Wright,et al.  Collaborative inhibition is due to the product, not the process, of recalling in groups , 2004, Psychonomic bulletin & review.

[94]  James W. Polichak,et al.  Common ground and everyday language use: comments on Horton and Keysar (1996) , 1998, Cognition.

[95]  Christopher A. Dickinson,et al.  Coordinating cognition: The costs and benefits of shared gaze during collaborative search , 2008, Cognition.

[96]  Sarah Brown-Schmidt,et al.  Addressees distinguish shared from private information when interpreting questions during interactive conversation , 2008, Cognition.

[97]  M. Tanenhaus,et al.  Accent and reference resolution in spoken-language comprehension , 2002 .

[98]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[99]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[100]  S. Brennan,et al.  Attenuating Information in Spoken Communication: For the Speaker, or for the Addressee?. , 2010 .

[101]  Adrian Akmajian,et al.  Linguistics: An Introduction to Language and Communication , 1979 .

[102]  G. Dell,et al.  Adapting production to comprehension: The explicit mention of instruments , 1987, Cognitive Psychology.

[103]  Brian J. Scholl,et al.  Modularity, Development and ‘Theory of Mind’ , 1999 .

[104]  H. H. Clark,et al.  Referring as a collaborative process , 1986, Cognition.

[105]  M. Turvey,et al.  The motor theory of speech perception reviewed , 2006, Psychonomic bulletin & review.

[106]  Celia B. Harris,et al.  Collaborative recall and collective memory: What happens when we remember together? , 2008, Memory.

[107]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[108]  D. Barr,et al.  Perspective-free pragmatics: Broken precedents and the recovery-from-preemption hypothesis , 2007 .

[109]  P. Hagoort,et al.  Neural correlates of pragmatic language comprehension in autism spectrum disorders. , 2009, Brain : a journal of neurology.

[110]  S. Kiesler,et al.  Group decision making and communication technology , 1992 .

[111]  S. Brennan,et al.  THE FEELING OF ANOTHER'S KNOWING : PROSODY AND FILLED PAUSES AS CUES TO LISTENERS ABOUT THE METACOGNITIVE STATES OF SPEAKERS , 1995 .

[112]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[113]  H. H. Clark.  Arenas of language use , 1993 .

[114]  Heather Bortfeld,et al.  Use and acquisition of idiomatic expressions in referring by native and non‐native speakers , 1997 .

[115]  B. Basden,et al.  Costs and benefits of collaborative remembering , 2000 .

[116]  M. F. Schober.  Conversational evidence for rethinking meaning , 1998 .

[117]  Uta Frith,et al.  Theory of mind , 2001, Current Biology.

[118]  C. Fowler,et al.  Talkers' signaling of new and old. words in speech and listeners' perception and use of the distinction , 1987 .

[119]  Anna K. Kuhlen,et al.  Anticipating Distracted Addressees: How Speakers' Expectations and Addressees' Feedback Influence Storytelling , 2010 .

[120]  S. Brennan,et al.  When conceptual pacts are broken: Partner-specific effects on the comprehension of referring expressions , 2003 .

[121]  Gene H. Lerner.  Interaction and grammar: On the “semi-permeable” character of grammatical units in conversation: conditional entry into the turn space of another speaker , 1996 .

[122]  R. Gelman,et al.  The development of communication skills: modifications in the speech of young children as a function of listener. , 1973, Monographs of the Society for Research in Child Development.

[123]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[124]  Günther Knoblich,et al.  From mirroring to joint action , 2008 .

[125]  H. Wimmer,et al.  Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deception , 1983, Cognition.