Joint Action, Interactive Alignment, and Dialog

Dialog is a joint action at different levels. At the highest level, the goal of interlocutors is to align their mental representations. This emerges from joint activity at lower levels, both concerned with linguistic decisions (e.g., choice of words) and nonlinguistic processes (e.g., alignment of posture or speech rate). Because of the high-level goal, the interlocutors are particularly concerned with close coupling at these lower levels. As we illustrate with examples, this means that imitation and entrainment are particularly pronounced during interactive communication. We then argue that the mechanisms underlying such processes involve covert imitation of interlocutors' communicative behavior, leading to emulation of their expected behavior. In other words, communication provides a very good example of predictive emulation, in a way that leads to successful joint activity.

[1]  S. Garrod,et al.  Saying what you mean in dialogue: A study in conceptual and semantic co-ordination , 1987, Cognition.

[2]  Colin M. Brown,et al.  Anticipating upcoming words in discourse: evidence from ERPs and reading times. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Steven H. Lewis,et al.  Listener Responsiveness and the Coordination of Conversation , 1982 .

[4]  H. H. Clark,et al.  Conceptual pacts and lexical choice in conversation. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[5]  Robert J. Hartsuiker,et al.  Is Syntax Separate or Shared Between Languages , 2004 .

[6]  Sarah Brown-Schmidt,et al.  Real-Time Investigation of Referential Domains in Unscripted Conversation: A Targeted Language Game Approach , 2008, Cogn. Sci..

[7]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[8]  Per Linell,et al.  Approaching Dialogue: Talk, Interaction and Contexts in Dialogical Perspectives , 1998 .

[9]  Daniel C. Richardson,et al.  Looking To Understand: The Coupling Between Speakers' and Listeners' Eye Movements and Its Relationship to Discourse Comprehension , 2005, Cogn. Sci..

[10]  S. Goldinger Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[11]  Michael J. Richardson,et al.  Rocking together: dynamics of intentional and unintentional interpersonal coordination. , 2007, Human movement science.

[12]  Kara D. Federmeier Thinking ahead: the role and roots of prediction in language comprehension. , 2007, Psychophysiology.

[13]  G. Dell,et al.  Persistent structural priming from language comprehension to language production , 2007, Cognition.

[14]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[15]  H. H. Clark,et al.  Using uh and um in spontaneous speaking , 2002, Cognition.

[16]  E. Goffman,et al.  Forms of talk , 1982 .

[17]  H. Giles,et al.  Accommodation theory: Communication, context, and consequence. , 1991 .

[18]  M. Pickering,et al.  Is Syntax Separate or Shared Between Languages? , 2004, Psychological science.

[19]  Kara D. Federmeier,et al.  Right words and left words: electrophysiological evidence for hemispheric differences in meaning processing. , 1999, Brain research. Cognitive brain research.

[20]  Alexandra A. Cleland,et al.  The use of lexical and syntactic information in language production: Evidence from the priming of noun-phrase structure , 2003 .

[21]  Alexandra A. Cleland,et al.  Syntactic alignment and participant role in dialogue , 2007, Cognition.

[22]  G. Altmann,et al.  The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye-movements , 2003 .

[23]  T. Paus,et al.  Modulation of Motor Excitability during Speech Perception: The Role of Broca's Area , 2004, Journal of Cognitive Neuroscience.

[24]  Louis ten Bosch,et al.  Durational Aspects of Turn-Taking in Spontaneous Face-to-Face and Telephone Dialogues , 2004, TSD.

[25]  M. Kutas,et al.  Anticipating Words and Their Gender: An Event-related Brain Potential Study of Semantic Integration, Gender Expectancy, and Gender Agreement in Spanish Sentence Reading , 2004, Journal of Cognitive Neuroscience.

[26]  W. Prinz A common-coding approach to perception and action , 1990 .

[27]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[28]  Roderick Murray-Smith,et al.  Gait alignment in mobile phone conversations , 2007, Mobile HCI.

[29]  Matthew W. Crocker,et al.  The influence of the immediate visual context on incremental thematic role-assignment: evidence from eye-movements in depicted events , 2005, Cognition.

[30]  M. Pickering,et al.  Why is conversation so easy? , 2004, Trends in Cognitive Sciences.

[31]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[32]  C. Fowler,et al.  Rapid access to speech gestures in perception: Evidence from choice and simple response time tasks. , 2003, Journal of memory and language.

[33]  Alexandra A. Cleland,et al.  Syntactic co-ordination in dialogue , 2000, Cognition.

[34]  Katherine A. DeLong,et al.  Probabilistic word pre-activation during language comprehension inferred from electrical brain activity , 2005, Nature Neuroscience.

[35]  Jan-Peter de Holger N. J. Ruiter,et al.  Projecting the End of a Speaker's Turn: A Cognitive Cornerstone of Conversation , 2006 .

[36]  M. Pickering,et al.  Do people use language production to make predictions during comprehension? , 2007, Trends in Cognitive Sciences.

[37]  Friedemann Pulvermüller,et al.  Motor cortex maps articulatory features of speech sounds , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[38]  G. Rizzolatti,et al.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study , 2002, The European journal of neuroscience.

[39]  Daniel C. Richardson,et al.  The Art of Conversation Is Coordination , 2007, Psychological science.

[40]  Margaret Wilson,et al.  An oscillator model of the timing of turn-taking , 2005, Psychonomic bulletin & review.

[41]  T. Paus,et al.  Seeing and hearing speech excites the motor system involved in speech production , 2003, Neuropsychologia.

[42]  J. Bavelas,et al.  Listeners as co-narrators. , 2000, Journal of personality and social psychology.

[43]  K. Shockley,et al.  Mutual interpersonal postural constraints are involved in cooperative conversation. , 2003, Journal of experimental psychology. Human perception and performance.

[44]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[45]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[46]  M. Pickering,et al.  Alignment in dialogue , 2007 .

[47]  G. Altmann,et al.  Incremental interpretation at verbs: restricting the domain of subsequent reference , 1999, Cognition.

[48]  Jean E. Fox Tree,et al.  Pronouncing “the” as “thee” to signal problems in speaking , 1997, Cognition.

[49]  A. Markman,et al.  Referential communication and category acquisition. , 1998, Journal of experimental psychology. General.

[50]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.