Behavior Matching in Multimodal Communication Is Synchronized

A variety of theoretical frameworks predict the resemblance of behaviors between two people engaged in communication, in the form of coordination, mimicry, or alignment. However, little is known about the time course of the behavior matching, even though there is evidence that dyads synchronize oscillatory motions (e.g., postural sway). This study examined the temporal structure of nonoscillatory actions-language, facial, and gestural behaviors-produced during a route communication task. The focus was the temporal relationship between matching behaviors in the interlocutors (e.g., facial behavior in one interlocutor vs. the same facial behavior in the other interlocutor). Cross-recurrence analysis revealed that within each category tested (language, facial, gestural), interlocutors synchronized matching behaviors, at temporal lags short enough to provide imitation of one interlocutor by the other, from one conversational turn to the next. Both social and cognitive variables predicted the degree of temporal organization. These findings suggest that the temporal structure of matching behaviors provides low-level and low-cost resources for human interaction.

[1]  P. Lieberman Some Effects of Semantic and Grammatical Context on the Production and Perception of Speech , 1963 .

[2]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[3]  W. S. Condon,et al.  A segmentation of behavior , 1967 .

[4]  J. T. Webb Subject Speech Rates as a Function of Interviewer Behaviour , 1969, Language and speech.

[5]  E. Schegloff,et al.  Opening up Closings , 1973 .

[6]  H. Giles,et al.  Speech style and social evaluation , 1975 .

[7]  A. Meltzoff,et al.  Imitation of Facial and Manual Gestures by Human Neonates , 1977, Science.

[8]  J. McDowall Interactional Synchrony: A Reappraisal , 1978 .

[9]  P. N. Kugler,et al.  1 On the Concept of Coordinative Structures as Dissipative Structures: I. Theoretical Lines of Convergence* , 1980 .

[10]  P. N. Kugler,et al.  On the concept of coordinative structures as dissipative structures: i , 1980 .

[11]  G. Stelmach,et al.  Tutorials in Motor Behavior , 1980 .

[12]  J. Cappella,et al.  Talk and Silence Sequences in Informal Conversations III: Interspeaker Influence , 1981 .

[13]  G. Miller,et al.  Cognitive science. , 1981, Science.

[14]  S. Garrod,et al.  Saying what you mean in dialogue: A study in conceptual and semantic co-ordination , 1987, Cognition.

[15]  D. Collard,et al.  Trust : making and breaking cooperative relations , 1989 .

[16]  Björn Lindblom,et al.  Explaining Phonetic Variation: A Sketch of the H&H Theory , 1990 .

[17]  N. Luhmann,et al.  Trust: Making and Breaking Cooperative Relations , 1990 .

[18]  Anne H. Anderson,et al.  The Hcrc Map Task Corpus , 1991 .

[19]  H. Giles,et al.  Accommodation theory: Communication, context, and consequence. , 1991 .

[20]  Frank J. Bernieri,et al.  Interpersonal coordination: Behavior matching and interactional synchrony. , 1991 .

[21]  H. Giles,et al.  Contexts of Accommodation , 1993 .

[22]  E. Bard,et al.  The unintelligibility of speech to children: effects of referent availability , 1994, Journal of Child Language.

[23]  Yvonne Rogers,et al.  Distributed cognition: an alternative framework for analysing and explaining collaborative working , 1994, J. Inf. Technol..

[24]  S. Garrod,et al.  Conversation, co-ordination and convention: an empirical investigation of how groups establish linguistic conventions , 1994, Cognition.

[25]  C. Creider Hand and Mind: What Gestures Reveal about Thought , 1994 .

[26]  E. Hatfield,et al.  Emotional Contagion , 1995 .

[27]  E. Hutchins Cognition in the wild , 1995 .

[28]  Gwyneth Doherty-Sneddon,et al.  The Reliability of a Dialogue Structure Coding Scheme , 1997, CL.

[29]  K. Grammer,et al.  The Courtship Dance: Patterns of Nonverbal Synchronization in Opposite-Sex Encounters , 1998 .

[30]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[31]  Alexandra A. Cleland,et al.  Syntactic co-ordination in dialogue , 2000, Cognition.

[32]  F. Strack,et al.  "Mood contagion": the automatic transfer of mood between persons. , 2000, Journal of personality and social psychology.

[33]  J. Bargh,et al.  The perception–behavior expressway: Automatic effects of social perception on social behavior. , 2001 .

[34]  J. Krause,et al.  Mixed-species shoaling in fish: the sensory mechanisms and costs of shoal choice , 2002, Behavioral Ecology and Sociobiology.

[35]  Ramon C. Littell,et al.  SAS for Linear Models , 2002 .

[36]  Thomas E. Myers,et al.  Contagious yawning: the role of self-awareness and mental state attribution. , 2003, Brain research. Cognitive brain research.

[37]  K. Shockley,et al.  Mutual interpersonal postural constraints are involved in cooperative conversation. , 2003, Journal of experimental psychology. Human perception and performance.

[38]  R. Baaren,et al.  Mimicry for money: Behavioral consequences of imitation , 2003 .

[39]  Fernanda Ferreira,et al.  The misinterpretation of noncanonical sentences , 2003, Cognitive Psychology.

[40]  Andrei Popescu-Belis,et al.  What are discourse markers ? , 2003 .

[41]  Heather H. Mitchell,et al.  Toward a Taxonomy of a Set of Discourse Markers in Dialog: A Theoretical and Computational Linguistic Account , 2003 .

[42]  B. Partridge Internal dynamics and the interrelations of fish in schools , 1981, Journal of comparative physiology.

[43]  Alice Turk,et al.  The Smooth Signal Redundancy Hypothesis: A Functional Explanation for Relationships between Redundancy, Prosodic Prominence, and Duration in Spontaneous Speech , 2004, Language and speech.

[44]  M. Pickering,et al.  Towards a mechanistic theory of dialog , 2004 .

[45]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[46]  S Hurley,et al.  Perspectives on Imitation , 2004 .

[47]  J. Bailenson,et al.  Digital Chameleons , 2005, Psychological science.

[48]  Daniel C. Richardson,et al.  Looking To Understand: The Coupling Between Speakers' and Listeners' Eye Movements and Its Relationship to Discourse Comprehension , 2005, Cogn. Sci..

[49]  T. Chartrand,et al.  Beyond the Perception-Behavior Link: The Ubiquitous Utility and Motivational Moderators of Nonconscious Mimicry. , 2005 .

[50]  Michael J. Richardson,et al.  Effects of visual and verbal interaction on unintentional interpersonal coordination. , 2005, Journal of experimental psychology. Human perception and performance.

[51]  G. Lipsitz WHERE IS THE LOVE , 2005 .

[52]  Michael J. Spivey,et al.  Unraveling the Dyad: Using Recurrence Analysis to Explore Patterns of Syntactic Coordination Between Children and Caregivers in Conversation , 2006 .

[53]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[54]  Max M. Louwerse,et al.  Dialog Act Classification Using N-Gram Algorithms , 2006, FLAIRS.

[55]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[56]  Daniel C. Richardson,et al.  The Art of Conversation Is Coordination , 2007, Psychological science.

[57]  Michael J. Richardson,et al.  Rocking together: dynamics of intentional and unintentional interpersonal coordination. , 2007, Human movement science.

[58]  Michael J. Richardson,et al.  Articulatory constraints on interpersonal postural coordination. , 2007, Journal of experimental psychology. Human perception and performance.

[59]  Thomas Hofmann,et al.  Speakers optimize information density through syntactic reduction , 2007 .

[60]  J. Cacioppo,et al.  Grounding social cognition: Synchronization, coordination, and co-regulation. , 2008 .

[61]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[62]  Michael J. Richardson,et al.  Language Use, Coordination, and the Emergence of Cooperative Action , 2008 .

[63]  T. Chartrand,et al.  Where is the love? The social aspects of mimicry , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[64]  Daniel C. Richardson,et al.  Conversation and Coordinative Structures , 2009, Top. Cogn. Sci..

[65]  Michael J. Hove,et al.  It's all in the timing: Interpersonal synchrony increases affiliation , 2009 .

[66]  Raymond H. Cuijpers,et al.  Joint Action: Neurocognitive Mechanisms Supporting Human Interaction , 2009, Top. Cogn. Sci..

[67]  Simon Garrod,et al.  Joint Action, Interactive Alignment, and Dialog , 2009, Top. Cogn. Sci..

[68]  Csr Young,et al.  How to Do Things With Words , 2009 .

[69]  B. J. Arthur,et al.  Harmonic Convergence in the Love Songs of the Dengue Vector Mosquito , 2009, Science.

[70]  María L. Flecha-García,et al.  Eyebrow raises in dialogue and their relation to discourse structure, utterance function and pitch accents in English , 2010, Speech Commun..

[71]  T. Florian Jaeger,et al.  Redundancy and reduction: Speakers manage syntactic information density , 2010, Cognitive Psychology.

[72]  A. Hamilton,et al.  Eye contact enhances mimicry of intransitive hand movements , 2011, Biology Letters.

[73]  Max M. Louwerse,et al.  Effects of Ambiguous Gestures and Language on the Time Course of Reference Resolution , 2010, Cogn. Sci..

[74]  Daniel C. Richardson,et al.  The Dynamics of Reference and Shared Visual Attention , 2011, Front. Psychology.

[75]  Daniel C. Richardson,et al.  Nominal Cross Recurrence as a Generalized Lag Sequential Analysis for Behavioral Streams , 2011, Int. J. Bifurc. Chaos.

[76]  付伶俐 打磨Using Language,倡导新理念 , 2014 .