Shared Understanding and Synchrony Emergence - Synchrony as an Indice of the Exchange of Meaning between Dialog Partners

Synchrony is claimed by psychology as a crucial parameter of any social interaction. In dialog interactions, the synchrony between non-verbal behaviours of interactants is claimed to account for the quality of the interaction: to give to human a feeling of natural interaction, an agent must be able to synchronise on appropriate time. The synchronisation occurring during non-verbal iteractions has recently been modelised as a phenonomenon emerging from the coupling between interactants. We propose here, and test in simulation, a dynamical model of verbal communication which links the emergence of synchrony between non-verbal behaviours to the level of meaning exchanged through words by interactants: if partners of a dyad understand each other, synchrony emerges, whereas if they do not understand, synchrony is disrupted. In addition to retrieve the fact that synchrony emergence within a dyad of agents depends on their level of shared understanding, our tests pointed two noteworthy properties of synchronisation phenomenons: first, as well as synchrony accounts for mutual understanding and good interaction, di-synchrony accounts for misunderstanding; second, synchronisation and di-synchronisation emerging from mutual understanding are very quick phenomenons.

[1]  Frank J. Bernieri,et al.  Coordinated movement and rapport in teacher-student interactions , 1988 .

[2]  A. Kendon Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[3]  John T. Cacioppo,et al.  Emotional Contagion by Elaine Hatfield , 1993 .

[4]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[5]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[6]  V. Yngve On getting a word in edgewise , 1970 .

[7]  Catherine Pelachaud,et al.  Modelling multimodal expression of emotion in a virtual agent , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[8]  Claire Hughes,et al.  Early Social Cognition , 2010 .

[9]  J. Nadel The Imitative Mind: Imitation and imitation recognition: Functional use in preverbal infants and nonverbal children with autism , 2002 .

[10]  William S. Condon,et al.  An Analysis of Behavioral Organization , 2013 .

[11]  M. LaFrance Nonverbal synchrony and rapport: Analysis by the cross-lag panel technique. , 1979 .

[12]  Jacqueline Nadel,et al.  Reading sadness beyond human faces , 2010, Brain Research.

[13]  W. S. Condon,et al.  SOUND FILM ANALYSIS OF NORMAL AND PATHOLOGICAL BEHAVIOR PATTERNS , 1966, The Journal of nervous and mental disease.

[14]  Philippe Gaussier,et al.  How an Agent Can Detect and Use Synchrony Parameter of Its Own Interaction with a Human? , 2009, COST 2102 Training School.

[15]  D. Matsumoto,et al.  Spontaneous facial expressions of emotion of congenitally and noncongenitally blind individuals. , 2009, Journal of personality and social psychology.

[16]  Ken Prepin,et al.  Human–machine interaction as a model of machine–machine interaction: how to make machines interact as humans do , 2007, Adv. Robotics.

[17]  Philippe Gaussier,et al.  Avoiding the world model trap: An acting robot does not need to be so smart! , 1994 .

[18]  J. Nadel,et al.  Human brain spots emotion in non humanoid robots. , 2011, Social cognitive and affective neuroscience.

[19]  Catherine Pelachaud,et al.  Emotional Meaning and Expression in Animated Faces , 1999, IWAI.

[20]  Line Garnero,et al.  Inter-Brain Synchronization during Social Interaction , 2010, PloS one.

[21]  M. Rohde,et al.  Sensitivity to social contingency or stability of interaction? Modelling the dynamics of perceptual crossing , 2008 .

[22]  M. Auvray,et al.  Perceptual interactions in a minimalist virtual environment , 2009 .

[23]  T. Brazelton,et al.  The infant's response to entrapment between contradictory messages in face-to-face interaction. , 1978, Journal of the American Academy of Child Psychiatry.

[24]  Philippe Gaussier,et al.  Neural networks for complex scene recognition: simulation of a visual system with several cortical areas , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.