Perspective-taking in dialogue as self-organization under social constraints

Abstract We present a dynamical systems account of how simple social information influences perspective-taking. Our account is motivated by the notion that perspective-taking may obey common dynamic principles with perceptuomotor coupling. We turn to the prominent HKB dynamical model of motor coordination, drawing from basic principles of self-organization to describe how conversational perspective-taking unfolds in a low-dimensional attractor landscape. We begin by simulating experimental data taken from a simple instruction-following task, in which participants have different expectations about their interaction partner. By treating belief states as different values of a control parameter, we show that data generated by a basic dynamical process fits overall egocentric and other-centric response distributions, the time required for participants to enact a response on a trial-by-trial basis, and the action dynamics exhibited in individual trials. We end by discussing the theoretical significance of dynamics in dialog, arguing that high-level coordination such as perspective-taking may obey similar dynamics as perceptuomotor coordination, pointing to common principles of adaptivity and flexibility during dialog.

[1]  E. Bard,et al.  Controlling the Intelligibility of Referring Expressions in Dialogue , 2000 .

[2]  A. Kendon Movement coordination in social interaction: some examples described. , 1970, Acta psychologica.

[3]  Michael J. Richardson,et al.  Language Use, Coordination, and the Emergence of Cooperative Action , 2008 .

[4]  J A Kelso,et al.  The nonlinear dynamics of speech categorization. , 1994, Journal of experimental psychology. Human perception and performance.

[5]  H. Haken,et al.  A theoretical model of phase transitions in human hand movements , 2004, Biological Cybernetics.

[6]  E. Spelke,et al.  Updating egocentric representations in human navigation , 2000, Cognition.

[7]  A. Dittmann,et al.  Body movement and speech rhythm in social conversation. , 1969, Journal of personality and social psychology.

[8]  Paul van Geert,et al.  The Dynamics of General Developmental Mechanisms From Piaget and Vygotsky to Dynamic Systems Models , 2000 .

[9]  J. A. Scott Kelso,et al.  Reaction-anticipation transitions in human perception-action patterns , 1996 .

[10]  J. Gottman The Mathematics of Marriage: Dynamic Nonlinear Models , 2003 .

[11]  Michael J. Spivey,et al.  Graded motor responses in the time course of categorizing atypical exemplars , 2007, Memory & cognition.

[12]  Victor Kuperman,et al.  Crowdsourcing and language studies: the new generation of linguistic data , 2010, Mturk@HLT-NAACL.

[13]  B. J. Fogg,et al.  Can computers be teammates? , 1996, Int. J. Hum. Comput. Stud..

[14]  Richard B. Darlington,et al.  Is Kurtosis Really “Peakedness?” , 1970 .

[15]  Michael J. Richardson,et al.  Social Connection Through Joint Action and Interpersonal Coordination , 2009, Top. Cogn. Sci..

[16]  G. Ermentrout Dynamic patterns: The self-organization of brain and behavior , 1997 .

[17]  Lewis P. Shapiro,et al.  Categorization of Ambiguous Sentences as a Function of a Changing Prosodic Parameter: A Dynamical Approach , 1999, Journal of psycholinguistic research.

[18]  S. Brennan,et al.  Processes of Interactive Spoken Discourse: The Role of the Partner , 2003 .

[19]  Herbert H. Clark,et al.  Coordinating beliefs in conversation , 1992 .

[20]  M. Turvey,et al.  Models of interlimb coordination--equilibria, local analyses, and spectral patterning: comment on Fuchs and Kelso (1994). , 1995, Journal of experimental psychology. Human perception and performance.

[21]  K. Shockley,et al.  Mutual interpersonal postural constraints are involved in cooperative conversation. , 2003, Journal of experimental psychology. Human perception and performance.

[22]  Daniel C. Richardson,et al.  Conversation and Coordinative Structures , 2009, Top. Cogn. Sci..

[23]  H. H. Clark,et al.  Speaking while monitoring addressees for understanding , 2004 .

[24]  Sarah Brown-Schmidt,et al.  Addressees distinguish shared from private information when interpreting questions during interactive conversation , 2008, Cognition.

[25]  Michael K. Tanenhaus,et al.  Pragmatic effects on reference resolution in a collaborative task: evidence from eye movements , 2004, Cogn. Sci..

[26]  Randall D. Beer,et al.  The Dynamics of Active Categorical Perception in an Evolved Model Agent , 2003, Adapt. Behav..

[27]  Gary S. Dell,et al.  Mechanisms for Listener-Adaptation in Language Production: Limiting the Role of the "Model of the Listener" , 2013 .

[28]  Joanna Ra,et al.  Reconciling symbolic and dynamic aspects of language: Toward a dynamic psycholinguistics , 2007 .

[29]  M. Pickering,et al.  The role of beliefs in lexical alignment: Evidence from dialogs with humans and computers , 2011, Cognition.

[30]  Richard C. Schmidt,et al.  Scaffolds for Social Meaning , 2007 .

[31]  J. Kelso,et al.  Activating Basic Category Exemplars in Sentence Contexts: A Dynamical Account , 2008, Journal of psycholinguistic research.

[32]  Iris van Rooij,et al.  A non-representational approach to imagined action , 2002, Cogn. Sci..

[33]  S. Brennan 4 How Conversation Is Shaped by Visual and Spoken Evidence , 2005 .

[34]  H. H. Clark,et al.  Referring as a collaborative process , 1986, Cognition.

[35]  J. Hartigan,et al.  The Dip Test of Unimodality , 1985 .

[36]  Michael F. Schober,et al.  Speakers, addressees, and frames of reference: Whose effort is minimized in conversations about locations? , 1995 .

[37]  E. D. Paolo,et al.  Can social interaction constitute social cognition? , 2010, Trends in Cognitive Sciences.

[38]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[39]  Raymond S. Nickerson,et al.  How We Know—and Sometimes Misjudge—What Others Know: Imputing One's Own Knowledge to Others , 1999 .

[40]  Michael J. Richardson,et al.  Order Parameter Dynamics of Body-scaled Hysteresis and Mode Transitions in Grasping Behavior , 2009, Journal of biological physics.

[41]  Anna K. Kuhlen,et al.  Two Minds, One Dialog , 2010 .

[42]  Michael J. Spivey,et al.  Continuous attraction toward phonological competitors. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Daniel C. Richardson,et al.  Looking To Understand: The Coupling Between Speakers' and Listeners' Eye Movements and Its Relationship to Discourse Comprehension , 2005, Cogn. Sci..

[44]  P. Hagoort,et al.  Recipient design in tacit communication , 2009, Cognition.

[45]  Kevin Shockley,et al.  Interpersonal Synergies , 2010, Front. Psychology.

[46]  Paul U. Lee,et al.  Why do speakers mix perspectives? , 1999, Spatial Cogn. Comput..

[47]  A. H. Kawamoto Nonlinear dynamics in the resolution of lexical ambiguity: A parallel distributed processing account. , 1993 .

[48]  B. Tversky,et al.  Embodied and disembodied cognition: Spatial perspective-taking , 2009, Cognition.

[49]  Michael J. Richardson,et al.  Judging and actualizing intrapersonal and interpersonal affordances. , 2007, Journal of experimental psychology. Human perception and performance.

[50]  Michael J. Spivey,et al.  Toward a New Scientific Visualization for the Language Sciences , 2012, Inf..

[51]  Rick Dale,et al.  Listeners invest in an assumed other’s perspective despite cognitive cost , 2011, Cognition.

[52]  Linda B. Smith,et al.  Social coordination in toddler's word learning: interacting systems of perception and action , 2008, Connect. Sci..

[53]  R. Gerrig,et al.  The impact of memory demands on audience design during language production , 2005, Cognition.

[54]  Michael J. Spivey,et al.  Continuous Dynamics in Real-Time Cognition , 2006 .

[55]  Michael J. Richardson,et al.  Effects of visual and verbal interaction on unintentional interpersonal coordination. , 2005, Journal of experimental psychology. Human perception and performance.

[56]  Laura A. Carlson,et al.  Selecting a reference frame , 1999, Spatial Cogn. Comput..

[57]  Sarah Brown-Schmidt,et al.  Talking in another person's shoes: Incremental perspective-taking in language processing , 2011, Dialogue Discourse.

[58]  Nicholas D. Duran,et al.  The action dynamics of overcoming the truth , 2010, Psychonomic bulletin & review.

[59]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[60]  D. Barr,et al.  The Egocentric Basis of Language Use , 1998 .

[61]  N. Epley,et al.  Perspective taking as egocentric anchoring and adjustment. , 2004, Journal of personality and social psychology.

[62]  B. Tversky,et al.  Perspective in Spatial Descriptions , 1996 .

[63]  A. Chemero Radical Embodied Cognitive Science , 2009 .

[64]  R. Ratcliff,et al.  Connectionist and diffusion models of reaction time. , 1999, Psychological review.

[65]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[66]  Michael J. Spivey,et al.  Action Dynamics Reveal Parallel Competition in Decision Making , 2008, Psychological science.

[67]  SUSAN E. BRENNAN,et al.  Conversation with and through computers , 1991, User Modeling and User-Adapted Interaction.

[68]  A. Homer,et al.  Interactions among performance, task, and gender variables in verbal discrimination learning , 1981 .

[69]  Susan Brennan,et al.  Partner-Specific Adaptation in Dialog , 2009, Top. Cogn. Sci..

[70]  Heather Bortfeld,et al.  Use and acquisition of idiomatic expressions in referring by native and non‐native speakers , 1997 .

[71]  Boaz Keysar,et al.  Less Is More: A Minimalist Account of Joint Action in Communication , 2009, Top. Cogn. Sci..

[72]  James D. Montgomery,et al.  The Mathematics of Marriage , 2004 .

[73]  T. McNamara,et al.  Multiple views of spatial memory , 1997 .

[74]  M. Rohde,et al.  Sensitivity to social contingency or stability of interaction? Modelling the dynamics of perceptual crossing , 2008 .

[75]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[76]  A. Opstal Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .