Speaking and Listening with the Eyes: Gaze Signaling during Dyadic Interactions

Cognitive scientists have long been interested in the role that eye gaze plays in social interactions. Previous research suggests that gaze acts as a signaling mechanism and can be used to control turn-taking behaviour. However, early research on this topic employed methods of analysis that aggregated gaze information across an entire trial (or trials), which masks any temporal dynamics that may exist in social interactions. More recently, attempts have been made to understand the temporal characteristics of social gaze but little research has been conducted in a natural setting with two interacting participants. The present study combines a temporally sensitive analysis technique with modern eye tracking technology to 1) validate the overall results from earlier aggregated analyses and 2) provide insight into the specific moment-to-moment temporal characteristics of turn-taking behaviour in a natural setting. Dyads played two social guessing games (20 Questions and Heads Up) while their eyes were tracked. Our general results are in line with past aggregated data, and using cross-correlational analysis on the specific gaze and speech signals of both participants we found that 1) speakers end their turn with direct gaze at the listener and 2) the listener in turn begins to speak with averted gaze. Convergent with theoretical models of social interaction, our data suggest that eye gaze can be used to signal both the end and the beginning of a speaking turn during a social interaction. The present study offers insight into the temporal dynamics of live dyadic interactions and also provides a new method of analysis for eye gaze data when temporal relationships are of interest.

[1]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[2]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[3]  Donald W. Fiske,et al.  Face-to-face interaction: Research, methods, and theory , 1977 .

[4]  M. Foddy,et al.  Patterns of Gaze in Cooperative and Competitive Negotiation , 1978 .

[5]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[6]  J. Harrigan,et al.  LISTENERS' BODY MOVEMENTS AND SPEAKING TURNS , 1985 .

[7]  C. Kleinke.  Gaze and eye contact: a research review. , 1986, Psychological bulletin.

[8]  J. Burgoon,et al.  Nonverbal Communication , 2018, Encyclopedia of Evolutionary Psychological Science.

[9]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[10]  F. Tokunaga,et al.  In the eye , 1998 .

[11]  S. Baron-Cohen,et al.  Gaze Perception Triggers Reflexive Visuospatial Orienting , 1999 .

[12]  J. Bavelas,et al.  Listeners as co-narrators. , 2000, Journal of personality and social psychology.

[13]  J. Bavelas,et al.  Listener Responses as a Collaborative Process: The Role of Gaze , 2002 .

[14]  J. Zbilut,et al.  Recurrence Quantification Analysis of Nonlinear Dynamical Systems , 2004 .

[15]  Daniel C. Richardson,et al.  Looking To Understand: The Coupling Between Speakers' and Listeners' Eye Movements and Its Relationship to Discourse Comprehension , 2005, Cogn. Sci..

[16]  Fiona G. Phelps,et al.  Gaze aversion: A response to cognitive or social difficulty? , 2005, Memory & cognition.

[17]  Daniel C. Richardson,et al.  The Art of Conversation Is Coordination , 2007, Psychological science.

[18]  S. Tipper,et al.  Gaze cueing of attention: visual attention, social cognition, and individual differences. , 2007, Psychological bulletin.

[19]  P. Kay,et al.  Universals and cultural variation in turn-taking in conversation , 2009, Proceedings of the National Academy of Sciences.

[20]  Masaaki Kawahashi,et al.  Renovation of Journal of Visualization , 2010, J. Vis..

[21]  Kaitlin E W Laidlaw,et al.  Potential social interactions are important to social attention , 2011, Proceedings of the National Academy of Sciences.

[22]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[23]  Marisa Tice,et al.  Turn-boundary projection: Looking ahead , 2011, CogSci.

[24]  T. Foulsham,et al.  The where, what and when of gaze allocation in the lab and the natural environment , 2011, Vision Research.

[25]  Fred Cummins.  Gaze and blinking in dyadic conversation: A study in coordinated behaviour among individuals , 2012 .

[26]  Evan F. Risko,et al.  Social attention with real versus reel stimuli: toward an empirical approach to concerns about ecological validity , 2012, Front. Hum. Neurosci..

[27]  R. Saxe,et al.  Look at this: the neural correlates of initiating and responding to bids for joint attention , 2012, Front. Hum. Neurosci..

[28]  Iain D Couzin,et al.  The directional flow of visual information transfer between pedestrians , 2012, Biology Letters.

[29]  Richard Andersson,et al.  Timing of gazes in child dialogues: a time-course analysis of requests and back channelling in referential communication. , 2012, International journal of language & communication disorders.

[30]  Benjamin W Tatler,et al.  Do as eye say: gaze cueing and language in a real-world social interaction. , 2013, Journal of vision.

[31]  Ross MacDonald,et al.  The effect of social roles on gaze cue utilisation in a real-world collaboration , 2013, CogSci.

[32]  K. Vogeley,et al.  From gaze cueing to dual eye-tracking: Novel approaches to investigate the neural correlates of gaze in social interaction , 2013, Neuroscience & Biobehavioral Reviews.

[33]  Tom Foulsham,et al.  What Affects Social Attention? Social Presence, Eye Contact and Autistic Traits , 2013, PLoS ONE.

[34]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[35]  A. Kingstone,et al.  Natural gaze signaling in a social context , 2014 .

[36]  Kobin H. Kendrick,et al.  Unaddressed participants’ gaze in multi-person interaction: optimizing recipiency , 2015, Frontiers in Psychology.

[37]  Javier Cudeiro,et al.  N C ] 1 6 D ec 2 01 4 Bootstrap testing for differences in cross-correlation , 2014 .