Referent expressions and gaze: reference type influences real-world gaze cue utilization.

Gaze cues are used alongside language to communicate. Lab-based studies have shown that people reflexively follow gaze cue stimuli, however it is unclear whether this affect is present in real interactions. Language specificity influences the extent to which we utilize gaze cues in real interactions, but it is unclear whether the type of language used can similarly affect gaze cue utilization. We aimed to (a) investigate whether automatic gaze following effects are present in real-world interactions, and (b) explore how gaze cue utilization varies depending on the form of concurrent language used. Wearing a mobile eye-tracker, participants followed instructions to complete a real-world search task. The instructor varied the determiner used (featural or spatial) and the presence of gaze cues (absent, congruent, or incongruent). Congruent gaze cues were used more when provided alongside featural references. Incongruent gaze cues were initially followed no more than chance. However, unlike participants in the no-gaze condition, participants in the incongruent condition did not benefit from receiving spatial instructions over featural instructions. We suggest that although participants selectively use informative gaze cues and ignore unreliable gaze cues, visual search can nevertheless be disrupted when inherently spatial gaze cues are accompanied by contradictory verbal spatial references.

[1]  Frank Bretz,et al.  Simultaneous Inference , 2020, Biostatistics Decoded.

[2]  Pia Knoeferle,et al.  Can Speaker Gaze Modulate Syntactic Structuring and Thematic Role Assignment during Spoken Sentence Comprehension? , 2012, Front. Psychology.

[3]  H. H. Clark,et al.  Speaking while monitoring addressees for understanding , 2004 .

[4]  T. Hothorn,et al.  Simultaneous Inference in General Parametric Models , 2008, Biometrical journal. Biometrische Zeitschrift.

[5]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[6]  P. Thier,et al.  How precise is gaze following in humans? , 2008, Vision Research.

[7]  G. Galfano,et al.  Eye gaze cannot be ignored (but neither can arrows) , 2012, Quarterly journal of experimental psychology.

[8]  A. Kingstone,et al.  Get real! Resolving the debate about equivalent social stimuli , 2009 .

[9]  G. Kuhn,et al.  Look away! Eyes and arrows engage oculomotor responses automatically , 2009, Attention, perception & psychophysics.

[10]  Benjamin W Tatler,et al.  Do as eye say: gaze cueing and language in a real-world social interaction. , 2013, Journal of vision.

[11]  L. Chelazzi,et al.  My eyes want to look where your eyes are looking: Exploring the tendency to imitate another individual's gaze , 2002, Neuroreport.

[12]  D. Bates,et al.  Linear Mixed-Effects Models using 'Eigen' and S4 , 2015 .

[13]  Alan Kingstone,et al.  A new look at social attention: orienting to the eyes is not (entirely) under volitional control. , 2012, Journal of experimental psychology. Human perception and performance.

[14]  N. Emery,et al.  The eyes have it: the neuroethology, function and evolution of social gaze , 2000, Neuroscience & Biobehavioral Reviews.

[15]  J. Hietanen,et al.  I'll Walk This Way: Eyes Reveal the Direction of Locomotion and Make Passersby Look and Go the Other Way , 2009, Psychological science.

[16]  Jon Driver,et al.  Adult's Eyes Trigger Shifts of Visual Attention in Human Infants , 1998 .

[17]  C. Villate,et al.  Eyes always attract attention but gaze orienting is task-dependent: Evidence from eye movement monitoring , 2007, Neuropsychologia.

[18]  Michael L. Platt,et al.  Spontaneous social orienting and gaze following in ringtailed lemurs (Lemur catta) , 2007, Animal Cognition.

[19]  John C Trueswell,et al.  Use of Speaker's Gaze and Syntax in Verb Learning , 2009, Language learning and development : the official journal of the Society for Language Development.

[20]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[21]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[22]  H. Gibbons,et al.  The eyes have it , 1991, Nature.

[23]  Anne B. Sereno,et al.  Social orienting: Reflexive versus voluntary control , 2010, Vision Research.

[24]  S. Brennan,et al.  Speakers' eye gaze disambiguates referring expressions early during face-to-face conversation , 2007 .

[25]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[26]  M. Crocker,et al.  Investigating joint attention mechanisms through spoken human–robot interaction , 2011, Cognition.

[27]  Salvatore Maria Aglioti,et al.  Follow My Eyes: The Gaze of Politicians Reflexively Captures the Gaze of Ingroup Voters , 2011, PloS one.

[28]  Gustav Kuhn,et al.  The influence of eye-gaze and arrow pointing distractor cues on voluntary eye movements , 2007, Perception & psychophysics.

[29]  G. Vallar,et al.  Is gaze following purely reflexive or goal-directed instead? Revisiting the automaticity of orienting attention by gaze cues , 2012, Experimental Brain Research.

[30]  A. Lacic.  [A new look]. , 1989, Pielegniarka i polozna.