Perceiving where another person is looking: the integration of head and body information in estimating another person’s gaze

The process through which an observer allocates his/her attention based on the attention of another person is known as joint attention. To be able to do this, the observer effectively has to compute where the other person is looking. It has been shown that observers integrate information from the head and the eyes to determine the gaze of another person. Most studies have documented that observers show a bias called the overshoot effect when eyes and head are misaligned. That is, when the head is not oriented straight to the observer, perceived gaze direction is sometimes shifted in the direction opposite to the head turn. The present study addresses whether body information is also used as a cue to compute perceived gaze direction. In Experiment 1, we observed a similar overshoot effect in both behavioral and saccadic responses when manipulating body orientation. In Experiment 2, we explored whether the overshoot effect was due to observers assuming that the eyes are oriented further than the head when head and body orientation are misaligned. We removed horizontal eye information by presenting the stimulus from a side view. Head orientation was now manipulated in a vertical direction and the overshoot effect was replicated. In summary, this study shows that body orientation is indeed used as a cue to determine where another person is looking.

[1]  Shinki Ando,et al.  Perception of Gaze Direction Based on Luminance Ratio , 2004, Perception.

[2]  A. Noll.  The effects of visible eye and head turn on the perception of being looked at. , 1976, The American journal of psychology.

[3]  Ken Masame,et al.  Perception of Where a Person is Looking: Overestimation and Underestimation of Gaze Direction , 1991 .

[4]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[5]  D. Perrett,et al.  Perceptual History Influences Neural Responses to Face and Body Postures , 2003, Journal of Cognitive Neuroscience.

[6]  Colin W. G. Clifford,et al.  Dual-Route Model of the Effect of Head Orientation on Perceived Gaze Direction , 2014, Journal of experimental psychology. Human perception and performance.

[7]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[8]  Z. Merali.  Here's looking at you, kid , 2008, Nature.

[9]  J. Hietanen,et al.  Social attention orienting integrates visual information from head and body orientation , 2002, Psychological research.

[10]  William Hyde Wollaston,et al.  XIII. On the apparent direction of eyes in a portrait , 1824, Philosophical Transactions of the Royal Society of London.

[11]  Filip Germeys,et al.  The role of social cues in the deployment of spatial attention: head-body relationships automatically activate directional spatial codes in a Simon task , 2011, Front. Integr. Neurosci..

[12]  L. M. M.-T..  Theory of Probability , 1929, Nature.

[13]  Ruth S. Nagayama,et al.  The effect of torso direction on the judgement of eye direction , 2005 .

[14]  M. Hudson,et al.  Anticipating intentional actions: The effect of eye gaze direction on the judgment of head rotation , 2009, Cognition.

[15]  Ben Craven,et al.  A Role for Eyebrows in Regulating the Visibility of Eye Gaze Direction , 2007, Quarterly journal of experimental psychology.

[16]  Shinki Ando,et al.  Luminance-induced shift in the apparent direction of gaze. , 2010, Perception.

[17]  J. Hietanen.  Does your gaze direction and head orientation shift my visual attention? , 1999, Neuroreport.

[18]  D. Perrett,et al.  Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque. , 1994, Cerebral cortex.

[19]  S. Langton,et al.  The influence of head contour and nose angle on the perception of eye-gaze direction , 2004, Perception & psychophysics.

[20]  Dirk Heylen,et al.  Accuracy of Head Orientation Perception in Triadic Situations: Experiment in a Virtual Environment , 2007, Perception.

[21]  S. Baron-Cohen.  How to build a baby that can read minds: Cognitive mechanisms in mindreading. , 1994 .

[22]  M. Crocker,et al.  Investigating joint attention mechanisms through spoken human–robot interaction , 2011, Cognition.

[23]  Jon Driver,et al.  Seen Gaze-Direction Modulates Fusiform Activity and Its Coupling with Other Brain Areas during Face Processing , 2001, NeuroImage.

[24]  Johan D. Carlin,et al.  A Head View-Invariant Representation of Gaze Direction in Anterior Superior Temporal Sulcus , 2011, Current Biology.

[25]  Dejan Todorović,et al.  Geometrical basis of perception of gaze direction , 2006, Vision Research.

[26]  M. Cline.  The perception of where a person is looking. , 1967, The American journal of psychology.

[27]  Richard D. Morey,et al.  Confidence Intervals from Normalized Data: A correction to Cousineau (2005) , 2008 .

[28]  Dejan Todorović,et al.  The Effect of Face Eccentricity on the Perception of Gaze Direction , 2009, Perception.

[29]  Mark G. Grotefend.  The Perception Is... , 2009 .

[30]  R. West,et al.  Influence of the Epicanthal Fold on the Perceived Direction of Gaze , 2008, Optometry and vision science : official publication of the American Academy of Optometry.

[31]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[33]  Claire K. Naughtin,et al.  A direct link between gaze perception and social attention. , 2011, Journal of experimental psychology. Human perception and performance.

[34]  P. Thier,et al.  How precise is gaze following in humans? , 2008, Vision Research.

[35]  Géry d'Ydewalle,et al.  Representational momentum and event course anticipation in the perception of implied periodical motions. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[36]  H. Wilson,et al.  Perception of head orientation , 2000, Vision Research.

[37]  J. Rouder,et al.  Default Bayes Factors for Model Selection in Regression , 2012, Multivariate behavioral research.

[38]  J. Gibson,et al.  Perception of another person's looking behavior. , 1963, The American journal of psychology.

[39]  S. Baron-Cohen,et al.  Gaze Perception Triggers Reflexive Visuospatial Orienting , 1999 .

[40]  S. Brennan,et al.  Speakers' eye gaze disambiguates referring expressions early during face-to-face conversation , 2007 .

[41]  Mayu Nishimura,et al.  What are you looking at? Acuity for triadic eye gaze. , 2004, The Journal of general psychology.

[42]  C. Clifford,et al.  A real head turner: horizontal and vertical head directions are multichannel coded. , 2011, Journal of vision.

[43]  Otsuka Yumiko,et al.  Dual route model of the effect of head orientation on perceived gaze direction , 2013 .

[44]  Dave S. Kerby,et al.  The effect of head turn on the perception of gaze , 2009, Vision Research.

[45]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[46]  K. Maruyama,et al.  The effect of face orientation upon apparent direction of gaze , 1983 .

[47]  Colin W G Clifford,et al.  About Turn , 2009, Psychological science.

[48]  Jon Driver,et al.  The positive and negative of human expertise in gaze perception , 2000, Cognition.

[49]  Jari K. Hietanen,et al.  Eye contact with neutral and smiling faces: effects on autonomic responses and frontal EEG asymmetry , 2012, Front. Hum. Neurosci..

[50]  S. Langton.  The Mutual Influence of Gaze and Head Orientation in the Analysis of Social Attention Direction , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[51]  R. West.  Perceived Direction of Gaze from Eyes with Dark vs. Light Irises , 2011, Optometry and vision science : official publication of the American Academy of Optometry.

[52]  S. Anstis,et al.  The perception of where a face or television "portrait" is looking. , 1969, The American journal of psychology.

[53]  V. Bruce,et al.  Do the eyes have it? Cues to the direction of social attention , 2000, Trends in Cognitive Sciences.

[54]  Cristina Becchio,et al.  Inferring intentions from biological motion: A stimulus set of point-light communicative interactions , 2010, Behavior research methods.

[55]  R. Jenkins,et al.  ormal gaze discrimination and adaptation in seven prosopagnosics , 2009 .

[56]  N. Emery,et al.  The eyes have it: the neuroethology, function and evolution of social gaze , 2000, Neuroscience & Biobehavioral Reviews.

[57]  Jeffrey N. Rouder,et al.  Default Bayes factors for ANOVA designs , 2012 .

[58]  Differences in the Perception of Monocular and Binocular Gaze , 2010, Optometry and vision science : official publication of the American Academy of Optometry.

[59]  Matthew W. Crocker,et al.  The influence of speaker gaze on listener comprehension: Contrasting visual versus intentional accounts , 2014, Cognition.

[60]  J. Freyd,et al.  The mental representation of movement when static stimuli are viewed , 1983, Perception & psychophysics.

[61]  Brian Coe,et al.  The positive and the negative , 1983, Nature.