I See What You See: Eye Movements in Real-World Scenes Are Affected by Perceived Direction of Gaze

In this chapter, we report an investigation the influence of the saliency of another person's direction of gaze on an observer's eye movements through real-world scenes. Participants' eye movements were recorded while they viewed a sequence of scene photographs that told a story. A subset of the scenes contained an actor. The actor's face was highly likely to be fixated, and when it was, the observer's next saccade was more likely to be toward the object that was the focus of the actor's gaze than in any other direction. Furthermore, when eye movement patterns did not show an immediate saccade to the focused object, observers were nonetheless more likely to fixate the focused object than a control object within close temporal proximity of fixation on the face. We conclude that during real-world scene perception, observers are sensitive to another's direction of gaze and use it to help guide their own eye movements.

[1]  R. Brooks,et al.  Infant Understanding of the Referential Nature of Looking , 2000 .

[2]  M. Tinker How People Look at Pictures. , 1936 .

[3]  J. Bruner,et al.  The capacity for joint visual attention in the infant , 1975, Nature.

[4]  S. Langton The Mutual Influence of Gaze and Head Orientation in the Analysis of Social Attention Direction , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[5]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[6]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[7]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[8]  M. V. von Grünau,et al.  The Detection of Gaze Direction: A Stare-In-The-Crowd Effect , 1995, Perception.

[9]  M. Asada,et al.  A developmental approach accelerates learning of joint attention , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[10]  D. Povinelli,et al.  Mindblindness. An Essay on Autism and Theory of Mind Simon Baron-Cohen 1995 , 1996, Trends in Neurosciences.

[11]  Shinki Ando,et al.  Luminance-induced shift in the apparent direction of gaze. , 2010, Perception.

[12]  D. Muir,et al.  A demonstration of gaze following in 3- to 6-month-olds , 1997 .

[13]  Minoru Asada,et al.  Joint attention emerges through bootstrap learning , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[14]  A. Meltzoff,et al.  The importance of eyes: how infants interpret adult looking behavior. , 2002, Developmental psychology.

[15]  J. Laird,et al.  Looking and loving: The effects of mutual gaze on feelings of romantic love. , 1989 .

[16]  G R Loftus,et al.  The functional visual field during picture viewing. , 1980, Journal of experimental psychology. Human learning and memory.

[17]  Minoru Asada,et al.  Joint attention with strangers based on generalization through joint attention with caregivers , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[18]  D. Perrett,et al.  Understanding the intentions of others from visual signals: Neurophysiological evidence. , 1994 .

[19]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[20]  Mark H. Johnson,et al.  Does gaze perception facilitate overt orienting? , 2003 .

[21]  A. Kingstone,et al.  Cognitive Ethology and exploring attention in real-world scenes , 2006, Brain Research.

[22]  A. Friedman Framing pictures: the role of knowledge in automatized encoding and memory for gist. , 1979, Journal of experimental psychology. General.

[23]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[24]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[25]  S. Langton,et al.  Gaze Cues Influence the Allocation of Attention in Natural Scene Viewing , 2006, Quarterly journal of experimental psychology.

[26]  R. Langdon,et al.  Spatial cueing by social versus nonsocial directional signals , 2005 .

[27]  Shinki Ando,et al.  Perception of Gaze Direction Based on Luminance Ratio , 2004, Perception.

[28]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[29]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[30]  J. Gibson,et al.  Perception of another person's looking behavior. , 1963, The American journal of psychology.

[31]  Brian Scassellati,et al.  Theory of Mind for a Humanoid Robot , 2002, Auton. Robots.

[32]  C. Moore,et al.  Joint attention : its origins and role in development , 1995 .

[33]  Nancy Millette,et al.  How People Look at Pictures , 1935 .

[34]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[35]  C. Moore,et al.  Intentional relations and social understanding , 1996, Behavioral and Brain Sciences.

[36]  J. Henderson Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[37]  L. Chelazzi,et al.  My eyes want to look where your eyes are looking: Exploring the tendency to imitate another individual's gaze , 2002, Neuroreport.

[38]  Alan Kingstone,et al.  Attentional effects of counterpredictive gaze and arrow cues. , 2004, Journal of experimental psychology. Human perception and performance.

[39]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[40]  S. Baron-Cohen,et al.  Gaze Perception Triggers Reflexive Visuospatial Orienting , 1999 .

[41]  Fernanda Ferreira,et al.  Scene Perception for Psycholinguists. , 2004 .

[42]  Andrew P Bayliss,et al.  Orienting of attention via observed eye gaze is head-centred , 2004, Cognition.

[43]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .

[44]  M. Cline The perception of where a person is looking. , 1967, The American journal of psychology.

[45]  C. Moore,et al.  The origins of joint visual attention in infants. , 1998, Developmental psychology.

[46]  N. Emery,et al.  The eyes have it: the neuroethology, function and evolution of social gaze , 2000, Neuroscience & Biobehavioral Reviews.

[47]  Carrick C. Williams,et al.  Eye movements and picture processing during recognition , 2003, Perception & psychophysics.

[48]  A. Kingstone,et al.  Attention, Researchers! It Is Time to Take a Look at the Real World , 2003 .

[49]  Riitta Parkkola,et al.  Automatic attention orienting by social and symbolic cues activates different neural networks: An fMRI study , 2006, NeuroImage.

[50]  C. Kleinke Gaze and eye contact: a research review. , 1986, Psychological bulletin.

[51]  Mark H. Johnson,et al.  CONSPEC and CONLERN: a two-process theory of infant face recognition. , 1991, Psychological review.

[52]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[53]  V. Bruce,et al.  Reflexive visual orienting in response to the social attention of others , 1999 .

[54]  N. Fox,et al.  Social perception in infants , 1985 .

[55]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[56]  Zenzi M. Griffin,et al.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[57]  Alan Kingstone,et al.  Abrupt onsets and gaze direction cues trigger independent reflexive attentional effects , 2003, Cognition.

[58]  Michael G. Reynolds,et al.  Metacognitive errors in change detection: Missing the gap between lab and life , 2007, Consciousness and Cognition.