Saliency and scan patterns in the inspection of real-world scenes: Eye movements during encoding and recognition

How do sequences of eye fixations match each other when viewing a picture during encoding and again during a recognition test, and to what extent are fixation sequences (scan patterns) determined by the low-level visual features of the picture rather than the domain knowledge of the viewer? The saliency map model of visual attention was tested in two experiments to ask whether the rank ordering of regions by their saliency values can be used to predict the sequence of fixations made when first looking at an image. Experiment 1 established that the sequence of fixations on first inspection during encoding was similar to that made when looking at the picture the second time, in the recognition test. Experiment 2 confirmed this similarity of fixation sequences at encoding and recognition, and also found a similarity between scan patterns made during the initial recognition test and during a second recognition test 1 week later. The fixation scan patterns were not similar to those predicted by the saliency map model in either experiment, however. These conclusions are qualified by interactions involving the match between the content of the image and the domain of interest of the viewers.

[1]  T. Foulsham,et al.  Short article: Does conspicuity enhance distraction? Saliency and eye landing position when searching for objects , 2009, Quarterly journal of experimental psychology.

[2]  T. Foulsham,et al.  Is attention necessary for object identification? Evidence from eye movements during the inspection of real-world scenes , 2008, Consciousness and Cognition.

[3]  A. Kingstone,et al.  Gaze selection in complex social scenes , 2008 .

[4]  T. Foulsham,et al.  How Does the Purpose of Inspection Influence the Potency of Visual Salience in Scene Perception? , 2007, Perception.

[5]  G. Underwood,et al.  Low-level visual saliency does not predict change detection in natural scenes. , 2007, Journal of vision.

[6]  T. Foulsham,et al.  Quarterly Journal of Experimental Psychology: in press Visual saliency and semantic incongruency influence eye movements when , 2022 .

[7]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[8]  R. Baddeley,et al.  The long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task , 2006, Vision Research.

[9]  T. Foulsham,et al.  Eye movements during scene inspection: A test of the saliency map hypothesis , 2006 .

[10]  Dominique Lamy,et al.  Effects of task relevance and stimulus-driven salience in feature-search mode. , 2004, Journal of experimental psychology. Human perception and performance.

[11]  Geoffrey Underwood,et al.  Inspecting Pictures for Information to Verify a Sentence: Eye Movements in General Encoding and in Focused Search , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[12]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[13]  Jean Underwood,et al.  Visual attention while driving: sequences of eye fixations made by experienced and novice drivers , 2003, Ergonomics.

[14]  Michael E. Holmes,et al.  Attention to repeated images on the World-Wide Web: Another look at scanpath theory , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[15]  H. Nothdurft.  Attention shifts to salient targets , 2002, Vision Research.

[16]  Bruno Laeng,et al.  Eye scanpaths during visual imagery reenact those of perception of the same visual scene , 2002, Cogn. Sci..

[17]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[18]  V. Bruce,et al.  Do the eyes have it? Cues to the direction of social attention , 2000, Trends in Cognitive Sciences.

[19]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[20]  L W Stark,et al.  String editing analysis of human visual search. , 1995, Optometry and vision science : official publication of the American Academy of Optometry.

[21]  Lawrence W. Stark,et al.  Visual perception and sequences of eye movement fixations: a stochastic modeling approach , 1992, IEEE Trans. Syst. Man Cybern..

[22]  J. Stern.  Theoretical and applied aspects of eye movement research A. G. Gale and F. Johnson, (Elsevier Science Publishers B.V., Amsterdam, 1984) pp. xiii + 565, Dfl. 185 , 1985, Biological Psychology.

[23]  D. F. Fisher,et al.  Eye movements : cognition and visual perception , 1982 .

[24]  M. Potter.  Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[25]  I. Biederman,et al.  On the information extracted from a glance at a scene. , 1974, Journal of experimental psychology.

[26]  L. Stark,et al.  Scanpaths in saccadic eye movements while viewing and recognizing patterns. , 1971, Vision research.

[27]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[28]  R. Almond.  The therapeutic community. , 1971, Scientific American.

[29]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[30]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[31]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[32]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[33]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[34]  D. S. Wooding,et al.  The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. , 1996, Spatial vision.

[35]  R. Groner,et al.  Looking at Faces: Local and Global Aspects of Scanpaths , 1984 .

[36]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[37]  R. C. Langford.  How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .