How context information and target information guide the eyes from the first epoch of search in real-world scenes.

This study investigated how the visual system utilizes context and task information during the different phases of a visual search task. The specificity of the target template (the picture or the name of the target) and the plausibility of target position in real-world scenes were manipulated orthogonally. Our findings showed that both target template information and guidance of spatial context are utilized to guide eye movements from the beginning of scene inspection. In both search initiation and subsequent scene scanning, the availability of a specific visual template was particularly useful when the spatial context of the scene was misleading and the availability of a reliable scene context facilitated search mainly when the template was abstract. Target verification was affected principally by the level of detail of target template, and was quicker in the case of a picture cue. The results indicate that the visual system can utilize target template guidance and context guidance flexibly from the beginning of scene inspection, depending upon the amount and the quality of the available information supplied by either of these high-level sources. This allows for optimization of oculomotor behavior throughout the different phases of search within a real-world scene.

[1]  J. Henderson,et al.  Initial scene representations facilitate eye movement guidance in visual search. , 2007, Journal of experimental psychology. Human perception and performance.

[2]  George L. Malcolm,et al.  Combining top-down processes to guide eye movements during real-world scene search. , 2010, Journal of vision.

[3]  J. Henderson,et al.  Object-based attentional selection in scene viewing. , 2010, Journal of vision.

[4]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[5]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[6]  John J. B. Allen,et al.  Neurophysiological evidence for the influence of past experience on figure-ground perception. , 2010, Journal of vision.

[7]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[8]  M. Castelhano,et al.  The relative contribution of scene context and target features to visual search in scenes , 2010, Attention, perception & psychophysics.

[9]  J. Findlay Saccade Target Selection During Visual Search , 1997, Vision Research.

[10]  Naomi M. Kenner,et al.  How fast can you change your mind? The speed of top-down guidance in visual search , 2004, Vision Research.

[11]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[12]  John M Henderson,et al.  The time course of initial scene processing for eye movement guidance in natural scene search. , 2010, Journal of vision.

[13]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[14]  J. Wolfe,et al.  When does repeated search in scenes involve memory? Looking at versus looking for objects in scenes. , 2012, Journal of experimental psychology. Human perception and performance.

[15]  Michelle R. Greene,et al.  PSYCHOLOGICAL SCIENCE Research Article The Briefest of Glances The Time Course of Natural Scene Understanding , 2022 .

[16]  P. de Graef,et al.  Perceptual effects of scene context on object identification , 1990, Psychological research.

[17]  G. Zelinsky,et al.  Short article: Search guidance is proportional to the categorical specificity of a target cue , 2009, Quarterly journal of experimental psychology.

[18]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[19]  J. Wolfe Saved by a Log , 2012, Psychological science.

[20]  Alexander Pollatsek,et al.  Typicality aids search for an unspecified target, but only in identification and not in attentional guidance , 2008, Psychonomic bulletin & review.

[21]  Gregory J. Zelinsky,et al.  Scene context guides eye movements during visual search , 2006, Vision Research.

[22]  J. Henderson,et al.  Object–scene inconsistencies do not capture gaze: evidence from the flash-preview moving-window paradigm , 2011, Attention, perception & psychophysics.

[23]  Miguel P Eckstein,et al.  Object co-occurrence serves as a contextual cue to guide and facilitate visual search in a natural viewing environment. , 2011, Journal of vision.

[24]  Miguel P Eckstein,et al.  Attentional Cues in Real Scenes, Saccadic Targeting, and Bayesian Priors , 2005, Psychological science.

[25]  Yuhong Jiang,et al.  Setting up the target template in visual search. , 2005, Journal of vision.

[26]  Ryota Kanai,et al.  Recognising the forest, but not the trees: An effect of colour on scene perception and recognition , 2008, Consciousness and Cognition.

[27]  Michelle R. Greene,et al.  Visual search in scenes involves selective and nonselective pathways , 2011, Trends in Cognitive Sciences.

[28]  Rajesh P. N. Rao,et al.  Eye movements in iconic visual search , 2002, Vision Research.

[29]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[30]  T. Foulsham,et al.  Is attention necessary for object identification? Evidence from eye movements during the inspection of real-world scenes , 2008, Consciousness and Cognition.

[31]  D H Ballard,et al.  Hand-eye coordination during sequential tasks. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  R. Rafal,et al.  Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. , 1994, Journal of experimental psychology. General.

[33]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[34]  Tom Troscianko,et al.  Regional effects of clutter on human target detection performance. , 2013, Journal of vision.

[35]  B. Tatler,et al.  Semantic consistency versus perceptual salience in visual scenes: findings from change detection. , 2013, Acta psychologica.

[36]  Guillaume A. Rousselet,et al.  Processing scene context: Fast categorization and object interference , 2007, Vision Research.

[37]  D E Williams,et al.  Preattentive guidance of eye movements during triple conjunction search tasks: The effects of feature discriminability and saccadic amplitude , 2001, Psychonomic bulletin & review.

[38]  A. Hollingworth Two forms of scene memory guide visual search: Memory for scene context and memory for the binding of target object to scene location , 2009 .

[39]  J. Wolfe,et al.  The interplay of episodic and semantic memory in guiding repeated search in scenes , 2013, Cognition.

[40]  Michael L. Mack,et al.  Modeling categorization of scenes containing consistent versus inconsistent objects. , 2010, Journal of vision.

[41]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[42]  Ashley M. Sherman,et al.  Visual search for arbitrary objects in real scenes , 2011, Attention, perception & psychophysics.

[43]  M. Castelhano,et al.  Scene context influences without scene gist: Eye movements guided by spatial associations in visual search , 2011, Psychonomic bulletin & review.

[44]  Antonio Torralba,et al.  Recognizing indoor scenes , 2009, CVPR.

[45]  David H Brainard,et al.  Surface color perception and equivalent illumination models. , 2011, Journal of vision.

[46]  Melissa L.-H. Võ,et al.  A glimpse is not a glimpse: Differential processing of flashed scene previews leads to differential target search benefits , 2010 .

[47]  D. Ballard,et al.  Eye guidance in natural vision: reinterpreting salience. , 2011, Journal of vision.

[48]  C. Eriksen,et al.  Allocation of attention in the visual field. , 1985, Journal of experimental psychology. Human perception and performance.

[49]  George L. Malcolm,et al.  The effects of target template specificity on visual search in real-world scenes: evidence from eye movements. , 2009, Journal of vision.

[50]  Gregory J Zelinsky,et al.  Cutting through the clutter: searching for targets in evolving complex scenes. , 2011, Journal of vision.

[51]  J. Findlay,et al.  Absence of scene context effects in object detection and eye gaze capture , 2007 .

[52]  M. Kiefer,et al.  Conceptual representations in mind and brain: Theoretical developments, current evidence and future directions , 2012, Cortex.

[53]  Gregory J. Zelinsky,et al.  Visual search guidance is best after a short delay , 2011, Vision Research.

[54]  G. Zelinsky A theory of eye movements during target acquisition. , 2008, Psychological review.

[55]  Gregory J. Zelinsky,et al.  Searching through the hierarchy: How level of target categorization affects visual search , 2012, Visual cognition.

[56]  M. Eckstein,et al.  Attentional Cues in Real Scenes, Saccadic Targeting, and Bayesian Priors , 2006 .

[57]  J. Henderson,et al.  Does gravity matter? Effects of semantic and syntactic inconsistencies on the allocation of attention during scene perception. , 2009, Journal of vision.

[58]  A. Basbaum,et al.  The senses : a comprehensive reference , 2008 .

[59]  M. Potter Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[60]  Fan Wu,et al.  Robust object-based encoding in visual working memory. , 2013, Journal of vision.

[61]  Hany Farid,et al.  The specificity of the search template. , 2009, Journal of vision.

[62]  Gregory J. Zelinsky,et al.  Visual search is guided to categorically-defined targets , 2009, Vision Research.

[63]  G. Zelinsky,et al.  An effect of referential scene constraint on search implies scene segmentation , 2009 .

[64]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[65]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[66]  Jennifer J. Richler,et al.  Effect size estimates: current use, calculations, and interpretation. , 2012, Journal of experimental psychology. General.

[67]  M. Bravo,et al.  A scale invariant measure of clutter. , 2008, Journal of vision.

[68]  Myriam Chanceaux,et al.  The influence of clutter on real-world scene search: evidence from search efficiency and eye movements. , 2009, Journal of vision.

[69]  U. Neisser VISUAL SEARCH. , 1964, Scientific American.

[70]  Krista A. Ehinger,et al.  Modelling search for people in 900 scenes: A combined source model of eye guidance , 2009 .

[71]  Simon P. Liversedge,et al.  The effect of the first glimpse at a scene on eye movements during search , 2012, Psychonomic bulletin & review.

[72]  C. Scialfa,et al.  Response times and eye movements in feature and conjunction search as a function of target eccentricity , 1998, Perception & psychophysics.

[73]  B. Tatler,et al.  Looking and Acting: Vision and eye movements in natural behaviour , 2009 .