Cutting through the clutter: searching for targets in evolving complex scenes.

We evaluated the use of visual clutter as a surrogate measure of set size effects in visual search by comparing the effects of subjective clutter (determined by independent raters) and objective clutter (as quantified by edge count and feature congestion) using "evolving" scenes, ones that varied incrementally in clutter while maintaining their semantic continuity. Observers searched for a target building in rural, suburban, and urban city scenes created using the game SimCity. Stimuli were 30 screenshots obtained for each scene type as the city evolved over time. Reaction times and search guidance (measured by scan path ratio) were fastest/strongest for sparsely cluttered rural scenes, slower/weaker for more cluttered suburban scenes, and slowest/weakest for highly cluttered urban scenes. Subjective within-city clutter estimates also increased as each city matured and correlated highly with RT and search guidance. However, multiple regression modeling revealed that adding objective estimates failed to better predict search performance over the subjective estimates alone. This suggests that within-city clutter may not be explained exclusively by low-level feature congestion; conceptual congestion (e.g., the number of different types of buildings in a scene), part of the subjective clutter measure, may also be important in determining the effects of clutter on search.

[1]  N. Mackworth.  Visual noise causes tunnel vision , 1965 .

[2]  M. Bravo,et al.  A scale invariant measure of clutter. , 2008, Journal of vision.

[3]  Gregory J. Zelinsky,et al.  Searching for camouflaged targets: Effects of target-background similarity on visual search , 2006, Vision Research.

[4]  James R. Brockmole,et al.  Using real-world scenes as contextual cues for search , 2006 .

[5]  M. Pomplun.  Saccadic selectivity in complex visual search displays , 2006, Vision Research.

[6]  Myriam Chanceaux,et al.  The influence of clutter on real-world scene search: evidence from search efficiency and eye movements. , 2009, Journal of vision.

[7]  D. Roenker,et al.  Age and visual search: expanding the useful field of view. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[8]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .

[9]  G. Zelinsky,et al.  Short article: Search guidance is proportional to the categorical specificity of a target cue , 2009, Quarterly journal of experimental psychology.

[10]  Alex D. Hwang,et al.  A model of top-down attentional control during visual search in complex scenes. , 2009, Journal of vision.

[11]  Xin Chen,et al.  Real-world visual search is dominated by top-down guidance , 2006, Vision Research.

[12]  Rajesh P. N. Rao,et al.  PSYCHOLOGICAL SCIENCE Research Article EYE MOVEMENTS REVEAL THE SPATIOTEMPORAL DYNAMICS OE VISUAL SEARCH , 2022 .

[13]  J. Driver,et al.  Segmentation, attention and phenomenal visual objects , 2001, Cognition.

[14]  H. Bouma,et al.  Visual search and reading : eye movements and functional visual field : a tutorial review , 1978 .

[15]  J. Henderson.  Regarding Scenes , 2007 .

[16]  Gregory J. Zelinsky,et al.  Scene context guides eye movements during visual search , 2006, Vision Research.

[17]  U. Neisser.  VISUAL SEARCH. , 1964, Scientific American.

[18]  Krista A. Ehinger,et al.  Modelling search for people in 900 scenes: A combined source model of eye guidance , 2009 .

[19]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[20]  M. Wertheimer,et al.  A source book of Gestalt psychology. , 1939 .

[21]  E S KRENDEL,et al.  Search in an unstructured visual field. , 1960, Journal of the Optical Society of America.

[22]  F. L. Engel.  Visual conspicuity, directed attention and retinal locus. , 1971, Vision research.

[23]  Gregory J. Zelinsky,et al.  Exploring set size effects in realistic scenes , 2010 .

[24]  Miguel P Eckstein,et al.  Attentional Cues in Real Scenes, Saccadic Targeting, and Bayesian Priors , 2005, Psychological science.

[25]  Arthur F Kramer,et al.  Training and transfer of training in the search for camouflaged targets , 2009, Attention, perception & psychophysics.

[26]  Gregory J. Zelinsky,et al.  Exploring set size effects in scenes: Identifying the objects of search , 2008 .

[27]  G. Zelinsky,et al.  An effect of referential scene constraint on search implies scene segmentation , 2009 .

[28]  M. Bravo,et al.  Object recognition in dense clutter , 2006, Perception & psychophysics.

[29]  N. Kanwisher.  Repetition blindness: Type recognition without token individuation , 1987, Cognition.

[30]  Gregory J Zelinsky,et al.  Exploring the Perceptual Causes of Search Set-Size Effects in Complex Scenes , 2010, Perception.

[31]  N. Kanwisher,et al.  Repetition blindness and illusory conjunctions: errors in binding visual types with visual tokens. , 1991, Journal of experimental psychology. Human perception and performance.

[32]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[33]  T. Foulsham,et al.  How Does the Purpose of Inspection Influence the Potency of Visual Salience in Scene Perception? , 2007, Perception.

[34]  F. Newell,et al.  Is object search mediated by object-based or image-based representations? , 2004, Spatial vision.

[35]  Yuanzhen Li,et al.  Feature congestion: a measure of display clutter , 2005, CHI.

[36]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[37]  Hany Farid,et al.  Search for a Category Target in Clutter , 2004, Perception.

[38]  Arthur F Kramer,et al.  Visual search for real world targets under conditions of high target-background similarity: Exploring training and transfer in younger and older adults. , 2010, Acta psychologica.

[39]  Maura C. Lohrenz,et al.  Human Factors : The Journal of the Human Factors and Ergonomics Society , 2007 .

[40]  Helga C. Arsenio,et al.  Panoramic search: the interaction of memory and vision in search through a familiar scene. , 2004, Journal of experimental psychology. Human perception and performance.

[41]  J. Wolfe.  Visual search in continuous, naturalistic stimuli , 1994, Vision Research.

[42]  R. von der Heydt,et al.  A neural model of figure-ground organization. , 2007, Journal of neurophysiology.

[43]  David L. Sheinberg,et al.  Eye movements during parallel-serial visual search. , 1997, Journal of experimental psychology. Human perception and performance.

[44]  Frank E. Ritter,et al.  The Rise of Cognitive Architectures , 2007, Integrated Models of Cognitive Systems.

[45]  Roland J. Baddeley,et al.  High frequency edges (but not contrast) predict where we fixate: A Bayesian system identification analysis , 2006, Vision Research.

[46]  M. Wertheimer.  Untersuchungen zur Lehre von der Gestalt. II , 1923 .

[47]  Irving Biederman,et al.  Object search in nonscene displays. , 1988 .

[48]  Melissa R. Beck,et al.  Measuring search efficiency in complex visual search tasks: global and local clutter. , 2010, Journal of experimental psychology. Applied.

[49]  George L. Malcolm,et al.  The effects of target template specificity on visual search in real-world scenes: evidence from eye movements. , 2009, Journal of vision.

[50]  Michelle R. Greene,et al.  Visual search in scenes involves selective and nonselective pathways , 2011, Trends in Cognitive Sciences.

[51]  Rajesh P. N. Rao,et al.  Eye movements in iconic visual search , 2002, Vision Research.

[52]  G. Zelinsky.  A theory of eye movements during target acquisition. , 2008, Psychological review.

[53]  Frans W Cornelissen,et al.  A crowding model of visual clutter. , 2009, Journal of vision.

[54]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[55]  F. L. Engel.  Visual conspicuity, visual search and fixation tendencies of the eye , 1977, Vision Research.

[56]  Benjamin W. Tatler,et al.  Current understanding of eye guidance , 2009 .

[57]  James R. Brockmole,et al.  Short Article: Recognition and Attention Guidance during Contextual Cueing in Real-World Scenes: Evidence from Eye Movements , 2006, Quarterly journal of experimental psychology.

[58]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[59]  P. Verghese.  Visual Search and Attention A Signal Detection Theory Approach , 2001, Neuron.

[60]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[61]  G J Zelinsky,et al.  Eye movements during change detection: Implications for search constraints, memory limitations, and scanning strategies , 2001, Perception & psychophysics.

[62]  Michelle R. Greene,et al.  Recognition of natural scenes from global properties: Seeing the forest without representing the trees , 2009, Cognitive Psychology.

[63]  Alexander Pollatsek,et al.  Typicality aids search for an unspecified target, but only in identification and not in attentional guidance , 2008, Psychonomic bulletin & review.

[64]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[65]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[66]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[67]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[68]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[69]  A. Oliva,et al.  Segmentation of objects from backgrounds in visual search tasks , 2002, Vision Research.

[70]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[71]  R. Rosenholtz.  Visual search for orientation among heterogeneous distractors: experimental results and implications for signal-detection theory models of search. , 2001, Journal of experimental psychology. Human perception and performance.

[72]  Gregory J. Zelinsky,et al.  Visual search is guided to categorically-defined targets , 2009, Vision Research.

[73]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[74]  J. Henderson,et al.  Initial scene representations facilitate eye movement guidance in visual search. , 2007, Journal of experimental psychology. Human perception and performance.

[75]  J. Requin.  Attention and Performance VII , 1980 .

[76]  Yuanzhen Li,et al.  Measuring visual clutter. , 2007, Journal of vision.

[77]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  C. K. Ogden.  A Source Book Of Gestalt Psychology , 2013 .

[79]  I. Biederman,et al.  Searching for objects in real-world scences. , 1973, Journal of experimental psychology.

[80]  M. Eckstein.  The Lower Visual Search Efficiency for Conjunctions Is Due to Noise and not Serial Attentional Processing , 1998 .

[81]  J. Henderson,et al.  Does gravity matter? Effects of semantic and syntactic inconsistencies on the allocation of attention during scene perception. , 2009, Journal of vision.

[82]  Gregory J. Zelinsky,et al.  Precuing target location in a variable set size "nonsearch" task: Dissociating search-based and interference-based explanations for set size effects. , 1999 .

[83]  A. Torralba,et al.  The role of context in object recognition , 2007, Trends in Cognitive Sciences.

[84]  Marc Pomplun,et al.  Area Activation 1 Running Head : AREA ACTIVATION Advancing Area Activation towards a General Model of Eye Movements in Visual Search , 2005 .