Beyond Scene Gist: Objects Guide Search More Than Scene Background

Although the facilitation of visual search by contextual information is well established, there is little understanding of the independent contributions of different types of contextual cues in scenes. Here we manipulated 3 types of contextual information: object co-occurrence, multiple object configurations, and background category. We isolated the benefits of each contextual cue to target detectability, its impact on decision bias, confidence, and the guidance of eye movements. We find that object-based information guides eye movements and facilitates perceptual judgments more than scene background. The degree of guidance and facilitation of each contextual cue can be related to its inherent informativeness about the target spatial location as measured by human explicit judgments about likely target locations. Our results improve the understanding of the contributions of distinct contextual scene components to search and suggest that the brain’s utilization of cues to guide eye movements is linked to the cue’s informativeness about the target’s location.

[1]  Charan Ranganath,et al.  Significance of objects in the perirhinal cortex , 2015, Trends in Cognitive Sciences.

[2]  Lester C. Loschky,et al.  The contributions of central and peripheral vision to scene gist recognition with a 180° visual field. , 2015, Journal of vision.

[3]  M. Pomplun,et al.  The roles of scene gist and spatial dependency among objects in the semantic guidance of attention in real-world scenes , 2014, Vision Research.

[4]  Monica S. Castelhano,et al.  Peripheral guidance in scenes: The interaction of scene context and object content. , 2014, Journal of experimental psychology. Human perception and performance.

[5]  Leyre Castro,et al.  Pigeons exhibit contextual cueing to both simple and complex backgrounds , 2014, Behavioural Processes.

[6]  Ryan V. Ringer,et al.  The spatiotemporal dynamics of scene gist recognition. , 2014, Journal of experimental psychology. Human perception and performance.

[7]  M. Pomplun,et al.  Guidance of visual attention by semantic information in real-world scenes , 2014, Front. Psychol..

[8]  Sennay Ghebreab,et al.  From Image Statistics to Scene Gist: Evoked Neural Activity Reveals Transition from Low-Level Natural Image Structure to Scene Category , 2013, The Journal of Neuroscience.

[9]  Michelle R. Greene Statistics of high-level scene context , 2013, Front. Psychol..

[10]  Stephen C. Mack,et al.  Rethinking human visual attention: Spatial cueing effects and optimality of decisions by honeybees, monkeys and humans , 2013, Vision Research.

[11]  Fei Guo,et al.  Neural Representations of Contextual Guidance in Visual Search of Real-World Scenes , 2013, The Journal of Neuroscience.

[12]  C. Ranganath,et al.  Two cortical systems for memory-guided behaviour , 2012, Nature Reviews Neuroscience.

[13]  J. Wolfe,et al.  When does repeated search in scenes involve memory? Looking at versus looking for objects in scenes. , 2012, Journal of experimental psychology. Human perception and performance.

[14]  Miguel P Eckstein,et al.  Object co-occurrence serves as a contextual cue to guide and facilitate visual search in a natural viewing environment. , 2011, Journal of vision.

[15]  M. Carrasco Visual attention: The past 25 years , 2011, Vision Research.

[16]  Ashley M. Sherman,et al.  Visual search for arbitrary objects in real scenes , 2011, Attention, perception & psychophysics.

[17]  Alex D. Hwang,et al.  Semantic guidance of eye movements in real-world scenes , 2011, Vision Research.

[18]  M. Castelhano,et al.  Scene context influences without scene gist: Eye movements guided by spatial associations in visual search , 2011, Psychonomic bulletin & review.

[19]  Miguel P Eckstein,et al.  Visual search: a retrospective. , 2011, Journal of vision.

[20]  D. Ballard,et al.  Eye guidance in natural vision: reinterpreting salience. , 2011, Journal of vision.

[21]  Emily J. Ward,et al.  Eye-centered encoding of visual space in scene-selective regions. , 2010, Journal of vision.

[22]  Hao Su,et al.  Objects as Attributes for Scene Classification , 2010, ECCV Workshops.

[23]  M. Castelhano,et al.  The relative contribution of scene context and target features to visual search in scenes , 2010, Attention, perception & psychophysics.

[24]  Lester C. Loschky,et al.  The natural/man-made distinction is made before basic-level distinctions in scene gist processing , 2010 .

[25]  Jason A. Droll,et al.  Expected object position of two hundred fifty observers predicts first fixations of seventy seven separate observers during search , 2010 .

[26]  J. Henderson,et al.  Flashing scenes and moving windows: an effect of initial scene gist on eye movements , 2010 .

[27]  George L. Malcolm,et al.  Combining top-down processes to guide eye movements during real-world scene search. , 2010, Journal of vision.

[28]  Melissa L.-H. Võ,et al.  A glimpse is not a glimpse: Differential processing of flashed scene previews leads to differential target search benefits , 2010 .

[29]  George L. Malcolm,et al.  The effects of target template specificity on visual search in real-world scenes: evidence from eye movements. , 2009, Journal of vision.

[30]  Lester C. Loschky,et al.  The contributions of central versus peripheral vision to scene gist recognition. , 2009, Journal of vision.

[31]  Krista A. Ehinger,et al.  Modelling search for people in 900 scenes: A combined source model of eye guidance , 2009 .

[32]  Miguel P Eckstein,et al.  Learning cue validity through performance feedback. , 2009, Journal of Vision.

[33]  J. Henderson,et al.  The influence of color on the perception of scene gist. , 2008, Journal of experimental psychology. Human perception and performance.

[34]  Charan Ranganath,et al.  Medial Temporal Lobe Activity Predicts Successful Relational Memory Binding , 2008, The Journal of Neuroscience.

[35]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[36]  A. Torralba,et al.  The role of context in object recognition , 2007, Trends in Cognitive Sciences.

[37]  J. Henderson,et al.  Initial scene representations facilitate eye movement guidance in visual search. , 2007, Journal of experimental psychology. Human perception and performance.

[38]  M. Bar,et al.  The parahippocampal cortex mediates spatial and nonspatial associations. , 2007, Cerebral cortex.

[39]  P. Perona,et al.  What do we perceive in a glance of a real-world scene? , 2007, Journal of vision.

[40]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[41]  Iain D Gilchrist,et al.  Target location probability effects in visual search: an effect of sequential dependencies. , 2006, Journal of experimental psychology. Human perception and performance.

[42]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[43]  Gregory J. Zelinsky,et al.  Scene context guides eye movements during visual search , 2006, Vision Research.

[44]  Miguel P Eckstein,et al.  Attentional Cues in Real Scenes, Saccadic Targeting, and Bayesian Priors , 2005, Psychological science.

[45]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[46]  Olivier R. Joubert,et al.  How long to get to the “gist” of real-world natural scenes? , 2005 .

[47]  Yuanzhen Li,et al.  Feature congestion: a measure of display clutter , 2005, CHI.

[48]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[49]  Abel G. Oliva,et al.  Gist of a scene , 2005 .

[50]  Jodi L. Davenport,et al.  Scene Consistency in Object and Background Perception , 2004, Psychological science.

[51]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[52]  Yuhong V. Jiang,et al.  What is learned in spatial contextual cuing— configuration or individual locations? , 2004, Perception & psychophysics.

[53]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[54]  Paul E. Downing,et al.  Viewpoint-Specific Scene Representations in Human Parahippocampal Cortex , 2003, Neuron.

[55]  Miguel P Eckstein,et al.  Comparison of two weighted integration models for the cueing task: linear and likelihood. , 2003, Journal of vision.

[56]  J. Maunsell,et al.  The role of attention in visual processing. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[57]  A. Kramer,et al.  Attentional guidance of the eyes by contextual information and abrupt onsets. , 2001, Perception & psychophysics.

[58]  H H Bülthoff,et al.  Detection of animals in natural images using far peripheral vision , 2001, The European journal of neuroscience.

[59]  B. Dosher Mechanisms of Perceptual Attention , 2000 .

[60]  P. L. Smith,et al.  Attention and luminance detection: effects of cues, masks, and pedestals. , 2000, Journal of experimental psychology. Human perception and performance.

[61]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[62]  B. Dosher,et al.  Mechanisms of perceptual attention in precuing of location , 2000, Vision Research.

[63]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[64]  M. Chun,et al.  Top-Down Attentional Guidance Based on Implicit Learning of Visual Covariation , 1999 .

[65]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[66]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[67]  J. Henderson,et al.  Does consistent scene context facilitate object perception? , 1998, Journal of experimental psychology. General.

[68]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[69]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[70]  S J Luck,et al.  Mechanisms of visual-spatial attention: resource allocation or uncertainty reduction? , 1996, Journal of experimental psychology. Human perception and performance.

[71]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[72]  A. Pollatsek,et al.  Identification of objects in scenes: the role of scene background in object naming. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[73]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[74]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[75]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[76]  M. Potter Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[77]  tephen E. Palmer The effects of contextual scenes on the identification of objects , 1975, Memory & cognition.

[78]  I. Biederman Perceiving Real-World Scenes , 1972, Science.