Object recognition in dense clutter

Observers in recognition experiments invariably view objects against a blank background, whereas observers of real scenes sometimes view objects against dense clutter. In this study, we examined whether an object’s background affects the information used for recognition. Our stimuli consisted of color photographs of everyday objects. The photographs were organized either as a sparse array, as is typical of a visual search experiment, or as high density clutter, such as might be found in a toy chest, a handbag, or a kitchen drawer. The observer’s task was to locate an animal, vehicle, or food target in the stimulus. We varied the information in the stimuli by convolving them with a low-pass filter (blur) or a high-pass filter (edge) or converting them to grayscale. In two experiments, we found that the blur and edge manipulations produced a modest decrement in performance with the sparse arrangement but a severe decrement in performance with the clutter arrangement. These results indicate that the information used for recognition depends on the object’s background. Thus, models of recognition that have been developed for isolated objects may not generalize to objects in dense clutter.

[1]  R. Gregory The intelligent eye , 1970 .

[2]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  H. Barrow,et al.  Computational vision , 1981, Proceedings of the IEEE.

[4]  H L Kundel,et al.  A visual concept shapes image perception. , 1983, Radiology.

[5]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[6]  Elizabeth S. Spelke,et al.  Principles of Object Perception , 1990, Cogn. Sci..

[7]  G. Legge,et al.  Color improves object recognition in normal and low vision , 1993 .

[8]  M. Peterson Object Recognition Processes Can and Do Operate Before Figure–Ground Organization , 1994 .

[9]  Gordon E. Legge,et al.  Human efficiency for recognizing and detecting low-pass filtered objects , 1995, Vision Research.

[10]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[11]  E. Rolls High-level vision: Object recognition and visual cognition, Shimon Ullman. MIT Press, Bradford (1996), ISBN 0 262 21013 4 , 1997 .

[12]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[13]  Stephen A. Engel,et al.  Linearity across spatial frequency in object recognition , 1998, Vision Research.

[14]  Pietro Perona,et al.  A Probabilistic Approach to Object Recognition Using Local Photometry and Global Geometry , 1998, ECCV.

[15]  Michael D. Heath,et al.  Are edges sufficient for object recognition? , 1998 .

[16]  David G. Lowe,et al.  Towards a Computational Model for Object Recognition in IT Cortex , 2000, Biologically Motivated Computer Vision.

[17]  G Richard,et al.  Ultra-rapid categorisation of natural scenes does not rely on colour cues: a study in monkeys and humans , 2000, Vision Research.

[18]  Michel Vidal-Naquet,et al.  A Fragment-Based Approach to Object Representation and Classification , 2001, IWVF.

[19]  I. Biederman,et al.  Size tuning in the absence of spatial frequency tuning in object recognition , 2001, Vision Research.

[20]  D. Weiskopf,et al.  The role of color in high-level vision , 2001, Trends in Cognitive Sciences.

[21]  Laurie R Santos,et al.  Recognition and categorization of biologically significant objects by rhesus monkeys (Macaca mulatta): the domain of food , 2001, Cognition.

[22]  Shimon Ullman,et al.  Class-Specific, Top-Down Segmentation , 2002, ECCV.

[23]  M. Bar A Cortical Mechanism for Triggering Top-Down Facilitation in Visual Object Recognition , 2003, Journal of Cognitive Neuroscience.

[24]  A. Needham,et al.  4.5-month-old infants’ learning, retention and use of object boundary information , 2003 .

[25]  M. Bravo,et al.  Object segmentation by top-down processes , 2003 .

[26]  B. Rossion,et al.  Revisiting Snodgrass and Vanderwart's Object Pictorial Set: The Role of Surface Detail in Basic-Level Object Recognition , 2004, Perception.

[27]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[28]  R. French,et al.  The Importance of Starting Blurry: Simulating Improved Basic-Level Category Learning in Infants Due to Weak Visual Acuity , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.