Invariant Recognition of Natural Objects in the Presence of Shadows

Shadows are frequently present when we recognize natural objects, but it is unclear whether they help or hinder recognition. Shadows could improve recognition by providing information about illumination and 3-D surface shape, or impair recognition by introducing spurious contours that are confused with object boundaries. In three experiments, we explored the effect of shadows on recognition of natural objects. The stimuli were digitized photographs of fruits and vegetables displayed with or without shadows. In experiment 1, we evaluated the effects of shadows, color, and image resolution on naming latency and accuracy. Performance was not affected by the presence of shadows, even for gray-scale, blurry images, where shadows are difficult to identify. In experiment 2, we explored recognition of two-tone images of the same objects. In these images, shadow edges are difficult to distinguish from object and surface edges because all edges are defined by a luminance boundary. Shadows impaired performance, but only in the early trials. In experiment 3, we examined whether shadows have a stronger impact when exposure time is limited, allowing little time for processing shadows; no effect of shadows was found. These studies show that recognition of natural objects is highly invariant to the complex luminance patterns caused by shadows.

[1]  C. M. Mooney Age in the development of closure ability in children. , 1957, Canadian journal of psychology.

[2]  Ewald Hering Outlines of a theory of the light sense , 1964 .

[3]  L. Stone Illusory motion. , 1967, The American journal of psychology.

[4]  J. Beck Surface color perception , 1972 .

[5]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[6]  A Yonas,et al.  Development of Sensitivity to Information Provided by Cast Shadows in Pictures , 1978, Perception.

[7]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  Makoto Nagao,et al.  Region extraction and shape analysis in aerial photographs , 1979 .

[9]  R. Reynolds,et al.  Perception of an Illusory Contour as a Function of Processing Time , 1981, Perception.

[10]  E. Warrington Neuropsychological studies of object recognition. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Takeo Kanade,et al.  Using shadows in finding surface orientations , 1983, Comput. Vis. Graph. Image Process..

[12]  K. Berbaum,et al.  Light Source Position in the Perception of Object Shape , 1983, Perception.

[13]  J. Davidoff,et al.  Some effects of color on naming and recognition of objects. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[14]  J. Davidoff,et al.  Some effects of color on naming and recognition of objects. , 1985 .

[15]  I. Biederman,et al.  Surface versus edge-based determinants of visual recognition , 1988, Cognitive Psychology.

[16]  Antonio Medina Puerta,et al.  The power of shadows: shadow stereopsis , 1989 .

[17]  Patrick Cavanagh,et al.  Shape from shadows. , 1989 .

[18]  A. Medina Puerta The power of shadows: shadow stereopsis. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[19]  P. Cavanagh,et al.  Shape from shadows. , 1989, Journal of experimental psychology. Human perception and performance.

[20]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[21]  Patrick Cavanagh,et al.  What's up in top-down processing? , 1991 .

[22]  S. Edelman,et al.  Orientation dependence in the recognition of familiar and novel views of three-dimensional objects , 1992, Vision Research.

[23]  J. Koenderink,et al.  Perception of local shape from shading , 1993, Perception & psychophysics.

[24]  G. Legge,et al.  Color improves object recognition in normal and low vision , 1993 .

[25]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[26]  Heinrich H. Bülthoff,et al.  General lighting can overcome accidental viewing , 1994 .

[27]  H H Bülthoff,et al.  How are three-dimensional objects represented in the brain? , 1994, Cerebral cortex.

[28]  ALAN JOHNSTON,et al.  Investigating Shape-from-shading Illusions Using Solid Objects , 1996, Vision Research.

[29]  Pascal Mamassian,et al.  Illusory motion from shadows , 1996, Nature.

[30]  M. Tarr,et al.  Becoming a “Greeble” Expert: Exploring Mechanisms for Face Recognition , 1997, Vision Research.

[31]  Wendy L. Braje,et al.  Illumination effects in face recognition , 1998, Psychobiology.

[32]  Patrick Cavanagh,et al.  Recovery of 3D volume from 2-tone images of novel objects , 1998, Cognition.

[33]  Heinrich H Bülthoff,et al.  Why the visual recognition system might encode the effects of illumination , 1998, Vision Research.

[34]  Dandi Daley Mackall A Horse of a Different Color , 2000 .