Many existing computer vision modules assume that shadows in an image have been accounted for prior to their application. In spite of this, relatively little work has been done on recognizing shadows or on recognizing a single surface material when directly lit and in shadow. This is in part because shadows cannot be infallible recognized until a scene's lighting and geometry are known. However, color is a strong cue to the presence of shadows. We present a general color image segmentation algorithm whose output is amenable to the recovery of shadows as determined by an analysis of the physics of shadow radiance. Then, we show how an observer that can cast its own shadows can infer enough information about a scene's illumination to refine the segmentation results to determine where the shadows in the scene are with reasonable confidence. Having an observer that can actively cast shadows frees us from restrictive assumptions about the scene illumination or the reliance on high level scene knowledge. We present results of our methods on images of complex indoor and outdoor scenes. Comments University of Pennsylvania Department of Computer and Information Science Technical Report No. MSCIS-92-82. This technical report is available at ScholarlyCommons: http://repository.upenn.edu/cis_reports/307 Active Color Image Analysis for Recognizing Shadows MS-CIS-92-82 GRASP LAB 336 Gareth Funka-Lea Ruzena Bajcsy University of Pennsylvania School of Engineering and Applied Science Computer and Information Science Department Philadelphia, PA 191 04-6389
[1]
David L. Waltz,et al.
Understanding Line drawings of Scenes with Shadows
,
1975
.
[2]
R. Bruce Irvin,et al.
Methods for exploiting the relationship between buildings and their shadows in aerial imagery
,
1989,
IEEE Trans. Syst. Man Cybern..
[3]
Ruzena Bajcsy,et al.
Segmentation as the search for the best description of the image in terms of primitives
,
1990,
[1990] Proceedings Third International Conference on Computer Vision.
[4]
Steven A. Shafer,et al.
Using color to separate reflection components
,
1985
.
[5]
R. Bruce Irvin,et al.
Methods For Exploiting The Relationship Between Buildings And Their Shadows In Aerial Imagery
,
1989,
Photonics West - Lasers and Applications in Science and Engineering.
[6]
K. Torrance,et al.
Theory for off-specular reflection from roughened surfaces
,
1967
.
[7]
John K. Tsotsos,et al.
Ambient illumination and the determination of material changes.
,
1986,
Journal of the Optical Society of America. A, Optics and image science.
[8]
J. M. Rubin,et al.
Color Vision: Representing Material Categories
,
1984
.