Combining color and geometry for the active, visual recognition of shadows

Shadows are a frequent occurrence, but they cannot be infallibly recognized until a scene's geometry and lighting are known. We present a number of cues which together strongly suggest the identification of a shadow and which can be examined with low cost. The techniques are: a color image segmentation method that recovers single material surfaces as single image regions irregardless of the surface partially in shadow, a method to recover the penumbra and umbra of shadow; a method for determining whether some object could be obstructing a light source. The last cue requires the examination of well understood shadows in the scene. Our observer is equipped with an extendable probe for casting its own shadows. Actively obtained shadows allow the observer to experimentally determine the location of the light sources in the scene. The system has been tested both indoors and out.<<ETX>>

[1]  Andrew P. Within.  Intensity-based edge classification , 1982, AAAI 1982.

[2]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[3]  Andrew P. Witkin,et al.  Intensity-Based Edge Classification , 1982, AAAI.

[4]  C. Jiang,et al.  Shadow identification , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  G. Funka-Lea,et al.  The visual recognition of shadows by an active observer , 1994 .

[6]  Azriel Rosenfeld,et al.  Detecting clouds and cloud shadows on aerial photographs , 1991, Pattern Recognit. Lett..

[7]  Richard W. Christiansen,et al.  A shadow detection and removal algorithm for 2-D images , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[8]  Ramakant Nevatia,et al.  Detecting buildings in aerial images , 1988, Comput. Vis. Graph. Image Process..

[9]  John K. Tsotsos,et al.  Ambient illumination and the determination of material changes. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[10]  J. M. Rubin,et al.  Color Vision: Representing Material Categories , 1984 .

[11]  Ruzena Bajcsy,et al.  Active Color Image Analysis for Recognizing Shadows , 1993, IJCAI.

[12]  David L. Waltz,et al.  Applications of the Connection Machine , 1990, Computer.

[13]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[14]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[15]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[16]  S. W. Lee.  Understanding of surface reflections in computer vision by color and multiple views , 1992 .

[17]  S. Shafer.  Shadows and Silhouettes in Computer Vision , 1985 .

[18]  Ruzena Bajcsy,et al.  Segmentation as the search for the best description of the image in terms of primitives , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[19]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[20]  Steven A. Shafer,et al.  Anatomy of a color histogram , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Makoto Nagao,et al.  Region extraction and shape analysis in aerial photographs , 1979 .