Separation and contrast enhancement of overlapping cast shadow components using polarization.

Shadow is an inseparable aspect of all natural scenes. When there are multiple light sources or multiple reflections several different shadows may overlap at the same location and create complicated patterns. Shadows are a potentially good source of information about a scene if the shadow regions can be properly identified and segmented. However, shadow region identification and segmentation is a difficult task and improperly identified shadows often interfere with machine vision tasks like object recognition and tracking. We propose here a new shadow separation and contrast enhancement method based on the polarization of light. Polarization information of the scene captured by our polarization-sensitive camera is shown to separate shadows from different light sources effectively. Such shadow separation is almost impossible to realize with conventional, polarization-insensitive imaging.

[1]  J. Marchant,et al.  Shadow-invariant classification for scenes illuminated by daylight. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[4]  Edward N Pugh,et al.  Adaptive algorithms for two-channel polarization sensing under various polarization statistics with nonuniform distributions. , 2006, Applied optics.

[5]  R. Bruce Irvin,et al.  Methods For Exploiting The Relationship Between Buildings And Their Shadows In Aerial Imagery , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[6]  Nader Engheta,et al.  Polarization enhanced visual surveillance techniques , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[7]  Yee-Hong Yang,et al.  Illuminant direction determination for multiple light sources , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  J S Tyo,et al.  Target detection in optically scattering media by polarization-difference imaging. , 1996, Applied optics.

[9]  Katsushi Ikeuchi,et al.  Illumination from Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Dmitry B. Goldgof,et al.  A Simple Strategy for Calibrating the Geometry of Light Sources , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Jörn Ostermann,et al.  Detection of Moving Cast Shadows for Object Segmentation , 1999, IEEE Trans. Multim..

[12]  R. Schwind,et al.  Zonation of the optical environment and zonation in the rhabdom structure within the eye of the backswimmer, Notonecta glauca , 2004, Cell and Tissue Research.

[13]  Edward N Pugh,et al.  Polarization-based and specular-reflection-based noncontact latent fingerprint imaging and lifting. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[14]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[15]  Theo Gevers,et al.  Classifying color edges in video into shadow-geometry, highlight, or material transitions , 2003, IEEE Trans. Multim..

[16]  Makoto Nagao,et al.  Region extraction and shape analysis in aerial photographs , 1979 .

[17]  R Wehner,et al.  Polarized-light navigation by insects. , 1976, Scientific American.

[18]  N. Engheta,et al.  Polarization-difference imaging: a biologically inspired technique for observation through scattering media. , 1995, Optics letters.

[19]  Dennis H. Goldstein,et al.  Polarimetric characterization of Spectralon , 1999, Optics + Photonics.

[20]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  A. Pentland Finding the illuminant direction , 1982 .

[22]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[23]  Sei-Wang Chen,et al.  Shadow detection and removal for traffic images , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[24]  Richard W. Christiansen,et al.  A shadow detection and removal algorithm for 2-D images , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[25]  Azriel Rosenfeld,et al.  Detecting clouds and cloud shadows on aerial photographs , 1991, Pattern Recognit. Lett..

[26]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[27]  John K. Tsotsos,et al.  Ambient illumination and the determination of material changes. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[28]  Claire-Lise Mottaz Jiang,et al.  Shadow segmentation and classification in a constrained environment , 1994 .

[29]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[30]  Horváth,et al.  Reflection-polarization patterns at flat water surfaces and their relevance for insect polarization vision , 1995, Journal of theoretical biology.

[31]  Walter G. Egan Dark-target retroreflection increase , 1999, Optics + Photonics.

[32]  Ruzena Bajcsy,et al.  Combining color and geometry for the active, visual recognition of shadows , 1995, Proceedings of IEEE International Conference on Computer Vision.

[33]  Michael J. Duggin,et al.  Imaging polarimetry in scene element discrimination , 1999, Optics + Photonics.

[34]  Nader Engheta,et al.  Bio-inspired display of polarization information using selected visual cues , 2003, SPIE Optics + Photonics.

[35]  J. Scott Tyo,et al.  Colorimetric representations for use with polarization-difference imaging of objects in scattering media , 1998 .

[36]  K. Frisch,et al.  Die Polarisation des Himmelslichtes als orientierender Faktor bei den Tänzen der Bienen , 1949, Experientia.

[37]  Nader Engheta,et al.  Display of polarization information by coherently moving dots. , 2003, Optics express.

[38]  Bir Bhanu,et al.  Physical models for moving shadow and object detection in video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.