Strong shadow removal via patch-based shadow edge detection

Detecting objects in shadows is a challenging task in computer vision. For example, in clear path detection application, strong shadows on the road confound the detection of the boundary between clear path and obstacles, making clear path detection algorithms less robust. Shadow removal, relies on the classification of edges as shadow edges or non-shadow edges. We present an algorithm to detect strong shadow edges, which enables us to remove shadows. By analyzing the patch-based characteristics of shadow edges and non-shadow edges (e.g., object edges), the proposed detector can discriminate strong shadow edges from other edges in images by learning the distinguishing characteristics. In addition, spatial smoothing is used to further improve shadow edge detection. Numerical experiments show convincing results that shadows on the road are either removed or attenuated with few visual artifacts, which benefits the clear path detection. In addition, we show that the proposed method outperforms the state-of-art algorithms in different conditions.

[1]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  M. S. Drew,et al.  Recovery of a chromaticity image free from shadows via illumination invariance , 2003 .

[3]  Alexei A. Efros,et al.  Detecting Ground Shadows in Outdoor Consumer Photographs , 2010, ECCV.

[4]  Antonio Criminisi,et al.  Object categorization by learned universal visual dictionary , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[5]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Theo Gevers,et al.  Shadow edge detection using geometric and photometric features , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[7]  Jiejie Zhu,et al.  Learning to recognize shadows in monochromatic natural images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Cheng Lu,et al.  Intrinsic Images by Entropy Minimization , 2004, ECCV.

[9]  Rita Cucchiara,et al.  Detecting objects, shadows and ghosts in video streams by exploiting color and motion information , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[10]  Cheng Lu,et al.  Entropy Minimization for Shadow Removal , 2009, International Journal of Computer Vision.

[11]  Li Xu,et al.  Shadow Removal from a Single Image , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[12]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[13]  Qi Wu,et al.  Camera-based clear path detection , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.