Accurate Moving Cast Shadow Suppression Based on Local Color Constancy Detection

This paper describes a novel framework for detection and suppression of properly shadowed regions for most possible scenarios occurring in real video sequences. Our approach requires no prior knowledge about the scene, nor is it restricted to specific scene structures. Furthermore, the technique can detect both achromatic and chromatic shadows even in the presence of camouflage that occurs when foreground regions are very similar in color to shadowed regions. The method exploits local color constancy properties due to reflectance suppression over shadowed regions. To detect shadowed regions in a scene, the values of the background image are divided by values of the current frame in the RGB color space. We show how this luminance ratio can be used to identify segments with low gradient constancy, which in turn distinguish shadows from foreground. Experimental results on a collection of publicly available datasets illustrate the superior performance of our method compared with the most sophisticated, state-of-the-art shadow detection algorithms. These results show that our approach is robust and accurate over a broad range of shadow types and challenging video conditions.

[1]  Ronald L. Rivest,et al.  Introduction to Algorithms, Second Edition , 2001 .

[2]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[3]  Azriel Rosenfeld,et al.  Tracking Groups of People , 2000, Comput. Vis. Image Underst..

[4]  Nicolas Martel-Brisson,et al.  Kernel-based learning of cast shadows from a physical model of light sources and surfaces for low-level segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Nicolas Martel-Brisson,et al.  Learning and Removing Cast Shadows through a Multidistribution Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Ravi Ramamoorthi,et al.  A Fourier theory for cast shadows , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Chu-Song Chen,et al.  Moving cast shadow detection using physics-based features , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Jörn Ostermann,et al.  Detection of Moving Cast Shadows for Object Segmentation , 1999, IEEE Trans. Multim..

[10]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jürgen Stauder,et al.  Estimation of point light source parameters for object-based coding , 1995, Signal Process. Image Commun..

[13]  Wen-Kai Tai,et al.  Moving cast shadow detection by exploiting multiple cues , 2008 .

[14]  Thomas H. Cormen,et al.  Introduction to algorithms [2nd ed.] , 2001 .

[15]  Rita Cucchiara,et al.  Improving shadow suppression in moving object detection with HSV color information , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[16]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jordi Gonzàlez,et al.  Background subtraction technique based on chromaticity and intensity patterns , 2008, 2008 19th International Conference on Pattern Recognition.

[18]  Til Aach,et al.  Detection of moving shadows using mean shift clustering and a significance test , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[19]  Goro Obinata,et al.  Vision Systems: Segmentation and Pattern Recognition , 2007 .

[20]  Alan Watt,et al.  3D Computer Graphics , 1993 .

[21]  Fatih Murat Porikli,et al.  Shadow flow: a recursive method to learn moving cast shadows , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.