Integrated moving cast shadows detection method for surveillance videos

Abstract. Moving cast shadow detection plays an exceedingly important role in content-based analysis in surveillance videos. A novel integrated moving cast shadow detection method is proposed for accurate moving objects detection. Based on the analysis for shadow model, we first exploit color information sufficiently in hue, saturation, and value color space and texture similarity in texture space to separate moving cast shadows from the foreground, respectively. Then we obtain the rough shadow detection result by means of synthesizing the above two results efficiently. Finally, post processing is put forward to modify misclassified pixels for acquiring the refined shadow detection result. Extensive experiments and comparisons of various scenes prove that the proposed method can detect cast shadows automatically and effectively and outperforms some well-known methods.

[1]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[2]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[3]  Chin-Teng Lin,et al.  An Efficient and Robust Moving Shadow Removal Algorithm and Its Applications in ITS , 2010, EURASIP J. Adv. Signal Process..

[4]  Chris Chatwin,et al.  On shadow elimination after moving region segmentation based on different threshold selection strategies , 2007 .

[5]  Osama Masoud,et al.  Moving Shadow Detection with Low- and Mid-Level Reasoning , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6]  Reinhard Koch,et al.  A Color Similarity Measure for Robust Shadow Removal in Real Time , 2003, VMV.

[7]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jin Young Choi,et al.  Adaptive shadow estimator for removing shadow of moving object , 2010, Comput. Vis. Image Underst..

[9]  Shutao Li,et al.  Moving Cast Shadow Detection of Vehicle Using Combined Color Models , 2010, 2010 Chinese Conference on Pattern Recognition (CCPR).

[10]  Jörn Ostermann,et al.  Detection of Moving Cast Shadows for Object Segmentation , 1999, IEEE Trans. Multim..

[11]  Nikolaos Papanikolopoulos,et al.  Learning to Detect Moving Shadows in Dynamic Environments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Nikolaos Papanikolopoulos,et al.  Learning of moving cast shadows for dynamic environments , 2008, 2008 IEEE International Conference on Robotics and Automation.

[13]  Brian C. Lovell,et al.  Improved Shadow Removal for Robust Person Tracking in Surveillance Scenarios , 2010, 2010 20th International Conference on Pattern Recognition.

[14]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Rita Cucchiara,et al.  Improving shadow suppression in moving object detection with HSV color information , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[16]  A. Venetsanopoulos,et al.  A color segmentation scheme for object-based video coding , 1998, 1998 IEEE Symposium on Advances in Digital Filtering and Signal Processing. Symposium Proceedings (Cat. No.98EX185).

[17]  Tim J. Ellis,et al.  Image Difference Threshold Strategies and Shadow Detection , 1995, BMVC.

[18]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[19]  Liu Zhi Fang,et al.  A method to segment moving vehicle cast shadow based on wavelet transform , 2008, Pattern Recognit. Lett..

[20]  Bir Bhanu,et al.  Physical models for moving shadow and object detection in video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Alessandro Leone,et al.  Shadow detection for moving objects based on texture analysis , 2007, Pattern Recognit..

[22]  Jun-Wei Hsieh,et al.  Shadow elimination for effective moving object detection by Gaussian shadow modeling , 2003, Image Vis. Comput..

[23]  Kai-Tai Song,et al.  Image-Based Traffic Monitoring With Shadow Suppression , 2007, Proceedings of the IEEE.

[24]  Wei Zhang,et al.  Moving Cast Shadows Detection Using Ratio Edge , 2007, IEEE Transactions on Multimedia.

[25]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[26]  Shengcai Liao,et al.  Moving Cast Shadow Removal Based on Local Descriptors , 2010, 2010 20th International Conference on Pattern Recognition.

[27]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..