Robust and accurate moving shadow detection based on multiple features fusion

Abstract In recent years, moving cast shadow detection has been becoming a critical challenge to improve the accuracy of moving object detection in video surveillance. In this paper, we derive a robust moving cast shadow detection method based on multiple features fusion. Firstly, several kinds of features such as intensity, color and texture are extracted sufficiently by means of various measures for the foreground image. Then, the synthetic feature map is generated by linear combination of these features. Consequently, moving cast shadow pixels are distinguished from their moving objects roughly. Finally, spatial adjustment is applied to correct misclassified pixels for acquiring the refined shadow detection result. The effectiveness of our proposed method is evaluated on various scenes. The results demonstrate that the method can achieve high detection rate. In particular, the experiments also indicate that it significantly outperforms several state-of-the-art methods by extensive comparisons.

[1]  Kai-Tai Song,et al.  Image-Based Traffic Monitoring With Shadow Suppression , 2007, Proceedings of the IEEE.

[2]  Jin Young Choi,et al.  Adaptive shadow estimator for removing shadow of moving object , 2010, Comput. Vis. Image Underst..

[3]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Shengcai Liao,et al.  Moving Cast Shadow Removal Based on Local Descriptors , 2010, 2010 20th International Conference on Pattern Recognition.

[5]  Jordi Gonzàlez,et al.  Accurate Moving Cast Shadow Suppression Based on Local Color Constancy Detection , 2011, IEEE Transactions on Image Processing.

[6]  Nasrollah Moghaddam Charkari,et al.  Robust moving shadow detection with hierarchical mixture of MLP experts , 2014, Signal Image Video Process..

[7]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[8]  Saroj K. Meher,et al.  Efficient method of moving shadow detection and vehicle classification , 2013 .

[9]  Nicolas Martel-Brisson,et al.  Learning and Removing Cast Shadows through a Multidistribution Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Brian C. Lovell,et al.  Improved Shadow Removal for Robust Person Tracking in Surveillance Scenarios , 2010, 2010 20th International Conference on Pattern Recognition.

[11]  S. Engel,et al.  Colour tuning in human visual cortex measured with functional magnetic resonance imaging , 1997, Nature.

[12]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[13]  Bir Bhanu,et al.  Physical models for moving shadow and object detection in video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Chongzhao Han,et al.  Moving shadow detection and removal for traffic sequences , 2007, Int. J. Autom. Comput..

[15]  Wei Zhang,et al.  Moving Cast Shadows Detection Using Ratio Edge , 2007, IEEE Transactions on Multimedia.

[16]  Jun Kong,et al.  Integrated moving cast shadows detection method for surveillance videos , 2012 .

[17]  Alessandro Leone,et al.  Shadow detection for moving objects based on texture analysis , 2007, Pattern Recognit..

[18]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[19]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  A. Venetsanopoulos,et al.  A color segmentation scheme for object-based video coding , 1998, 1998 IEEE Symposium on Advances in Digital Filtering and Signal Processing. Symposium Proceedings (Cat. No.98EX185).

[21]  Pietro Perona,et al.  Overcomplete steerable pyramid filters and rotation invariance , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Jun-Wei Hsieh,et al.  Shadow elimination for effective moving object detection by Gaussian shadow modeling , 2003, Image Vis. Comput..

[23]  Hagit Hel-Or,et al.  Moving shadow detection by nonlinear Tone-Mapping , 2012, 2012 19th International Conference on Systems, Signals and Image Processing (IWSSIP).

[24]  Liu Zhi Fang,et al.  A method to segment moving vehicle cast shadow based on wavelet transform , 2008, Pattern Recognit. Lett..

[25]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[26]  Chin-Teng Lin,et al.  An Efficient and Robust Moving Shadow Removal Algorithm and Its Applications in ITS , 2010, EURASIP J. Adv. Signal Process..

[27]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[28]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[30]  Nikolaos Papanikolopoulos,et al.  Learning to Detect Moving Shadows in Dynamic Environments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Norimichi Tsumura,et al.  Background updating and shadow detection based on spatial, color, and texture information of detected objects , 2012 .

[32]  Reinhard Koch,et al.  A Color Similarity Measure for Robust Shadow Removal in Real Time , 2003, VMV.

[33]  Thomas B. Moeslund,et al.  Detection and removal of chromatic moving shadows in surveillance scenarios , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[34]  Shutao Li,et al.  Moving Cast Shadow Detection of Vehicle Using Combined Color Models , 2010, 2010 Chinese Conference on Pattern Recognition (CCPR).

[35]  Soraia Raupp Musse,et al.  Background Subtraction and Shadow Detection in Grayscale Video Sequences , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).

[36]  Edward Jones,et al.  Shadow identification for digital imagery using colour and texture cues , 2012 .