Moving Cast Shadow Detection in Video Based on New Chromatic Criteria and Statistical Modeling

A novel moving cast shadow detection method is presented in this paper to detect and remove the cast shadows from the foreground. First, the foreground is detected using the global foreground modeling (GFM) method. Second, the moving cast shadow is detected and removed from the foreground using a new moving cast shadow detection method that contains four hierarchical steps. In the first step, a set of new chromatic criteria is presented to detect the candidate shadow pixels in the HSV color space. In the second step, a new shadow region detection method is proposed to cluster the candidate shadow pixels into shadow regions. In the third step, a statistical shadow model, which uses a single Gaussian distribution to model the shadow class, is presented to classify shadow pixels. In the last step, an aggregated shadow detection method is presented for final shadow detection. Experiments using the public video data 'Highway-3' and the real traffic data from the New Jersey Department of Transportation (NJDOT) show the feasibility of the proposed method.

[1]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[2]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Derek Hoiem,et al.  Paired Regions for Shadow Detection and Removal , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Xin Zhao,et al.  Densely Cascaded Shadow Detection Network via Deeply Supervised Parallel Fusion , 2018, IJCAI.

[5]  Yong Zhao,et al.  Moving cast shadow detection using joint color and texture features based on direction and distance , 2016, 2016 2nd IEEE International Conference on Computer and Communications (ICCC).

[6]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Alexei A. Efros,et al.  Detecting Ground Shadows in Outdoor Consumer Photographs , 2010, ECCV.

[8]  Chengjun Liu,et al.  A New Global Foreground Modeling and Local Background Modeling Method for Video Analysis , 2018, MLDM.

[9]  Dimitris Samaras,et al.  A+D Net: Training a Shadow Detector with Adversarial Shadow Attenuation , 2017, ECCV.

[10]  Soon Ki Jung,et al.  Decomposition into Low-rank plus Additive Matrices for Background/Foreground Separation: A Review for a Comparative Evaluation with a Large-Scale Dataset , 2015, Comput. Sci. Rev..

[11]  Chu-Song Chen,et al.  Moving cast shadow detection using physics-based features , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[13]  Alessandro Leone,et al.  Shadow detection for moving objects based on texture analysis , 2007, Pattern Recognit..

[14]  Jun-Wei Hsieh,et al.  Shadow elimination for effective moving object detection by Gaussian shadow modeling , 2003, Image Vis. Comput..

[15]  Hagit Hel-Or,et al.  Moving shadow detection by nonlinear Tone-Mapping , 2012, 2012 19th International Conference on Systems, Signals and Image Processing (IWSSIP).

[16]  Chi-Wing Fu,et al.  Bidirectional Feature Pyramid Network with Recurrent Attention Residual Modules for Shadow Detection , 2018, ECCV.

[17]  Abhijeet Bajpayee,et al.  A survey on shadow detection and removal based on single light source , 2015, 2015 IEEE 9th International Conference on Intelligent Systems and Control (ISCO).

[18]  Brian C. Lovell,et al.  Improved Shadow Removal for Robust Person Tracking in Surveillance Scenarios , 2010, 2010 20th International Conference on Pattern Recognition.

[19]  Chengjun Liu,et al.  A New Foreground Segmentation Method for Video Analysis in Different Color Spaces , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[20]  Wen-Chung Kao,et al.  An enhanced segmentation on vision-based shadow removal for vehicle detection , 2010, The 2010 International Conference on Green Circuits and Systems.

[21]  Harish Bhaskar,et al.  On the Role and the Importance of Features for Background Modeling and Foreground Detection , 2016, Comput. Sci. Rev..

[22]  Bir Bhanu,et al.  Physical models for moving shadow and object detection in video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Dimitris Samaras,et al.  Leave-One-Out Kernel Optimization for Shadow Detection and Removal , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jordi Gonzàlez,et al.  Accurate Moving Cast Shadow Suppression Based on Local Color Constancy Detection , 2011, IEEE Transactions on Image Processing.

[25]  Jacob Scharcanski,et al.  Stochastic shadow detection using a hypergraph partitioning approach , 2017, Pattern Recognit..

[26]  Mohand Saïd Allili,et al.  Foreground Segmentation in Videos Combining General Gaussian Mixture Modeling and Spatial Information , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Yang Wang,et al.  Real-Time Moving Vehicle Detection With Cast Shadow Removal in Video Based on Conditional Random Field , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Shutao Li,et al.  Moving Cast Shadow Detection of Vehicle Using Combined Color Models , 2010, 2010 Chinese Conference on Pattern Recognition (CCPR).