Moving Cast Shadows Detection Methods for Video Surveillance Applications

Moving cast shadows are a major concern in today’s performance from broad range of many vision-based surveillance applications because they highly difficult the object classification task. Several shadow detection methods have been reported in the literature during the last years. They are mainly divided into two domains. One usually works with static images, whereas the second one uses image sequences, namely video content. In spite of the fact that both cases can be analogously analyzed, there is a difference in the application field. The first case, shadow detection methods can be exploited in order to obtain additional geometric and semantic cues about shape and position of its casting object (‘shape from shadows’) as well as the localization of the light source. While in the second one, the main purpose is usually change detection, scene matching or surveillance (usually in a background subtraction context). Shadows can in fact modify in a negative way the shape and color of the target object and therefore affect the performance of scene analysis and interpretation in many applications. This chapter wills mainly reviews shadow detection methods as well as their taxonomies related with the second case, thus aiming at those shadows which are associated with moving objects (moving shadows).

[1]  Til Aach,et al.  Detection of moving shadows using mean shift clustering and a significance test , 2004, ICPR 2004.

[2]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[3]  Tieniu Tan,et al.  Cast Shadow Removal Combining Local and Global Features , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Touradj Ebrahimi,et al.  Shadow identification and classification using invariant color models , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[5]  Azriel Rosenfeld,et al.  Tracking Groups of People , 2000, Comput. Vis. Image Underst..

[6]  Ezequiel López-Rubio,et al.  Foreground Detection in Video Sequences with Probabilistic Self-Organizing Maps , 2011, Int. J. Neural Syst..

[7]  Bir Bhanu,et al.  Physical models for moving shadow and object detection in video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Vassilios Morellas,et al.  Robust Foreground Detection In Video Using Pixel Layers , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  K. Siala,et al.  Moving shadow detection with support vector domain description in the color ratios space , 2004, ICPR 2004.

[10]  Jun Shen,et al.  Motion detection in color image sequence and shadow elimination , 2004, IS&T/SPIE Electronic Imaging.

[11]  Rita Cucchiara,et al.  Improving shadow suppression in moving object detection with HSV color information , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[12]  Mubarak Shah,et al.  A hierarchical approach to robust background subtraction using color and gradient information , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[13]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[14]  Anthony C. Caputo,et al.  Digital Video Surveillance and Security , 2010 .

[15]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  Nuno Vasconcelos,et al.  Spatiotemporal Saliency in Dynamic Scenes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jordi Gonzàlez,et al.  Accurate Moving Cast Shadow Suppression Based on Local Color Constancy Detection , 2011, IEEE Transactions on Image Processing.

[18]  Tim J. Ellis,et al.  Image Difference Threshold Strategies and Shadow Detection , 1995, BMVC.

[19]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[21]  Dale Schuurmans,et al.  Real-Time Discriminative Background Subtraction , 2011, IEEE Transactions on Image Processing.

[22]  Yi-Ping Hung,et al.  Efficient hierarchical method for background subtraction , 2007, Pattern Recognit..

[23]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[24]  Thomas B. Moeslund,et al.  Detection and removal of chromatic moving shadows in surveillance scenarios , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[25]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[26]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[27]  Thomas Sikora,et al.  Comparison of static background segmentation methods , 2005, Visual Communications and Image Processing.

[28]  Soraia Raupp Musse,et al.  A Background Subtraction Model Adapted to Illumination Changes , 2006, 2006 International Conference on Image Processing.

[29]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[30]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[31]  Xiangzhong Fang,et al.  Moving Cast Shadow Detection , 2007 .

[32]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Nikos Paragios,et al.  Motion-based background subtraction using adaptive kernel density estimation , 2004, CVPR 2004.

[34]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[35]  O. Silven,et al.  A real-time system for monitoring of cyclists and pedestrians , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[36]  Alessandro Leone,et al.  Shadow detection for moving objects based on texture analysis , 2007, Pattern Recognit..

[37]  José María Martínez Sanchez,et al.  On the Evaluation of Background Subtraction Algorithms without Ground-Truth , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[38]  Reinhard Koch,et al.  A Color Similarity Measure for Robust Shadow Removal in Real Time , 2003, VMV.

[39]  Benjamin Höferlin,et al.  Evaluation of background subtraction techniques for video surveillance , 2011, CVPR 2011.

[40]  Wen-Kai Tai,et al.  Moving cast shadow detection by exploiting multiple cues , 2008 .

[41]  Fatih Murat Porikli,et al.  Shadow flow: a recursive method to learn moving cast shadows , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[42]  Nicolas Martel-Brisson,et al.  Learning and Removing Cast Shadows through a Multidistribution Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Tiziana D'Orazio,et al.  Moving object segmentation by background subtraction and temporal analysis , 2006, Image Vis. Comput..

[44]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[45]  Chenhui Yang,et al.  Simple Vehicle Detection with Shadow Removal at Intersection , 2010, 2010 Second International Conference on Multimedia and Information Technology.

[46]  Patrick Pérez,et al.  Detection and segmentation of moving objects in highly dynamic scenes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Goro Obinata,et al.  Vision Systems: Segmentation and Pattern Recognition , 2007 .

[48]  Jean-Marc Odobez,et al.  Multi-Layer Background Subtraction Based on Color and Texture , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Andrea Fusiello,et al.  Patch-Based Background Initialization in Heavily Cluttered Video , 2010, IEEE Transactions on Image Processing.

[50]  Jörn Ostermann,et al.  Detection of Moving Cast Shadows for Object Segmentation , 1999, IEEE Trans. Multim..

[51]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Grantham K. H. Pang,et al.  Effective moving cast shadow detection for monocular color image sequences , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[53]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[54]  Nicolas Martel-Brisson,et al.  Kernel-based learning of cast shadows from a physical model of light sources and surfaces for low-level segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[55]  Azriel Rosenfeld,et al.  Detection and location of people in video images using adaptive fusion of color and edge information , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[56]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[57]  F. Xavier Roca,et al.  Robust Real-Time Background Subtraction Based on Local Neighborhood Patterns , 2010, EURASIP J. Adv. Signal Process..

[58]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[59]  Wen-Fong Hu,et al.  A shadow elimination method for vehicle analysis , 2004, ICPR 2004.

[60]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[61]  Chu-Song Chen,et al.  Moving cast shadow detection using physics-based features , 2009, CVPR.

[62]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[63]  Tieniu Tan,et al.  Recent developments in human motion analysis , 2003, Pattern Recognit..

[64]  Xuelong Li,et al.  Cast shadow detection in video segmentation , 2005, Pattern Recognit. Lett..

[65]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Jun-Wei Hsieh,et al.  Shadow elimination for effective moving object detection with Gaussian models , 2002, Object recognition supported by user interaction for service robots.

[67]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Touradj Ebrahimi,et al.  Spatio-temporal shadow segmentation and tracking , 2003, IS&T/SPIE Electronic Imaging.