Adaptive shadow estimator for removing shadow of moving object

We propose an adaptive shadow estimator to detect and eliminate the shadow of a moving object while adapting to variation of illumination and the environment in an automatic manner. The proposed method discriminates between the shadow and the moving object by cascading three estimators which use the properties of chromaticity, brightness, and local intensity ratio. In the spatial adjustment step, the method compensates for accumulated errors in the cascading process. Experimental results show that our scheme can operate in real-time, outperforms existing methods, and rapidly adapts to variations in the environment.

[1]  Wei Chen,et al.  A Novel Algorithm of Moving Cast Shadow Suppression , 2006, 2006 8th international Conference on Signal Processing.

[2]  Quan Pan,et al.  A Robust Moving Object Detection Approach , 2008, 2008 Congress on Image and Signal Processing.

[3]  Xuelong Li,et al.  Insignificant shadow detection for video segmentation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Nicolas Martel-Brisson,et al.  Learning and Removing Cast Shadows through a Multidistribution Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Li-Qun Xu,et al.  An Efficient Object Segmentation Algorithm with Dynamic and Selective Background Updating and Shadow Removal , 2006, 2006 International Conference on Image Processing.

[6]  Yang Wang,et al.  Real-Time Moving Vehicle Detection With Cast Shadow Removal in Video Based on Conditional Random Field , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Nizar Bouguila,et al.  Unsupervised selection of a finite Dirichlet mixture model: an MML-based approach , 2006, IEEE Transactions on Knowledge and Data Engineering.

[8]  Yang Wang,et al.  A dynamic conditional random field model for foreground and shadow segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Tamás Szirányi,et al.  Bayesian Foreground and Shadow Detection in Uncertain Frame Rate Surveillance Videos , 2008, IEEE Transactions on Image Processing.

[10]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[11]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[12]  Jwu-Sheng Hu,et al.  Robust Background Subtraction with Shadow and Highlight Removal for Indoor Surveillance , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jörn Ostermann,et al.  Detection of Moving Cast Shadows for Object Segmentation , 1999, IEEE Trans. Multim..

[15]  Nikolaos Papanikolopoulos,et al.  Learning to Detect Moving Shadows in Dynamic Environments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[17]  Chu-Song Chen,et al.  A physical approach to Moving Cast Shadow Detection , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Liang Xu,et al.  Adaptive threshold shadow detection based on image block statistics , 2008, 2008 9th International Conference on Signal Processing.

[19]  M.R. Javan,et al.  An Efficient Object Segmentation Algorithm for Surveillance Systems , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[20]  Alan Hanjalic,et al.  Autonomous and Adaptive Learning of Shadows for Surveillance , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[21]  Kai-Tai Song,et al.  Image-Based Traffic Monitoring With Shadow Suppression , 2007, Proceedings of the IEEE.

[22]  Nicolas Martel-Brisson,et al.  Kernel-based learning of cast shadows from a physical model of light sources and surfaces for low-level segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Wen-Kai Tai,et al.  Moving cast shadow detection by exploiting multiple cues , 2008 .

[24]  Sung-Ho Kim,et al.  Similarity Measure and Shadow Casting Method for Object Tracking , 2007, Sixth International Conference on Advanced Language Processing and Web Information Technology (ALPIT 2007).

[25]  Wei Zhang,et al.  Moving Cast Shadows Detection Using Ratio Edge , 2007, IEEE Transactions on Multimedia.

[26]  Fei-Yue Wang,et al.  Moving Object Refining in Traffic Monitoring Applications , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[27]  Liang-Gee Chen,et al.  Fast video segmentation algorithm with shadow cancellation, global motion compensation, and adaptive threshold techniques , 2004, IEEE Transactions on Multimedia.

[28]  C. Techawatcharapaikul,et al.  Outdoor vehicle and shadow segmentation by temporal edge density information of adjacent frames , 2008, 2008 5th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[29]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[30]  Fatih Murat Porikli,et al.  Shadow flow: a recursive method to learn moving cast shadows , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[31]  David G. Stork,et al.  Pattern Classification , 1973 .

[32]  Nikolaos Papanikolopoulos,et al.  Learning of moving cast shadows for dynamic environments , 2008, 2008 IEEE International Conference on Robotics and Automation.

[33]  Mohan M. Trivedi,et al.  Moving shadow and object detection in traffic scenes , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[34]  Bir Bhanu,et al.  Physical models for moving shadow and object detection in video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Osama Masoud,et al.  Moving Shadow Detection with Low- and Mid-Level Reasoning , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[36]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Hsien-Che Lee,et al.  Introduction to Color Imaging Science , 2005 .

[38]  Hsien-Che Lee.  Introduction to Color Imaging Science: Eye optics , 2005 .

[39]  Xuan Yang,et al.  A statistical parameter learning method for cast shadow model , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[40]  Alessandro Leone,et al.  Shadow detection for moving objects based on texture analysis , 2007, Pattern Recognit..

[41]  K. Siala,et al.  Moving shadow detection with support vector domain description in the color ratios space , 2004, ICPR 2004.

[42]  Mubarak Shah,et al.  A hierarchical approach to robust background subtraction using color and gradient information , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[43]  Shang-Hong Lai,et al.  Adaptive Foreground Object Extraction for Real-Time Video Surveillance with Lighting Variations , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.