A background extraction and shadow removal algorithm based on clustering for ViBe

Shadow removal has always been one of the hot research topics in the fields of computer vision. Recently the ViBe (Visual background extraction) foreground extraction algorithm which is based on probability and statistics gets more and more attention due to its high speed and simplicity. However, its biggest drawback is the poor performance for videos with moving shadows. Because the process of the original ViBe algorithm is carried out in the gray space, it is against the extraction of background as existing shadow removal algorithms typically operate with a colored background image. In this paper, a background extraction and shadow removal algorithm based on clustering for ViBe is proposed. Firstly, the color background is extracted by clustering the values of each pixel in R, G, B components space. Then the background information is used to remove shadow hidden in the foreground. For indoor and outdoor videos with moving cast shadows, ROC (Receiver Operating Characteristic) curve is used to validate the proposed approach. Experimental results show that a good performance has been gained in shadow removal.

[1]  Shuifa Sun,et al.  A Shadow Removal Algorithm for ViBe in HSV Color Space , 2013, ICMT 2013.

[2]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Martin D. Levine,et al.  Removing shadows , 2005, Pattern Recognit. Lett..

[4]  Jian Wang,et al.  A H-K clustering algorithm based on ensemble learning , 2013 .

[5]  Shireen Elhabian,et al.  Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art , 2008 .

[6]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Mohan M. Trivedi,et al.  Moving shadow and object detection in traffic scenes , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[8]  Rui Jiang,et al.  The Integration Adjacent Frame Difference of Improved ViBe for Foreground Object Detection , 2011, 2011 7th International Conference on Wireless Communications, Networking and Mobile Computing.

[9]  Jiong Yang,et al.  An Approach to Active Spatial Data Mining Based on Statistical Information , 2000, IEEE Trans. Knowl. Data Eng..

[10]  Francis Y. L. Chin,et al.  Shadow detection for vehicles by locating the object-shadow boundary , 2005, SIP.

[11]  Xiang Gao,et al.  Error analysis of background adaption , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[12]  Takeo Kanade,et al.  Introduction to the Special Section on Video Surveillance , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[14]  Hannu Koivisto,et al.  Classification and Clustering for Knowledge Discovery , 2005, Studies in Computational Intelligence.

[15]  Bir Bhanu,et al.  Physical models for moving shadow and object detection in video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Saman K. Halgamuge,et al.  Classification and clustering for knowledge discovery , 2005 .

[17]  Lei Bangjun.  ViBe foreground detection algorithm and its improvement with morphology post-processing for outdoor scene , 2013 .

[18]  Marc Van Droogenbroeck,et al.  ViBE: A powerful random technique to estimate the background in video sequences , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Cláudio Rosito Jung,et al.  Efficient Background Subtraction and Shadow Removal for Monochromatic Video Sequences , 2009, IEEE Transactions on Multimedia.

[20]  Marc Van Droogenbroeck,et al.  Background subtraction: Experiments and improvements for ViBe , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[21]  Jiong Yang,et al.  STING: A Statistical Information Grid Approach to Spatial Data Mining , 1997, VLDB.

[22]  Liyuan Li,et al.  Integrating intensity and texture differences for robust change detection , 2002, IEEE Trans. Image Process..

[23]  Wang Yu-ying,et al.  Research on improvement of Apriori algorithm based on matrix compression , 2013 .

[24]  Alessandro Bevilacqua,et al.  Robust denoising and moving shadows detection in traffic scenes , 2001 .

[25]  Christoph F. Eick,et al.  An architecture and algorithms for multi-run clustering , 2009, 2009 IEEE Symposium on Computational Intelligence and Data Mining.

[26]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  K. Siala,et al.  Moving shadow detection with support vector domain description in the color ratios space , 2004, ICPR 2004.

[28]  Joshua Zhexue Huang,et al.  Extensions to the k-Means Algorithm for Clustering Large Data Sets with Categorical Values , 1998, Data Mining and Knowledge Discovery.

[29]  Christopher O. Jaynes,et al.  Moving Shadow Detection using a Combined Geometric and Color Classification Approach , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[30]  Xuelong Li,et al.  Cast shadow detection in video segmentation , 2005, Pattern Recognit. Lett..

[31]  Arnold W. M. Smeulders,et al.  Color texture measurement and segmentation , 2005, Signal Process..

[32]  Nikos A. Vlassis,et al.  The global k-means clustering algorithm , 2003, Pattern Recognit..