Robust detection of moving objects in video sequences through rough set theory framework

Detection of moving objects in the presence of challenging background situations like swaying vegetation, rippling water, camera jitter etc., is known to be a difficult task. Background subtraction is considered to be better than the other approaches in terms of robustness. Its success primarily depends on the proper choice of background model(s) associated with every pixel for its foreground/background labeling. In this work, we have adopted rough-set theoretic measures to embed the spatial similarity around a neighborhood as a model for the pixel. Basic histon and its associated measure Basic Histon Roughness Index (BHRI) have been reported in the literature. It was applied to still image segmentation with impressive performance. Its adoption in video sequences for foreground/background labeling is proposed herein. We extended the histon concept to a 3D histon, which considers the intensities across the color planes in a combined manner, instead of considering independent color planes. Further, we also incorporated fuzziness into the 3D HRI measure. The labeling decision is based on Bhattacharyya distance between the model HRI and the corresponding measure in the current frame. Adoption of rough set theoretic concept into moving object segmentation is nontrivial, as the model updating requires careful consideration so that the pixels associated with gradually changing background or dynamic background are labeled as background and at the same time, slow moving objects are never adopted into the background model. A novel background model update strategy proposed herein takes these into consideration and also eliminates the need of having exclusive ideal background frame initially.

[1]  TaeYong Kim,et al.  Background Subtraction Based on Local Orientation Histogram , 2008, APCHI.

[2]  Somnath Sengupta,et al.  Moving object detection in the presence of dynamic backgrounds using intensity and textural features , 2011, J. Electronic Imaging.

[3]  Dan Xu,et al.  A New Background Subtraction Method Using Texture and Color Information , 2011, ICIC.

[4]  Shengping Zhang,et al.  Dynamic background modeling and subtraction using spatio-temporal local binary patterns , 2008, 2008 15th IEEE International Conference on Image Processing.

[5]  Kazuhiko Sumi,et al.  Background subtraction based on cooccurrence of image variations , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Wen Gao,et al.  A covariance-based method for dynamic background subtraction , 2008, 2008 19th International Conference on Pattern Recognition.

[7]  A. K. Ray,et al.  Rough set theory based segmentation of color images , 2000, PeachFuzz 2000. 19th International Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.00TH8500).

[8]  Shaogang Gong,et al.  A highly efficient block-based dynamic background model , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[9]  Thierry Bouwmans,et al.  Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey , 2008 .

[10]  Ajay K. Ray,et al.  Fusion of rough set theoretic approximations and FCM for color image segmentation , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[11]  Yi-Ping Hung,et al.  Efficient hierarchical method for background subtraction , 2007, Pattern Recognit..

[12]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[13]  Meng Wu,et al.  Hybrid center-symmetric local pattern for dynamic background subtraction , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[14]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[15]  Weiming Zhang,et al.  Dynamic Background Subtraction Using Spatial-Color Binary Patterns , 2011, 2011 Sixth International Conference on Image and Graphics.

[16]  Xudong Jiang,et al.  Difference of Gaussian Edge-Texture Based Background Modeling for Dynamic Traffic Conditions , 2008, ISVC.

[17]  Ajoy Kumar Ray,et al.  Color image segmentation: Rough-set theoretic approach , 2008, Pattern Recognit. Lett..

[18]  Chunhong Pan,et al.  Adaptive εLBP for Background Subtraction , 2010, ACCV.

[19]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[20]  Vittorio Murino,et al.  Background Subtraction for Automated Multisensor Surveillance: A Comprehensive Review , 2010, EURASIP J. Adv. Signal Process..

[21]  Pojala Chiranjeevi,et al.  Detection of moving objects using fuzzy correlogram based background subtraction , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[22]  In-So Kweon,et al.  Hierarchical on-line boosting based background subtraction , 2011, 2011 17th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV).

[23]  Thierry Bouwmans,et al.  Type-2 Fuzzy Mixture of Gaussians Model: Application to Background Modeling , 2008, ISVC.

[24]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[26]  Zoran Duric,et al.  Using histograms to detect and track objects in color video , 2001, Proceedings 30th Applied Imagery Pattern Recognition Workshop (AIPR 2001). Analysis and Understanding of Time Varying Imagery.

[27]  Jesús Bescós,et al.  Background Subtraction Techniques: Systematic Evaluation and Comparative Analysis , 2009, ACIVS.

[28]  Olivier Bernier,et al.  Local kernel color histograms for background subtraction , 2006, VISAPP.

[29]  Thierry Bouwmans,et al.  Recent Advanced Statistical Background Modeling for Foreground Detection - A Systematic Survey , 2011 .

[30]  Li Song,et al.  Dynamic background subtraction based on spatial extended center-symmetric local binary pattern , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[31]  Guillaume-Alexandre Bilodeau,et al.  Iterative Division and Correlograms for Detection and Tracking of Moving Objects , 2006, IWICPAS.

[32]  Shengping Zhang,et al.  Dynamic Background Subtraction Based on Local Dependency Histogram , 2008, Int. J. Pattern Recognit. Artif. Intell..

[33]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[34]  Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .