Rapid background subtraction from video sequences

This paper presents a technique to detect the moving objects quickly and accurately by using a background subtraction algorithm called RaBS (Rapid Background Subtraction). The aim of RaBS is to distinguish between moving objects (referred as foreground) from the static one (referred as background) rapidly and efficiently. RaBS constructs for each pixel, a pixel model which is a collection of background samples taken in the past at the same location or in the neighborhood. The pixel model is constructed using the background pixels alone excluding the foreground pixels, if any. The current pixel is classified as foreground or background by comparing it with the corresponding pixel model. Before declaring a pixel as foreground it is passed through a shadow detection mechanism. If it is shadow then the current pixel will be classified as background but this pixel will not be used for updating the pixel model. The pixel model is then updated by using a random policy. Finally, the value of background pixel is propagated into the pixel model of a neighboring pixel. The update algorithm considers the pixels in the neighborhood also thereby exploiting the spatial dependencies. Spatial dependency makes the algorithm robust to camera oscillations. The algorithm relies exclusively on integer computations which makes it suitable for embedded applications.

[1]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[2]  Hélène Laurent,et al.  Review and evaluation of commonly-implemented background subtraction algorithms , 2008, 2008 19th International Conference on Pattern Recognition.

[3]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[4]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Hanqing Lu,et al.  A hierarchical approach for background modeling and moving objects detection , 2010 .

[7]  Bang Jun Lei,et al.  Real-time outdoor video surveillance with robust foreground extraction and object tracking via multi-state transition management , 2006, Pattern Recognit. Lett..

[8]  Dale Schuurmans,et al.  Real-Time Discriminative Background Subtraction , 2011, IEEE Transactions on Image Processing.

[9]  David Suter,et al.  Background Subtraction Based on a Robust Consensus Method , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Lionel Lacassagne,et al.  High performance motion detection: some trends toward new embedded architectures for vision systems , 2008, Journal of Real-Time Image Processing.

[12]  Guillaume-Alexandre Bilodeau,et al.  A Multiscale Region-Based Motion Detection and Background Subtraction Algorithm , 2010, Sensors.

[13]  Jin Keun Seo,et al.  Environmentally Robust Motion Detection for Video Surveillance , 2010, IEEE Transactions on Image Processing.

[14]  Alan M. McIvor,et al.  Background Subtraction Techniques , 2000 .

[15]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[16]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[17]  Hua Yang,et al.  An Efficient Method for Detecting Ghosts and Left Objects in Intelligent Video Surveillance , 2009, 2009 2nd International Congress on Image and Signal Processing.

[18]  Du-Ming Tsai,et al.  Independent Component Analysis-Based Background Subtraction for Indoor Surveillance , 2009, IEEE Transactions on Image Processing.

[19]  Thomas S. Huang,et al.  Robust estimation of foreground in surveillance videos by sparse error estimation , 2008, 2008 19th International Conference on Pattern Recognition.

[20]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.

[21]  Antoine Manzanera.  Sigma-Delta Background Subtraction and the Zipf Law , 2007, CIARP.

[22]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[23]  Jen-Hui Chuang,et al.  Learning a Scene Background Model via Classification , 2009, IEEE Transactions on Signal Processing.

[24]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[26]  Venkatesh Saligrama,et al.  Foreground-Adaptive Background Subtraction , 2009, IEEE Signal Processing Letters.

[27]  Yang Wang,et al.  A probabilistic approach for foreground and shadow segmentation in monocular image sequences , 2005, Pattern Recognit..

[28]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[29]  Nuno Vasconcelos,et al.  Spatiotemporal Saliency in Dynamic Scenes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Lionel Lacassagne,et al.  Motion detection: Fast and robust algorithms for embedded systems , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[31]  Max Mignotte,et al.  Statistical background subtraction using spatial cues , 2007, IEEE Transactions on Circuits and Systems for Video Technology.