Video background modeling: recent approaches, issues and our proposed techniques

Effective and efficient background subtraction is important to a number of computer vision tasks. We introduce several new techniques to address key challenges for background modeling using a Gaussian mixture model (GMM) for moving objects detection in a video acquired by a static camera. The novel features of our proposed model are that it automatically learns dynamics of a scene and adapts its parameters accordingly, suppresses ghosts in the foreground mask using a SURF features matching algorithm, and introduces a new spatio-temporal filter to further refine the foreground detection results. Detection of abrupt illumination changes in the scene is dealt with by a model shifting-based scheme to reuse already learned models and spatio-temporal history of foreground blobs is used to detect and handle paused objects. The proposed model is rigorously tested and compared with several previous models and has shown significant performance improvements.

[1]  Pengfei Shi,et al.  An Eigenbackground Subtraction Method Using Recursive Error Compensation , 2006, PCM.

[2]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[5]  M. Smids,et al.  Background Subtraction for Urban Traffic Monitoring using Webcams , 2007 .

[6]  Takeshi Ikenaga,et al.  A Foreground Extraction Algorithm Based on Adaptively Adjusted Gaussian Mixture Models , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[7]  Atsushi Shimada,et al.  Dynamic Control of Adaptive Mixture-of-Gaussians Background Model , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[8]  B. Shoushtarian.  A PRACTICAL APPROACH TO REAL-TIME DYNAMIC BACKGROUND GENERATION BASED ON A TEMPORAL MEDIAN FILTER , 2003 .

[9]  Bertrand Vachon,et al.  Statistical Background Modeling for Foreground Detection: A Survey , 2010 .

[10]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.

[11]  Bohyung Han,et al.  Density-Based Multifeature Background Subtraction with Support Vector Machine , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Weidong Zhang,et al.  A Novel Particle Filter Based Background Subtraction Method , 2006, 2006 International Conference on Computational Intelligence and Security.

[13]  Rubén Heras Evangelio,et al.  Detection of static objects for the task of video surveillance , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[14]  Serhat S Bucak,et al.  Incremental Nonnegative Matrix Factorization for Background Modeling in Surveillance Video , 2007, 2007 IEEE 15th Signal Processing and Communications Applications.

[15]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[16]  Thierry Bouwmans,et al.  Subspace Learning for Background Modeling: A Survey , 2009 .

[17]  Mark E Hallenbeck,et al.  Extracting Roadway Background Image , 2006 .

[18]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[20]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[21]  Chunhong Pan,et al.  Effective multi-resolution background subtraction , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Thierry Bouwmans,et al.  Recent Advanced Statistical Background Modeling for Foreground Detection - A Systematic Survey , 2011 .

[23]  Tamás Szirányi,et al.  Study on color space selection for detecting cast shadows in video surveillance: Articles , 2007 .

[24]  Mubarak Shah,et al.  Automatically Tuning Background Subtraction Parameters using Particle Swarm Optimization , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[25]  Stuart J. Russell,et al.  Image Segmentation in Video Sequences: A Probabilistic Approach , 1997, UAI.

[26]  Stefano Messelodi,et al.  A Kalman Filter Based Background Updating Algorithm Robust to Sharp Illumination Changes , 2005, ICIAP.

[27]  You Zhi-sheng,et al.  An Improved Video Compression Algorithm for Lane Surveillance , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[28]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[29]  Csaba Benedek,et al.  Study on color space selection for detecting cast shadows in video surveillance , 2007, Int. J. Imaging Syst. Technol..

[30]  P. Wayne Power,et al.  Understanding Background Mixture Models for Foreground Segmentation , 2002 .

[31]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[32]  M.M. Trivedi,et al.  Vision modules for a multi-sensory bridge monitoring approach , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[33]  Fan Yang,et al.  Color Space Selection for Moving Shadow Elimination , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[34]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[35]  Stan Sclaroff,et al.  Segmenting foreground objects from a dynamic textured background via a robust Kalman filter , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[36]  Jie Yang,et al.  Flexible background mixture models for foreground segmentation , 2006, Image Vis. Comput..

[37]  Venkatesh Saligrama,et al.  Foreground-Adaptive Background Subtraction , 2009, IEEE Signal Processing Letters.

[38]  Marc Van Droogenbroeck,et al.  Background subtraction: Experiments and improvements for ViBe , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[39]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[40]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Brendon J. Woodford,et al.  Enhancing the mixture of Gaussians background model with local matching and local adaptive learning , 2012, IVCNZ '12.

[42]  Olivier Bernier,et al.  Real Time Illumination Invariant Background Subtraction Using Local Kernel Histograms , 2006, BMVC.

[43]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[44]  Yen-Wei Chen,et al.  Detection of Moving Objects by Independent Component Analysis , 2006, ACCV.

[45]  Rubén Heras Evangelio,et al.  Splitting Gaussians in Mixture Models , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[46]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Nikos Paragios,et al.  Motion-based background subtraction using adaptive kernel density estimation , 2004, CVPR 2004.

[48]  Heng Zhang,et al.  Accurate Motion Detection in Dynamic Scenes Based on Ego-Motion Estimation and Optical Flow Segmentation Combined Method , 2011, 2011 Symposium on Photonics and Optoelectronics (SOPO).

[49]  James W. Davis,et al.  Background-subtraction using contour-based fusion of thermal and visible imagery , 2007, Comput. Vis. Image Underst..