Generalized Stauffer–Grimson background subtraction for dynamic scenes

We propose an adaptive model for backgrounds containing significant stochastic motion (e.g. water). The new model is based on a generalization of the Stauffer–Grimson background model, where each mixture component is modeled as a dynamic texture. We derive an online K-means algorithm for updating the parameters using a set of sufficient statistics of the model. Finally, we report on experimental results, which show that the proposed background model both quantitatively and qualitatively outperforms state-of-the-art methods in scenes containing significant background motions.

[1]  A. Fitzgibbon.  Stochastic rigidity: image registration for nowhere-static scenes , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Geoffrey E. Hinton,et al.  Parameter estimation for linear dynamical systems , 1996 .

[3]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[4]  Richard I. Hartley,et al.  Novelty Detection in Image Sequences with Dynamic Background , 2004, ECCV Workshop SMVP.

[5]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Lambert E. Wixson,et al.  Detecting salient motion by accumulating directionally-consistent flow , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Yongmin Li,et al.  On incremental and robust subspace learning , 2004, Pattern Recognit..

[8]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[9]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  W. Eric L. Grimson,et al.  Background Subtraction for Temporally Irregular Dynamic Textures , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[11]  Payam Saisan,et al.  Dynamic texture recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[13]  Nuno Vasconcelos,et al.  Modeling, Clustering, and Segmenting Video with Mixtures of Dynamic Textures , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Nuno Vasconcelos,et al.  Probabilistic kernels for the classification of auto-regressive visual processes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Ying-li Tian,et al.  Robust Salient Motion Detection with Complex Background for Real-Time Video Surveillance , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[16]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Nikos Paragios,et al.  Motion-based background subtraction using adaptive kernel density estimation , 2004, CVPR 2004.

[19]  Bohn Stafleu van Loghum,et al.  Online … , 2002, LOG IN.

[20]  Sailes K. Sengijpta.  Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[21]  Nikos Paragios,et al.  Background modeling and subtraction of dynamic scenes , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[22]  Stan Sclaroff,et al.  Segmenting foreground objects from a dynamic textured background via a robust Kalman filter , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[23]  Dragoljub Pokrajac,et al.  Motion Detection Based on Local Variation of Spatiotemporal Texture , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[24]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[25]  Nuno Vasconcelos,et al.  Mixtures of dynamic textures , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[26]  Daniel Cremers,et al.  Dynamic texture segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.