Real-time foreground detection based on tempo-spatial consistency validation and Gaussian Mixture Model

Robust foreground detection is a fundamental precursor of many video processing applications. Although various approaches were advanced, there still exist many factors making detection very challenging: 1) Dynamic background with gradual brightness changes, camera movement and large amount of noises. 2) Sharp illumination changes caused by shadows, light on-off, and so on. 3) Real-time requirement for practical systems. To overcome these problems, a new approach is proposed in this paper. It is based on the background of conventional Gaussian Mixed Model, incorporating tempo-spatial consistency validation to search genuine foreground seeds, so that foreground segments can be reliably acquired using region growth method. Experiments demonstrate that our approach achieves better performance than conventional GMM approach in detection accuracy, adaptability to sudden illumination changes and computation time.

[1]  Chiou-Ting Hsu,et al.  Background Modeling from GMM Likelihood Combined with Spatial and Color Coherency , 2006, 2006 International Conference on Image Processing.

[2]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[3]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[5]  Quan Pan,et al.  Real-time and accurate segmentation of moving objects in dynamic scene , 2004, VSSN '04.

[6]  Michal Irani,et al.  Separating Transparent Layers through Layer Information Exchange , 2004, ECCV.

[7]  A. Bozzoli,et al.  A tunable algorithm to update a reference image , 2000, Signal Process. Image Commun..

[8]  Nikos Paragios,et al.  Motion-based background subtraction using adaptive kernel density estimation , 2004, CVPR 2004.

[9]  Luca Lombardi,et al.  Multi-module switching and fusion for robust video surveillance , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[10]  Vassilios Morellas,et al.  Robust Foreground Detection In Video Using Pixel Layers , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Xiangzhong Fang,et al.  Spatiotemporal Gaussian mixture model to detect moving objects in dynamic scenes , 2007, J. Electronic Imaging.