Extract foreground objects based on sparse model of spatiotemporal spectrum

In this paper, we present a novel foreground object detection method based on the sparse model of the spectrum of spatiotemporal DCT domain, which is robust for high dynamic scenes. First, we adopt the three-dimensional Discrete Cosine Transform (DCT) to calculate the spatiotemporal spectrum representation of the current frame. Then, identification of foreground pixels is formulated as the analysis of the sparse solution of an optimization problem, where foreground pixels correspond to an outlier of the sparse model. Finally, the background updating method is presented to adaptively update the dictionary of sparse model corresponding to background representation. The experimental results on four challenging video sequences show that the proposed method is more robust to high dynamic changes of scenes compared with four representative methods.

[1]  L. Wixson Detecting Salient Motion by Accumulating Directionally-Consistent Flow , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Guillermo Sapiro,et al.  See all by looking at a few: Sparse modeling for finding representative objects , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Max Mignotte,et al.  Statistical background subtraction using spatial cues , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[6]  Wen Gao,et al.  Modeling Background and Segmenting Moving Objects from Compressed Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Yongtian Wang,et al.  An integrated background model for video surveillance based on primal sketch and 3D scene geometry , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Yunde Jia,et al.  Spatio-temporal patches for night background modeling by subspace learning , 2008, 2008 19th International Conference on Pattern Recognition.

[9]  Laure Tougne,et al.  Space-time spectral model for object detection in dynamic textured background , 2012, Pattern Recognit. Lett..

[10]  W. Eric L. Grimson,et al.  Background Subtraction for Temporally Irregular Dynamic Textures , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[11]  Qingshan Liu,et al.  Temporal spectral residual: fast motion saliency detection , 2009, ACM Multimedia.

[12]  Nikos Paragios,et al.  Scene modeling and change detection in dynamic scenes: A subspace approach , 2009, Comput. Vis. Image Underst..

[13]  Atsushi Shimada,et al.  Hybrid Background Model Using Spatial-Temporal LBP , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[14]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[15]  Yacov Hel-Or,et al.  Foreground detection using spatiotemporal projection kernels , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Hagit Hel-Or,et al.  Video Block Motion Estimation Based on Gray-Code Kernels , 2009, IEEE Transactions on Image Processing.