Incremental and Multi-feature Tensor Subspace Learning Applied for Background Modeling and Subtraction

Background subtraction (BS) is the art of separating moving objects from their background. The Background Modeling (BM) is one of the main steps of the BS process. Several subspace learning (SL) algorithms based on matrix and tensor tools have been used to perform the BM of the scenes. However, several SL algorithms work on a batch process increasing memory consumption when data size is very large. Moreover, these algorithms are not suitable for streaming data when the full size of the data is unknown. In this work, we propose an incremental tensor subspace learning that uses only a small part of the entire data and updates the low-rank model incrementally when new data arrive. In addition, the multi-feature model allows us to build a robust low-rank background model of the scene. Experimental results shows that the proposed method achieves interesting results for background subtraction task.

[1]  John C. S. Lui,et al.  Online Robust Subspace Tracking from Partial Information , 2011, ArXiv.

[2]  Xiaoqin Zhang,et al.  Robust foreground segmentation based on two effective background models , 2008, MIR '08.

[3]  M. Brand,et al.  Fast low-rank modifications of the thin singular value decomposition , 2006 .

[4]  Javier Melenchón,et al.  Efficiently Downdating, Composing and Splitting Singular Value Decompositions Preserving the Mean Information , 2007, IbPRIA.

[5]  Thierry Bouwmans,et al.  Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance , 2014, Comput. Vis. Image Underst..

[6]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[7]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[8]  Larry S. Davis,et al.  Special issue on background modeling for foreground detection in real-world dynamic scenes , 2014, Machine Vision and Applications.

[9]  Deng Cai,et al.  Tensor Subspace Analysis , 2005, NIPS.

[10]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[11]  Jong-Il Park,et al.  Computer Vision - ACCV 2012 Workshops , 2012, Lecture Notes in Computer Science.

[12]  Jimeng Sun,et al.  Two heads better than one: pattern discovery in time-evolving multi-aspect data , 2008, Data Mining and Knowledge Discovery.

[13]  Thierry Chateau,et al.  A Benchmark Dataset for Foreground/Background Extraction , 2012, ACCV 2012.

[14]  Brendon J. Woodford,et al.  Video background modeling: recent approaches, issues and our proposed techniques , 2013, Machine Vision and Applications.

[15]  Stephen J. Wright,et al.  On GROUSE and incremental SVD , 2013, 2013 5th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[16]  Paul Van Dooren,et al.  Low-rank incremental methods for computing dominant singular subspaces☆ , 2012 .

[17]  Philip S. Yu,et al.  Incremental tensor analysis: Theory and applications , 2008, TKDD.

[18]  Atsushi Shimada,et al.  Case-based background modeling: associative background database towards low-cost and high-performance change detection , 2013, Machine Vision and Applications.

[19]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[20]  Xiaoqin Zhang,et al.  Incremental Tensor Subspace Learning and Its Applications to Foreground Segmentation and Tracking , 2011, International Journal of Computer Vision.

[21]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Xiaoqin Zhang,et al.  Robust Visual Tracking Based on Incremental Tensor Subspace Learning , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[23]  Michael Lindenbaum,et al.  Sequential Karhunen-Loeve basis extraction and its application to images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[24]  Daniel Kressner,et al.  A literature survey of low‐rank tensor approximation techniques , 2013, 1302.7121.

[25]  Narendra Ahuja,et al.  Rank-R approximation of tensors using image-as-matrix representation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[27]  Jang-Gyu Lee,et al.  On updating the singular value decomposition , 1996, Proceedings of International Conference on Communication Technology. ICCT '96.

[28]  Thierry Chateau,et al.  A Benchmark Dataset for Outdoor Foreground/Background Extraction , 2012, ACCV Workshops.

[29]  Shuicheng Yan,et al.  A Convengent Solution to Tensor Subspace Learning , 2007, IJCAI.

[30]  Haiping Lu,et al.  A survey of multilinear subspace learning for tensor data , 2011, Pattern Recognit..

[31]  Michael J. Black,et al.  A Framework for Robust Subspace Learning , 2003, International Journal of Computer Vision.

[32]  Zhouchen Lin,et al.  A Block Lanczos with Warm Start Technique for Accelerating Nuclear Norm Minimization Algorithms , 2010, ArXiv.