Multi-component group sparse RPCA model for motion object detection under complex dynamic background

Abstract Robust PCA model and its variants are promising tools for motion object detection, which decompose video or image sequences matrix into a low rank background component and a sparse moving object component. Although they can handle static background well, the background motion is usually mixed in the sparse components under the condition of complex dynamic background, such as fountains, ripples, and shaking leaves, etc. Meanwhile, the detected boundaries of foreground objects are usually inaccurate and incomplete. In this paper, a multi-component group sparse RPCA model is proposed to cope with all the difficulties mentioned above. With the aiming to separate foreground motion object from dynamic background, our model represents the observed video or image sequences as three components, i.e., a low-rank static background, a group sparse foreground, and a dynamic background. In order to integrate the object boundary prior, each frame is over-segmented into super-pixels which are taken as the group information to define a group sparse norm. Accordingly, the group sparse norm takes each super-pixels as a whole to measure the sparse foreground. Furthermore, an incoherence term is introduced to enhance the separability of sparse foreground motion from dynamic background component. We further apply alternating direction method of multipliers algorithm to solve the proposed model. Extensive experiment results demonstrate the superiority of our method over some representative methods.

[1]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Eric L. Miller,et al.  Multiple Hypothesis Video Segmentation from Superpixel Flows , 2010, ECCV.

[3]  Laura Balzano,et al.  Incremental gradient on the Grassmannian for online foreground and background separation in subsampled video , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Zhi-Quan Luo,et al.  Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jingdong Wang,et al.  A Probabilistic Approach to Robust Matrix Factorization , 2012, ECCV.

[7]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[8]  Dacheng Tao,et al.  GoDec: Randomized Lowrank & Sparse Matrix Decomposition in Noisy Case , 2011, ICML.

[9]  Zhi-Quan Luo,et al.  On the linear convergence of the alternating direction method of multipliers , 2012, Mathematical Programming.

[10]  Longin Jan Latecki,et al.  Maximum weight cliques with mutex constraints for video object segmentation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Charles Guyon,et al.  Robust Principal Component Analysis for Background Subtraction: Systematic Evaluation and Comparative Analysis , 2012 .

[12]  Qingshan Liu,et al.  Decentralized Robust Subspace Clustering , 2016, AAAI.

[13]  Loong Fah Cheong,et al.  Block-Sparse RPCA for Salient Motion Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Xiaoming Yuan,et al.  Sparse and low-rank matrix decomposition via alternating direction method , 2013 .

[15]  Chenliang Xu,et al.  Streaming Hierarchical Video Segmentation , 2012, ECCV.

[16]  R. Larsen Lanczos Bidiagonalization With Partial Reorthogonalization , 1998 .

[17]  Hanqing Lu,et al.  Low rank driven robust facial landmark regression , 2015, Neurocomputing.

[18]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[19]  Sidney S. Fels,et al.  Evaluation of Background Subtraction Algorithms with Post-Processing , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[20]  Philippe Mahey,et al.  A survey on operator splitting and decomposition of convex programs , 2017, RAIRO Oper. Res..

[21]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Jian Dong,et al.  Accelerated low-rank visual recovery by random projection , 2011, CVPR 2011.

[24]  Qingshan Liu,et al.  Learning Discriminative Dictionary for Group Sparse Representation , 2014, IEEE Transactions on Image Processing.

[25]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[26]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Mubarak Shah,et al.  Video Object Segmentation through Spatially Accurate and Temporally Dense Extraction of Primary Object Regions , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.