Video Foreground Detection Algorithm Based on Fast Principal Component Pursuit and Motion Saliency

Aiming at the shortcoming of being unsuitable for dynamic background and high computational complexity of the existing RPCA- (robust principal component analysis-) based block-sparse moving object detection method, this paper proposes a two-stage foreground detection framework based on motion saliency for video sequence. At the first stage, the observed image sequence is regarded as the sum of a low-rank background matrix and a sparse outlier matrix, and then the decomposition is solved by the RPCA method via fast PCP (principal component pursuit). At the second stage, the sparse foreground blocks are obtained according to the spectral residuals and the spatial correlation of the foreground region. Finally, the block-sparse RPCA algorithm through fast PCP is used to estimate foreground areas dynamically and to reconstruct the foreground objects. Extensive experiments demonstrate that our method can exclude the interference of background motion and change, simultaneously improving the detection rate of small targets.

[1]  Namrata Vaswani,et al.  A Fast and Memory-Efficient Algorithm for Robust PCA (MEROP) , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Martin Jaggi,et al.  Sparse Convex Optimization Methods for Machine Learning , 2011 .

[3]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[4]  Fei Yang,et al.  Temporal Spectral Residual for fast salient motion detection , 2012, Neurocomputing.

[5]  Tobias Feldmann,et al.  Adaptive Foreground/Background Segmentation Using Multiview Silhouette Fusion , 2009, DAGM-Symposium.

[6]  Sajid Javed,et al.  Robust PCA, Subspace Learning, and Tracking , 2017 .

[7]  Brendt Wohlberg,et al.  Fast principal component pursuit via alternating minimization , 2013, 2013 IEEE International Conference on Image Processing.

[8]  Brendt Wohlberg,et al.  Incremental Principal Component Pursuit for Video Background Modeling , 2015, Journal of Mathematical Imaging and Vision.

[9]  Licheng Jiao,et al.  A fast tri-factorization method for low-rank matrix recovery and completion , 2013, Pattern Recognit..

[10]  Sajid Javed,et al.  On the Applications of Robust PCA in Image and Video Processing , 2018, Proceedings of the IEEE.

[11]  Prateek Jain,et al.  Non-convex Robust PCA , 2014, NIPS.

[12]  Thierry Bouwmans,et al.  Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance , 2014, Comput. Vis. Image Underst..

[13]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[14]  Namrata Vaswani,et al.  Recursive Robust PCA or Recursive Sparse Recovery in Large but Structured Noise , 2012, IEEE Transactions on Information Theory.

[15]  Motaz El-Saban,et al.  FRPCA: Fast Robust Principal Component Analysis , 2012 .

[16]  Yang Mi.  Fast Alternating Direction Method of Multipliers for Robust PCA , 2014 .

[17]  Michael Hintermüller,et al.  Robust Principal Component Pursuit via Inexact Alternating Minimization on Matrix Manifolds , 2015, Journal of Mathematical Imaging and Vision.

[18]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Shanmuganathan Raman,et al.  Robust PCA-based solution to image composition using augmented Lagrange multiplier (ALM) , 2016, The Visual Computer.

[20]  George Atia,et al.  Coherence Pursuit: Fast, Simple, and Robust Principal Component Analysis , 2016, IEEE Transactions on Signal Processing.

[21]  Loong Fah Cheong,et al.  Block-Sparse RPCA for Salient Motion Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Sajid Javed,et al.  Robust Subspace Learning: Robust PCA, Robust Subspace Tracking, and Robust Subspace Recovery , 2017, IEEE Signal Processing Magazine.

[23]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Ebroul Izquierdo,et al.  Approximated RPCA for fast and efficient recovery of corrupted and linearly correlated images and video frames , 2015, 2015 International Conference on Systems, Signals and Image Processing (IWSSIP).

[25]  Qiang Cheng,et al.  A Fast Factorization-Based Approach to Robust PCA , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[26]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[27]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[28]  Robert Powers,et al.  Protein NMR recall, precision, and F-measure scores (RPF scores): structure quality assessment measures based on information retrieval statistics. , 2005, Journal of the American Chemical Society.

[29]  Necdet Serhat Aybat,et al.  An alternating direction method with increasing penalty for stable principal component pursuit , 2013, Computational Optimization and Applications.

[30]  A. Bemporad,et al.  Forward-backward truncated Newton methods for convex composite optimization , 2014, 1402.6655.

[31]  Lei Zhang,et al.  Robust Principal Component Analysis with Complex Noise , 2014, ICML.

[32]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[33]  Namrata Vaswani,et al.  Real-time Robust Principal Components' Pursuit , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[34]  Martin Jaggi,et al.  A Simple Algorithm for Nuclear Norm Regularized Problems , 2010, ICML.

[35]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[36]  Hua Zheng.  FIRST-ORDER METHODS FOR NUCLEAR NORM MINIMIZATION AND ITS APPLICATIONS , 2009 .