Compressive Online Decomposition of Dynamic Signals Via N-ℓ1 Minimization With Clustered Priors

We introduce a compressive online decomposition via solving an ${n}$-$\ell _{1}$ cluster-weighted minimization to decompose a sequence of data vectors into sparse and low-rank components. In contrast to conventional batch Robust Principal Component Analysis (RPCA)—which needs to access full data—our method processes a data vector of the sequence per time instance from a small number of measurements. The $n-\ell _{1}$ cluster-weighted minimization promotes (i) the structure of the sparse components and (ii) their correlation with multiple previously-recovered sparse vectors via clustering and re-weighting iteratively. We establish guarantees on the number of measurements required for successful compressive decomposition under the assumption of slowly-varying low-rank components. Experimental results show that our guarantees are sharp and the proposed algorithm outperforms the state of the art.

[1]  Yonina C. Eldar,et al.  Reference-based compressed sensing: A sample complexity approach , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  André Kaup,et al.  Compressive Online Robust Principal Component Analysis via $n$ - $\ell_1$ Minimization , 2018, IEEE Transactions on Image Processing.

[3]  André Kaup,et al.  Compressive Online Robust Principal Component Analysis with Optical Flow for Video Foreground-Background Separation , 2017, SoICT.

[4]  Laura Balzano,et al.  Incremental gradient on the Grassmannian for online foreground and background separation in subsampled video , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Soon Ki Jung,et al.  Decomposition into Low-rank plus Additive Matrices for Background/Foreground Separation: A Review for a Comparative Evaluation with a Large-Scale Dataset , 2015, Comput. Sci. Rev..

[7]  Ling Chen,et al.  Online compressed robust PCA , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[8]  Brendt Wohlberg,et al.  Incremental Principal Component Pursuit for Video Background Modeling , 2015, Journal of Mathematical Imaging and Vision.

[9]  Michael B. Wakin,et al.  Recovery of Periodic Clustered Sparse signals from compressive measurements , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[10]  Piotr Indyk,et al.  Approximation Algorithms for Model-Based Compressive Sensing , 2014, IEEE Transactions on Information Theory.

[11]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[12]  Namrata Vaswani,et al.  An Online Algorithm for Separating Sparse and Low-Dimensional Signal Sequences From Their Sum , 2013, IEEE Transactions on Signal Processing.

[13]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[14]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[15]  André Kaup,et al.  Online Decomposition of Compressive Streaming Data Using n-l1 Cluster-Weighted Minimization , 2018, 2018 Data Compression Conference.

[16]  Sajid Javed,et al.  Robust PCA and Robust Subspace Tracking , 2017, ArXiv.

[17]  Namrata Vaswani,et al.  Modified-CS: Modifying compressive sensing for problems with partially known support , 2009, ISIT.

[18]  Yonina C. Eldar,et al.  Reweighted L1-norm minimization with guarantees: An incremental measurement approach to sparse reconstruction , 2017 .

[19]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[20]  Richard Baraniuk,et al.  Recovery of Clustered Sparse Signals from Compressive Measurements , 2009 .

[21]  Hassan Mansour,et al.  Weighted one-norm minimization with inaccurate support estimates: Sharp analysis via the null-space property , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Volkan Cevher,et al.  Adaptive-Rate Reconstruction of Time-Varying Signals With Application in Compressive Foreground Extraction , 2016, IEEE Transactions on Signal Processing.

[23]  André Kaup,et al.  Compressive online robust principal component analysis with multiple prior information , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[24]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[25]  Pablo A. Parrilo,et al.  The Convex Geometry of Linear Inverse Problems , 2010, Foundations of Computational Mathematics.

[26]  Miguel R. D. Rodrigues,et al.  Compressed Sensing With Prior Information: Strategies, Geometry, and Bounds , 2017, IEEE Transactions on Information Theory.

[27]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[28]  Yi Ma,et al.  Compressive principal component pursuit , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[29]  Miguel R. D. Rodrigues,et al.  Compressed sensing with side information: Geometrical interpretation and performance bounds , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[30]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[31]  Aswin C. Sankaranarayanan,et al.  SpaRCS: Recovering low-rank and sparse matrices from compressive measurements , 2011, NIPS.