A NONCONVEX ALGORITHM FOR SIMULTANEOUSLY SPARSE AND LOW-RANK MATRIX RECONSTRUCTION

This paper considers the reconstruction of simultaneously sparse and low-rank matrices with a limited number of random measurements. The use of convex approximations of the sparsity level and the matrix rank enables one to apply well-developed convex optimization techniques. However, owing to the approximation, a convex approach may fail when the global minimum of the cost function is not equal to the generative sparse and low-rank matrix, and there is nothing one can do to avoid this structural error for convex approaches from the perspective of algorithmic development. Instead of using the convex ℓ1 norm and the nuclear norm to promote sparsity and low rank, a new approach with nonconvex and nonseparable regularization is proposed to solve the reconstruction problem in this paper. Experimental results shows that in comparison to the existing approaches, the proposed approach achieves significantly improved performance for recovering simultaneously sparse and low-rank matrices.

[1]  Emmanuel J. Candès,et al.  Matrix Completion With Noise , 2009, Proceedings of the IEEE.

[2]  Bhaskar D. Rao,et al.  Latent Variable Bayesian Models for Promoting Sparsity , 2011, IEEE Transactions on Information Theory.

[3]  Paris V. Giampouras,et al.  Simultaneously Sparse and Low-Rank Abundance Matrix Estimation for Hyperspectral Image Unmixing , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Yang Liu,et al.  Simultaneous Bayesian Sparse Approximation With Structured Sparse Models , 2016, IEEE Transactions on Signal Processing.

[5]  Wei Chen,et al.  Low-Rank Tensor Completion: A Pseudo-Bayesian Learning Approach , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Qing Ling,et al.  Multi-Task Learning for Subspace Segmentation , 2015, ICML.

[7]  Christos G. Tsinos,et al.  Distributed Blind Hyperspectral Unmixing via Joint Sparsity and Low-Rank Constrained Non-Negative Matrix Factorization , 2017, IEEE Transactions on Computational Imaging.

[8]  Li Zhang,et al.  Joint Low-Rank and Sparse Principal Feature Coding for Enhanced Robust Representation and Visual Classification , 2016, IEEE Transactions on Image Processing.

[9]  Yonina C. Eldar,et al.  Simultaneously Structured Models With Application to Sparse and Low-Rank Matrices , 2012, IEEE Transactions on Information Theory.

[10]  Miguel R. D. Rodrigues,et al.  Projection Design for Statistical Compressive Sensing: A Tight Frame Based Approach , 2013, IEEE Transactions on Signal Processing.

[11]  Nicolas Vayatis,et al.  Estimation of Simultaneously Sparse and Low Rank Matrices , 2012, ICML.

[12]  Angshul Majumdar,et al.  Split Bregman algorithms for sparse / joint-sparse and low-rank signal recovery: Application in compressive hyperspectral imaging , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[13]  Yonina C. Eldar,et al.  Sparsity Based Sub-wavelength Imaging with Partially Incoherent Light via Quadratic Compressed Sensing References and Links , 2022 .

[14]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[15]  Miguel R. D. Rodrigues,et al.  Dictionary Design for Distributed Compressive Sensing , 2015, IEEE Signal Processing Letters.

[16]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001 .

[17]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Ian J. Wassell,et al.  Joint Sensing Matrix and Sparsifying Dictionary Optimization for Tensor Compressive Sensing , 2017, IEEE Transactions on Signal Processing.

[19]  Wei Chen,et al.  A Decentralized Bayesian Algorithm For Distributed Compressive Sensing in Networked Sensing Systems , 2016, IEEE Transactions on Wireless Communications.

[20]  R. Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[21]  Pierre Vandergheynst,et al.  Hyperspectral image compressed sensing via low-rank and joint-sparse matrix recovery , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Wei Chen,et al.  Optimized Node Selection for Compressive Sleeping Wireless Sensor Networks , 2016, IEEE Transactions on Vehicular Technology.

[23]  Wei Chen,et al.  Cost-Aware Activity Scheduling for Compressive Sleeping Wireless Sensor Networks , 2016, IEEE Transactions on Signal Processing.

[24]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[25]  Huan Xu,et al.  Provable Subspace Clustering: When LRR Meets SSC , 2013, IEEE Transactions on Information Theory.

[26]  Wen Gao,et al.  Exploring Algorithmic Limits of Matrix Rank Minimization Under Affine Constraints , 2014, IEEE Transactions on Signal Processing.

[27]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.