Exploiting Prior Information in Block-Sparse Signals

We study the problem of recovering a block-sparse signal from under-sampled observations. The non-zero values of such signals appear in few blocks, and their recovery is often accomplished using an <inline-formula><tex-math notation="LaTeX">$\ell _{1,2}$</tex-math></inline-formula> optimization problem. In applications such as DNA micro-arrays, some extra information about the distribution of non-zero blocks is available; i.e., the number of non-zero blocks in certain subsets of the blocks is known. A typical way to consider the extra information in recovery procedures is to solve a weighted <inline-formula><tex-math notation="LaTeX">$\ell _{1,2}$</tex-math></inline-formula> problem. In this paper, we consider a block-sparse model which is accompanied with a partitioning of the blocks; besides the overall block-sparsity level of the signal, we assume to know the block-sparsity of each subset in the partition. Our goal in this work is to minimize the number of required linear measurements for perfect recovery of the signal by tuning the weights of a weighted <inline-formula><tex-math notation="LaTeX">$\ell _{1,2}$</tex-math></inline-formula> problem. For this goal, we apply tools from conic integral geometry and derive closed-form expressions for the optimal weights. We show through precise analysis and simulations that the weighted <inline-formula><tex-math notation="LaTeX">$\ell _{1,2}$</tex-math></inline-formula> problem with optimal weights significantly outperforms the regular <inline-formula><tex-math notation="LaTeX">$\ell _{1,2}$</tex-math></inline-formula> problem. We further show that the optimal weights are robust against the inaccuracies of prior information.

[1]  Babak Hassibi,et al.  On the reconstruction of block-sparse signals with an optimal number of measurements , 2009, IEEE Trans. Signal Process..

[2]  Babak Hassibi,et al.  On the Reconstruction of Block-Sparse Signals With an Optimal Number of Measurements , 2008, IEEE Transactions on Signal Processing.

[3]  Yonina C. Eldar,et al.  Block-sparsity: Coherence and efficient recovery , 2008, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Babak Hassibi,et al.  Recovering Sparse Signals Using Sparse Measurement Matrices in Compressed DNA Microarrays , 2008, IEEE Journal of Selected Topics in Signal Processing.

[5]  Andrea Montanari,et al.  Accurate Prediction of Phase Transitions in Compressed Sensing via a Connection to Minimax Denoising , 2011, IEEE Transactions on Information Theory.

[6]  Yonina C. Eldar,et al.  From Theory to Practice: Sub-Nyquist Sampling of Sparse Wideband Analog Signals , 2009, IEEE Journal of Selected Topics in Signal Processing.

[7]  Yonina C. Eldar,et al.  Blind Multiband Signal Reconstruction: Compressed Sensing for Analog Signals , 2007, IEEE Transactions on Signal Processing.

[8]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[9]  Rayan Saab,et al.  Weighted ℓ1-Minimization for Sparse Recovery under Arbitrary Prior Information , 2016, ArXiv.

[10]  Weiyu Xu,et al.  Analyzing Weighted $\ell_1$ Minimization for Sparse Recovery With Nonuniform Sparse Models , 2010, IEEE Transactions on Signal Processing.

[11]  Pablo A. Parrilo,et al.  The Convex Geometry of Linear Inverse Problems , 2010, Foundations of Computational Mathematics.

[12]  Ali Bereyhi,et al.  Maximum-A-Posteriori Signal Recovery with Prior Information: Applications to Compressive Sensing , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[14]  Computational neuroscience: Species-specific motion detectors , 2016, Nature.

[15]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[16]  Joel A. Tropp,et al.  Convex recovery of a structured signal from independent random linear measurements , 2014, ArXiv.

[17]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[18]  Florent Krzakala,et al.  Performance Limits for Noisy Multimeasurement Vector Problems , 2016, IEEE Transactions on Signal Processing.

[19]  Yonina C. Eldar,et al.  Reduce and Boost: Recovering Arbitrary Sets of Jointly Sparse Vectors , 2008, IEEE Transactions on Signal Processing.

[20]  Joel A. Tropp,et al.  Living on the edge: phase transitions in convex programs with random data , 2013, 1303.6672.

[21]  Minh N. Do,et al.  A Theory for Sampling Signals from a Union of Subspaces , 2022 .

[22]  Philip Schniter,et al.  On approximate message passing for reconstruction of non-uniformly sparse signals , 2010, Proceedings of the IEEE 2010 National Aerospace & Electronics Conference.

[23]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[24]  Hassan Mansour,et al.  Recovering Compressively Sampled Signals Using Partial Support Information , 2010, IEEE Transactions on Information Theory.

[25]  Yonina C. Eldar,et al.  Block-Sparse Signals: Uncertainty Relations and Efficient Recovery , 2009, IEEE Transactions on Signal Processing.

[26]  Weiyu Xu,et al.  Spectral Super-Resolution With Prior Knowledge , 2014, IEEE Transactions on Signal Processing.

[27]  Shinichi Nakajima,et al.  Bayesian Group-Sparse Modeling and Variational Inference , 2014, IEEE Transactions on Signal Processing.

[28]  B. Hassibi,et al.  Compressive sensing for sparse approximations: constructions, algorithms, and analysis , 2010 .

[29]  Philip Schniter,et al.  Iteratively Reweighted ℓ1 Approaches to Sparse Composite Regularization , 2015, IEEE Trans. Computational Imaging.

[30]  Axel Flinth,et al.  Optimal Choice of Weights for Sparse Recovery With Prior Information , 2015, IEEE Transactions on Information Theory.