On recovery of block-sparse signals via mixed l 2 / l q ( 0 < q ≤ 1 ) normminimization

Compressed sensing (CS) states that a sparse signal can exactly be recovered from very few linear measurements. While in many applications, real-world signals also exhibit additional structures aside from standard sparsity. The typical example is the so-called block-sparse signals whose non-zero coefficients occur in a few blocks. In this article, we investigate the mixed l2/lq(0 < q ≤ 1) norm minimization method for the exact and robust recovery of such block-sparse signals. We mainly show that the non-convex l2/lq(0 < q < 1) minimization method has stronger sparsity promoting ability than the commonly used l2/l1 minimization method both practically and theoretically. In terms of a block variant of the restricted isometry property of measurement matrix, we present weaker sufficient conditions for exact and robust block-sparse signal recovery than those known for l2/l1 minimization. We also propose an efficient Iteratively Reweighted Least-Squares (IRLS) algorithm for the induced non-convex optimization problem. The obtained weaker conditions and the proposed IRLS algorithm are tested and compared with the mixed l2/l1 minimization method and the standard lq minimization method on a series of noiseless and noisy block-sparse signals. All the comparisons demonstrate the outperformance of the mixed l2/lq(0 < q < 1) method for block-sparse signal recovery applications, and meaningfulness in the development of new CS technology.

[1]  A. J. Jerri Correction to "The Shannon sampling theorem—Its various extensions and applications: A tutorial review" , 1979 .

[2]  Wotao Yin,et al.  Improved Iteratively Reweighted Least Squares for Unconstrained Smoothed 퓁q Minimization , 2013, SIAM J. Numer. Anal..

[3]  Ming-Jun Lai,et al.  A New Estimate of Restricted Isometry Constants for Sparse Solutions , 2011 .

[4]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[5]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[6]  S. Foucart,et al.  Sparsest solutions of underdetermined linear systems via ℓq-minimization for 0 , 2009 .

[7]  Rick Chartrand,et al.  Exact Reconstruction of Sparse Signals via Nonconvex Minimization , 2007, IEEE Signal Processing Letters.

[8]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[9]  Mihailo Stojnic,et al.  Block-length dependent thresholds in block-sparse compressed sensing , 2009, ArXiv.

[10]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[11]  Robert D. Nowak,et al.  Tight Measurement Bounds for Exact Recovery of Structured Sparse Signals , 2011, ArXiv.

[12]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[13]  郭海亮,et al.  L 1/2 正则子在 L q (0 q < 1)正则子中的代表性: 基于相位图的实验研究 , 2012 .

[14]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[15]  Dmitry M. Malioutov,et al.  A sparse signal reconstruction perspective for source localization with sensor arrays , 2005, IEEE Transactions on Signal Processing.

[16]  Massimo Fornasier,et al.  Recovery Algorithms for Vector-Valued Data with Joint Sparsity Constraints , 2008, SIAM J. Numer. Anal..

[17]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[18]  Akram Aldroubi,et al.  Stability and robustness of lq minimization using null space property , 2011 .

[19]  Junzhou Huang,et al.  The Benefit of Group Sparsity , 2009 .

[20]  A. Majumdar,et al.  Fast group sparse classification , 2009, Canadian Journal of Electrical and Computer Engineering.

[21]  Rabab K. Ward,et al.  Compressed sensing of color images , 2010, Signal Process..

[22]  Chiara Sabatti,et al.  Empirical Bayes Estimation of a Sparse Vector of Gene Expression Changes , 2005, Statistical applications in genetics and molecular biology.

[23]  M. Stojnic,et al.  $\ell_{2}/\ell_{1}$ -Optimization in Block-Sparse Compressed Sensing and Its Strong Thresholds , 2010, IEEE Journal of Selected Topics in Signal Processing.

[24]  Rayan Saab,et al.  Stable sparse approximations via nonconvex optimization , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[25]  Qun Wan,et al.  Enhanced compressive wideband frequency spectrum sensing for dynamic spectrum access , 2010, EURASIP Journal on Advances in Signal Processing.

[26]  Yonina C. Eldar,et al.  Block-Sparse Signals: Uncertainty Relations and Efficient Recovery , 2009, IEEE Transactions on Signal Processing.

[27]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[28]  Bhaskar D. Rao,et al.  Sparse channel estimation via matching pursuit with application to equalization , 2002, IEEE Trans. Commun..

[29]  Zongben Xu,et al.  Representative of L1/2 Regularization among Lq (0 < q ≤ 1) Regularizations: an Experimental Study Based on Phase Diagram , 2012 .

[30]  Zongben Xu,et al.  $L_{1/2}$ Regularization: A Thresholding Representation Theory and a Fast Solver , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[32]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[33]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[34]  Qiyu Sun,et al.  Recovery of sparsest signals via ℓq-minimization , 2010, ArXiv.

[35]  A. J. Jerri The Shannon sampling theorem—Its various extensions and applications: A tutorial review , 1977, Proceedings of the IEEE.

[36]  Yonina C. Eldar,et al.  Near-Oracle Performance of Greedy Block-Sparse Estimation Techniques From Noisy Measurements , 2010, IEEE Journal of Selected Topics in Signal Processing.

[37]  Qiyu Sun,et al.  Recovery of sparsest signals via $\ell^q$-minimization , 2010 .

[38]  R. Chartrand,et al.  Restricted isometry properties and nonconvex compressive sensing , 2007 .

[39]  Marc Moonen,et al.  Joint DOA and multi-pitch estimation based on subspace techniques , 2012, EURASIP J. Adv. Signal Process..

[40]  Wang Yao,et al.  L 1/2 regularization , 2010 .

[41]  Babak Hassibi,et al.  On the Reconstruction of Block-Sparse Signals With an Optimal Number of Measurements , 2008, IEEE Transactions on Signal Processing.

[42]  Babak Hassibi,et al.  Recovering Sparse Signals Using Sparse Measurement Matrices in Compressed DNA Microarrays , 2008, IEEE Journal of Selected Topics in Signal Processing.

[43]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..