Augmented Bayesian Compressive Sensing

The simultaneous sparse approximation problem is concerned with recovering a set of multichannel signals that share a common support pattern using incomplete or compressive measurements. Multichannel modifications of greedy algorithms like orthogonal matching pursuit (OMP), as well as convex mixed-norm extensions of the Lasso, have typically been deployed for efficient signal estimation. While accurate recovery is possible under certain circumstances, it has been established that these methods may all fail in regimes where traditional subspace techniques from array processing, notably the MUSIC algorithm, can provably succeed. Against this backdrop several recent hybrid algorithms have been developed that merge a subspace estimation step with OMP-like procedures to obtain superior results, sometimes with theoretical guarantees. In contrast, this paper considers a completely different approach built upon Bayesian compressive sensing. In particular, we demonstrate that minor modifications of standard Bayesian algorithms can naturally obtain the best of both worlds backed with theoretical and empirical support, surpassing the performance of existing hybrid MUSIC and convex simultaneous sparse approximation algorithms, especially when poor RIP conditions render alternative approaches ineffectual.

[1]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Bhaskar D. Rao,et al.  Sparse Signal Recovery With Temporally Correlated Source Vectors Using Sparse Bayesian Learning , 2011, IEEE Journal of Selected Topics in Signal Processing.

[3]  Bhaskar D. Rao,et al.  Subset selection in noise based on diversity measure minimization , 2003, IEEE Trans. Signal Process..

[4]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001 .

[5]  J. Tropp Algorithms for simultaneous sparse approximation. Part II: Convex relaxation , 2006, Signal Process..

[6]  Dmitry M. Malioutov,et al.  A sparse signal reconstruction perspective for source localization with sensor arrays , 2005, IEEE Transactions on Signal Processing.

[7]  Richard M. Leahy,et al.  Electromagnetic brain mapping , 2001, IEEE Signal Process. Mag..

[8]  Yoram Bresler,et al.  Subspace Methods for Joint Sparse Recovery , 2010, IEEE Transactions on Information Theory.

[9]  Joel A. Tropp,et al.  ALGORITHMS FOR SIMULTANEOUS SPARSE APPROXIMATION , 2006 .

[10]  Jong Chul Ye,et al.  Compressive MUSIC: Revisiting the Link Between Compressive Sensing and Array Signal Processing , 2012, IEEE Trans. Inf. Theory.

[11]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[12]  Michael P. Fitz,et al.  Reduced complexity decision feedback equalization for multipath channels with large delay spreads , 1999, IEEE Trans. Commun..

[13]  Bhaskar D. Rao,et al.  Latent Variable Bayesian Models for Promoting Sparsity , 2011, IEEE Transactions on Information Theory.

[14]  Bhaskar D. Rao,et al.  An Empirical Bayesian Strategy for Solving the Simultaneous Sparse Approximation Problem , 2007, IEEE Transactions on Signal Processing.

[15]  Jong Chul Ye,et al.  Improving Noise Robustness in Subspace-Based Joint Sparse Recovery , 2011, IEEE Transactions on Signal Processing.

[16]  Richard M. Leahy,et al.  Electromagnetic brain mapping - IEEE Signal Processing Magazine , 2001 .

[17]  Jorge S. Marques,et al.  Selecting Landmark Points for Sparse Manifold Learning , 2005, NIPS.

[18]  Richard G. Baraniuk,et al.  Recovery of Jointly Sparse Signals from Few Random Projections , 2005, NIPS.

[19]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[20]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[21]  Qing Ling,et al.  Decentralized Jointly Sparse Optimization by Reweighted Minimization , 2013 .

[22]  David B. Dunson,et al.  Multitask Compressive Sensing , 2009, IEEE Transactions on Signal Processing.

[23]  Yonina C. Eldar,et al.  Rank Awareness in Joint Sparse Recovery , 2010, IEEE Transactions on Information Theory.

[24]  Qing Ling,et al.  Decentralized Jointly Sparse Optimization by Reweighted $\ell_{q}$ Minimization , 2013, IEEE Transactions on Signal Processing.

[25]  Michael E. Tipping Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[26]  David B. Dunson,et al.  Multi-Task Compressive Sensing , 2007 .

[27]  Chen Li,et al.  Distributed Compressive Spectrum Sensing in Cooperative Multihop Cognitive Networks , 2011, IEEE Journal of Selected Topics in Signal Processing.

[28]  Ping Feng,et al.  Universal Minimum-Rate Sampling and Spectrum-Blind Reconstruction for Multiband Signals , 1998 .