Sparse Bayesian learning using correlated hyperparameters for recovery of block sparse signals

Abstract Traditional sparse Bayesian learning applies independent hyperparameters to control the sparsity of each coefficient in the sparse signal. For recovery of block-sparse signals with unknown block partitioning structure, pattern coupled sparse Bayesian learning (PCSBL) method considers the sparsity patterns of the neighboring coefficients to be related to each other and uses a predefined parameter to control the relevance between the hyperparameters. However, for most real signals with block sparsity, the degree of relevance between neighboring coefficients is inhomogeneous, and should be data-dependent. This motivates us to modify PCSBL by replacing the single predefined parameter with a set of data-dependent coupling parameters (DDCP) to capture the relevance. In this paper, by performing a linear transformation to the independent hyperparameters, a set of correlated hyperparameters is generated to build the hierarchical Gaussian prior model for recovery of block sparse signals. The coupling parameters which compose the transformation matrix are estimated by the expectation maximization (EM) principle. The relevance between the hyperparameters is data dependent so the sparsity patterns of neighboring coefficients are related in an adaptive way. Compared with existing block sparse recovery methods, our approach is able to encourage the block sparse structure in a more flexible and more reliable way.

[1]  Richard G. Baraniuk,et al.  Bayesian Compressive Sensing Via Belief Propagation , 2008, IEEE Transactions on Signal Processing.

[2]  Cishen Zhang,et al.  Iterative Bayesian Reconstruction of Non-IID Block-Sparse Signals , 2014, IEEE Transactions on Signal Processing.

[3]  Cishen Zhang,et al.  Block-Sparse Impulsive Noise Reduction in OFDM Systems—A Novel Iterative Bayesian Approach , 2016, IEEE Transactions on Communications.

[4]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[5]  Hongbin Li,et al.  Pattern-Coupled Sparse Bayesian Learning for Recovery of Block-Sparse Signals , 2013, IEEE Transactions on Signal Processing.

[6]  Michael E. Tipping Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[7]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[8]  Bhaskar D. Rao,et al.  Nested Sparse Bayesian Learning for block-sparse signals with intra-block correlation , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[10]  Zhiming Xu,et al.  Sparse signal reconstruction via concave continuous piecewise linear programming , 2016, Digit. Signal Process..

[11]  Gavin C. Cawley,et al.  Preventing Over-Fitting during Model Selection via Bayesian Regularisation of the Hyper-Parameters , 2007, J. Mach. Learn. Res..

[12]  Babak Hassibi,et al.  Recovering Sparse Signals Using Sparse Measurement Matrices in Compressed DNA Microarrays , 2008, IEEE Journal of Selected Topics in Signal Processing.

[13]  Rémi Gribonval,et al.  Harmonic decomposition of audio signals with matching pursuit , 2003, IEEE Trans. Signal Process..

[14]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[15]  Yonina C. Eldar,et al.  Blind Multiband Signal Reconstruction: Compressed Sensing for Analog Signals , 2007, IEEE Transactions on Signal Processing.

[16]  Bhaskar D. Rao,et al.  Extension of SBL Algorithms for the Recovery of Block Sparse Signals With Intra-Block Correlation , 2012, IEEE Transactions on Signal Processing.

[17]  Qinghua Guo,et al.  Low complexity sparse Bayesian learning using combined belief propagation and mean field with a stretched factor graph , 2016, Signal Process..

[18]  Yonina C. Eldar,et al.  Block-Sparse Signals: Uncertainty Relations and Efficient Recovery , 2009, IEEE Transactions on Signal Processing.

[19]  Jian Li,et al.  Sparse representations and sphere decoding for array signal processing , 2012, Digit. Signal Process..

[20]  Jun Fang,et al.  Pattern-Coupled Sparse Bayesian Learning for Recovery of Block-Sparse Signals , 2015, IEEE Trans. Signal Process..

[21]  Bhaskar D. Rao,et al.  An Empirical Bayesian Strategy for Solving the Simultaneous Sparse Approximation Problem , 2007, IEEE Transactions on Signal Processing.

[22]  Philip Schniter,et al.  A Message-Passing Receiver for BICM-OFDM Over Unknown Clustered-Sparse Channels , 2011, IEEE Journal of Selected Topics in Signal Processing.