A sparse Bayesian learning algorithm with dictionary parameter estimation

This paper concerns sparse decomposition of a noisy signal into atoms which are specified by unknown continuous-valued parameters. An example could be estimation of the model order, frequencies and amplitudes of a superposition of complex sinusoids. The common approach is to reduce the continuous parameter space to a fixed grid of points, thus restricting the solution space. In this work, we avoid discretization by working directly with the signal model containing parameterized atoms. Inspired by the “fast inference scheme” by Tipping and Faul we develop a novel sparse Bayesian learning (SBL) algorithm, which estimates the atom parameters along with the model order and weighting coefficients. Numerical experiments for spectral estimation with closely-spaced frequency components, show that the proposed SBL algorithm outperforms state-of-the-art subspace and compressed sensing methods.

[1]  Petre Stoica,et al.  MUSIC, maximum likelihood, and Cramer-Rao bound , 1989, IEEE Transactions on Acoustics, Speech, and Signal Processing.

[2]  Petre Stoica List of references on spectral line analysis , 1993, Signal Process..

[3]  Marco F. Duarte,et al.  Spectral compressive sensing , 2013 .

[4]  Wenjing Liao,et al.  Coherence Pattern-Guided Compressive Sensing with Unresolved Grids , 2011, SIAM J. Imaging Sci..

[5]  Dmitriy Shutin,et al.  Sparse estimation using Bayesian hierarchical prior modeling for real and complex linear models , 2015, Signal Process..

[6]  Dmitriy Shutin,et al.  2 2 A ug 2 01 1 1 Sparse Estimation using Bayesian Hierarchical Prior Modeling for Real and Complex Models , 2011 .

[7]  Søren Holdt Jensen,et al.  Compressive Parameter Estimation for Sparse Translation-Invariant Signals Using Polar Interpolation , 2013, IEEE Transactions on Signal Processing.

[8]  David B. Dunson,et al.  Multitask Compressive Sensing , 2009, IEEE Transactions on Signal Processing.

[9]  Michael Elad,et al.  Analysis versus synthesis in signal priors , 2006, 2006 14th European Signal Processing Conference.

[10]  Yonina C. Eldar,et al.  Compressed Sensing with Coherent and Redundant Dictionaries , 2010, ArXiv.

[11]  K. Arun,et al.  State-space and singular-value decomposition-based approximation methods for the harmonic retrieval problem , 1983 .

[12]  Eero P. Simoncelli,et al.  Recovery of Sparse Translation-Invariant Signals With Continuous Basis Pursuit , 2011, IEEE Transactions on Signal Processing.

[13]  Michael E. Tipping,et al.  Fast Marginal Likelihood Maximisation for Sparse Bayesian Models , 2003 .

[14]  Ieee Staff 2014 IEEE 8th Sensor Array and Multichannel Signal Processing Workshop (SAM) , 2014 .

[15]  Gongguo Tang,et al.  Atomic Norm Denoising With Applications to Line Spectral Estimation , 2012, IEEE Transactions on Signal Processing.

[16]  Thomas Strohmer,et al.  Measure What Should be Measured: Progress and Challenges in Compressive Sensing , 2012, ArXiv.

[17]  Emmanuel J. Candès,et al.  Super-Resolution from Noisy Data , 2012, Journal of Fourier Analysis and Applications.

[18]  Bernard H. Fleury,et al.  Bayesian compressed sensing with unknown measurement noise level , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[19]  Bhaskar D. Rao,et al.  Latent Variable Bayesian Models for Promoting Sparsity , 2011, IEEE Transactions on Information Theory.

[20]  Dmitriy Shutin,et al.  Incremental Sparse Bayesian Learning for Parameter Estimation of Superimposed Signals , 2013 .

[21]  Thomas Kailath,et al.  ESPRIT-estimation of signal parameters via rotational invariance techniques , 1989, IEEE Trans. Acoust. Speech Signal Process..