Performance analysis of Orthogonal Matching Pursuit under general perturbations

As a canonical greedy algorithm, Orthogonal Matching Pursuit (OMP) is used for sparse approximation. Previous studies have mainly considered non-perturbed observations y = Φx, and focused on the exact recovery of x through y and Φ. Here, Φ is a matrix with more columns than rows, and x is a sparse signal to be recovered. This paper deals with performance of OMP under general perturbations - from both y and Φ. The main contribution shows that exact recovery of the support set of x can be guaranteed under suitable conditions. Such conditions are RIP-based, and involve the concept of sparsity, relative perturbation, and the smallest nonzero entry. In addition, certain conditions are given under which the support set of x can be reconstructed in the order of its entries' magnitude. In the end, it is pointed out that the conditions can be relaxed at the expense of a decrease in the accuracy of the recovery.

[1]  Michael B. Wakin,et al.  Analysis of Orthogonal Matching Pursuit Using the Restricted Isometry Property , 2009, IEEE Transactions on Information Theory.

[2]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[3]  Thomas Strohmer,et al.  General Deviants: An Analysis of Perturbations in Compressed Sensing , 2009, IEEE Journal of Selected Topics in Signal Processing.

[4]  Yonina C. Eldar,et al.  From Theory to Practice: Sub-Nyquist Sampling of Sparse Wideband Analog Signals , 2009, IEEE Journal of Selected Topics in Signal Processing.

[5]  D. Lorenz,et al.  Greedy solution of ill-posed problems: error bounds and exact inversion , 2009, 0904.0154.

[6]  Entao Liu,et al.  Orthogonal Super Greedy Algorithm and Applications in Compressed Sensing ∗ , 2010 .

[7]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[8]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[9]  P. Wojtaszczyk,et al.  Error Estimates for Orthogonal Matching Pursuit and Random Dictionaries , 2011 .

[10]  Deanna Needell,et al.  Signal Recovery From Incomplete and Inaccurate Measurements Via Regularized Orthogonal Matching Pursuit , 2007, IEEE Journal of Selected Topics in Signal Processing.

[11]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[12]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[13]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[14]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[15]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[16]  Deanna Needell,et al.  Uniform Uncertainty Principle and Signal Recovery via Regularized Orthogonal Matching Pursuit , 2007, Found. Comput. Math..