Generalized Orthogonal Matching Pursuit

As a greedy algorithm to recover sparse signals from compressed measurements, orthogonal matching pursuit (OMP) algorithm has received much attention in recent years. In this paper, we introduce an extension of the OMP for pursuing efficiency in reconstructing sparse signals. Our approach, henceforth referred to as generalized OMP (gOMP), is literally a generalization of the OMP in the sense that multiple <i>N</i> indices are identified per iteration. Owing to the selection of multiple “correct” indices, the gOMP algorithm is finished with much smaller number of iterations when compared to the OMP. We show that the gOMP can perfectly reconstruct any <i>K</i>-sparse signals (<i>K</i> >; 1), provided that the sensing matrix satisfies the RIP with δ<sub>NK</sub> <; [(√<i>N</i>)/(√<i>K</i>+3√<i>N</i>)]. We also demonstrate by empirical simulations that the gOMP has excellent recovery performance comparable to <i>l</i><sub>1</sub>-minimization technique with fast processing speed and competitive computational complexity.

[1]  Ray Maleh,et al.  Improved RIP Analysis of Orthogonal Matching Pursuit , 2011, ArXiv.

[2]  A DavenportMark,et al.  Analysis of orthogonal matching pursuit using the restricted isometry property , 2010 .

[3]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[4]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[5]  Jian Wang,et al.  Near optimal bound of orthogonal matching pursuit using restricted isometric constant , 2012, EURASIP J. Adv. Signal Process..

[6]  Deanna Needell,et al.  Signal Recovery From Incomplete and Inaccurate Measurements Via Regularized Orthogonal Matching Pursuit , 2007, IEEE Journal of Selected Topics in Signal Processing.

[7]  David L. Donoho,et al.  Sparse Solution Of Underdetermined Linear Equations By Stagewise Orthogonal Matching Pursuit , 2006 .

[8]  Weiyu Xu,et al.  Breaking through the thresholds: an analysis for iterative reweighted ℓ1 minimization via the Grassmann angle framework , 2009, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[10]  Michael Zibulevsky,et al.  Signal reconstruction in sensor arrays using sparse representations , 2006, Signal Process..

[11]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[12]  Michael B. Wakin,et al.  Analysis of Orthogonal Matching Pursuit Using the Restricted Isometry Property , 2009, IEEE Transactions on Information Theory.

[13]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[14]  Volkan Cevher,et al.  Distributed target localization via spatial sparsity , 2008, 2008 16th European Signal Processing Conference.

[15]  Dmitry M. Malioutov,et al.  A sparse signal reconstruction perspective for source localization with sensor arrays , 2005, IEEE Transactions on Signal Processing.

[16]  Deanna Needell,et al.  Uniform Uncertainty Principle and Signal Recovery via Regularized Orthogonal Matching Pursuit , 2007, Found. Comput. Math..

[17]  Shie Qian,et al.  Signal representation using adaptive normalized Gaussian functions , 1994, Signal Process..

[18]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[19]  J. Navarro-Pedreño Numerical Methods for Least Squares Problems , 1996 .

[20]  Simon Foucart,et al.  Stability and Robustness of Weak Orthogonal Matching Pursuits , 2012 .

[21]  Roummel F. Marcia,et al.  Compressed Sensing Performance Bounds Under Poisson Noise , 2009, IEEE Transactions on Signal Processing.

[22]  Richard Baraniuk,et al.  Compressed Sensing Reconstruction via Belief Propagation , 2006 .

[23]  Tong Zhang,et al.  Sparse Recovery With Orthogonal Matching Pursuit Under RIP , 2010, IEEE Transactions on Information Theory.

[24]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[25]  Entao Liu,et al.  Orthogonal Super Greedy Algorithm and Applications in Compressed Sensing ∗ , 2010 .

[26]  Michael Elad,et al.  RIP-Based Near-Oracle Performance Guarantees for Subspace-Pursuit, CoSaMP, and Iterative Hard-Thresholding , 2010, 1005.4539.

[27]  Emmanuel J. Candès,et al.  Error correction via linear programming , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[28]  Michael Elad,et al.  RIP-Based Near-Oracle Performance Guarantees for SP, CoSaMP, and IHT , 2012, IEEE Transactions on Signal Processing.

[29]  Bruce W. Suter,et al.  Compressive Sampling With Generalized Polygons , 2011, IEEE Transactions on Signal Processing.

[30]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[31]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[32]  Alexandros G. Dimakis,et al.  Sparse Recovery of Nonnegative Signals With Minimal Expansion , 2011, IEEE Transactions on Signal Processing.

[33]  Jian Wang,et al.  Exact reconstruction of sparse signals via generalized orthogonal matching pursuit , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[34]  Jian Wang,et al.  On the Recovery Limit of Sparse Signals Using Orthogonal Matching Pursuit , 2012, IEEE Transactions on Signal Processing.

[35]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[36]  E. Candès,et al.  Sparsity and incoherence in compressive sampling , 2006, math/0611957.