Convex feasibility modeling and projection methods for sparse signal recovery

A computationally-efficient method for recovering sparse signals from a series of noisy observations, known as the problem of compressed sensing (CS), is presented. The theory of CS usually leads to a constrained convex minimization problem. In this work, an alternative outlook is proposed. Instead of solving the CS problem as an optimization problem, it is suggested to transform the optimization problem into a convex feasibility problem (CFP), and solve it using feasibility-seeking sequential and simultaneous subgradient projection methods, which are iterative, fast, robust and convergent schemes for solving CFPs. As opposed to some of the commonly-used CS algorithms, such as Bayesian CS and Gradient Projections for sparse reconstruction, which become inefficient as the problem dimension and sparseness degree increase, the proposed methods exhibit robustness with respect to these parameters. Moreover, it is shown that the CFP-based projection methods are superior to some of the state-of-the-art methods in recovering the signal's support. Numerical experiments show that the CFP-based projection methods are viable for solving large-scale CS problems with compressible signals.

[1]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[2]  Gilbert Crombez Non-monotoneous parallel iteration for solving convex feasibility problems , 2003, Kybernetika.

[3]  Andrzej Stachurski,et al.  Parallel Optimization: Theory, Algorithms and Applications , 2000, Parallel Distributed Comput. Pract..

[4]  P. L. Combettes The foundations of set theoretic estimation , 1993 .

[5]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[6]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[7]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[8]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[9]  Y. Censor,et al.  On the use of Cimmino's simultaneous projections method for computing a solution of the inverse problem in radiation therapy treatment planning , 1988 .

[10]  Gilbert Crombez A sequential iteration algorithm with non-monotoneous behaviour in the method of projections onto convex sets , 2006 .

[11]  E. George,et al.  APPROACHES FOR BAYESIAN VARIABLE SELECTION , 1997 .

[12]  P. L. Combettes,et al.  The Convex Feasibility Problem in Image Recovery , 1996 .

[13]  Peter Boesiger,et al.  Compressed sensing in dynamic MRI , 2008, Magnetic resonance in medicine.

[14]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[15]  M. Rudelson Random Vectors in the Isotropic Position , 1996, math/9608208.

[16]  Pini Gurfil,et al.  Methods for Sparse Signal Recovery Using Kalman Filtering With Embedded Pseudo-Measurement Norms and Quasi-Norms , 2010, IEEE Transactions on Signal Processing.

[17]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[18]  K. Worsley,et al.  Detecting Sparse Signals in Random Fields, With an Application to Brain Mapping , 2007 .

[19]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[20]  Patrick L. Combettes,et al.  On the effectiveness of projection methods for convex feasibility problems with linear inequality constraints , 2009, Computational Optimization and Applications.

[21]  S. Godsill,et al.  Bayesian variable selection and regularization for time–frequency surface estimation , 2004 .

[22]  L. Carin,et al.  Compressive particle filtering for target tracking , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[23]  Lúcio T. Santos,et al.  A parallel subgradient projections method for the convex feasibility problem , 1987 .

[24]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[25]  Pini Gurfil,et al.  On The Behavior of Subgradient Projections Methods for Convex Feasibility Problems in Euclidean Spaces , 2008, SIAM J. Optim..

[26]  Yair Censor,et al.  Cyclic subgradient projections , 1982, Math. Program..

[27]  Stergios I. Roumeliotis,et al.  Distributed multirobot localization , 2002, IEEE Trans. Robotics Autom..

[28]  Gabor T. Herman,et al.  Fundamentals of Computerized Tomography: Image Reconstruction from Projections , 2009, Advances in Pattern Recognition.

[29]  Rick Chartrand,et al.  Exact Reconstruction of Sparse Signals via Nonconvex Minimization , 2007, IEEE Signal Processing Letters.

[30]  K. Jarrod Millman,et al.  Learning Sparse Codes with a Mixture-of-Gaussians Prior , 1999, NIPS.

[31]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[32]  Stephen P. Boyd,et al.  Sensor Selection via Convex Optimization , 2009, IEEE Transactions on Signal Processing.

[33]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[34]  Y. Censor,et al.  Block-iterative projection methods for parallel computation of solutions to convex feasibility problems , 1989 .

[35]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[36]  R. Remmert,et al.  European Mathematical Society , 1994 .

[37]  Heinz H. Bauschke,et al.  On Projection Algorithms for Solving Convex Feasibility Problems , 1996, SIAM Rev..

[38]  E.J. Candes Compressive Sampling , 2022 .

[39]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[40]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[41]  I. Yamada,et al.  Hybrid Steepest Descent Method for Variational Inequality Problem over the Fixed Point Set of Certain Quasi-nonexpansive Mappings , 2005 .

[42]  Stergios I. Roumeliotis,et al.  Distributed Multi-Robot Localization , 2000, DARS.