Robust Signal Recovery from Incomplete Observations

Recently, a series of exciting results have shown that it is possible to reconstruct a sparse signal exactly from a very limited number of linear measurements by solving a convex optimization program. If our underlying signal f can be written as a superposition of B elements from a known basis, it is possible to recover f from a projection onto a generic subspace of dimension about B log N. Moreover, the procedure is robust to measurement error; adding a perturbation of size ∈ to the measurements will not induce a recovery error of more than a small constant times ∈. In this paper, we will briefly overview these results, and show how the recovery via convex optimization can be implemented in an efficient manner, and present some numerical results illustrating the practicality of the procedure.

[1]  Stephen J. Wright Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[2]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[3]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[4]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[5]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[6]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[7]  J. CandesE.,et al.  Near-Optimal Signal Recovery From Random Projections , 2006 .

[8]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[9]  James Renegar,et al.  A mathematical view of interior-point methods in convex optimization , 2001, MPS-SIAM series on optimization.

[10]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[11]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[12]  Donald Goldfarb,et al.  Second-order cone programming , 2003, Math. Program..

[13]  Wotao Yin,et al.  Second-order Cone Programming Methods for Total Variation-Based Image Restoration , 2005, SIAM J. Sci. Comput..

[14]  J. Shewchuk An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .