Why l1 Is a Good Approximation to l0: A Geometric Explanation

In practice, we usually have partial information; as a result, we have several dierent possibilities consistent with the given measurements and the given knowledge. For example, in geosciences, several possible density distributions are consistent with the measurement results. It is reasonable to select the simplest among such distributions. A general solution can be described, e.g., as a linear combination of basic functions. A natural way to dene the simplest solution is to select one for which the number of the non-zero coecients ci is the smallest. The corresponding \‘0-optimization" problem is non-convex and therefore, dicult to solve. As a good approximation to this problem, Cand es and Tao proposed to use a solution to the convex ‘1 optimization problem P jcij ! min. In this paper, we provide a geometric

[1]  Reinaldo Sanchez,et al.  An ℓ1-algorithm for underdetermined systems and applications , 2011, 2011 Annual Meeting of the North American Fuzzy Information Processing Society.

[2]  S. Vavasis Nonlinear optimization: complexity issues , 1991 .

[3]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[4]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[5]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[6]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[7]  Miguel Argáez,et al.  Sparse representation via ℓ1-minimization for underdetermined systems in classification of tumors with gene expression data , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..