An algebraic approach to the subset selection problem

The need for decomposing a signal into its optimal representation arises in many applications. In such applications, one can usually represent the signal as a combination of an over-complete dictionary elements. The non-uniqueness of signal representation, in such dictionaries, provides us with the opportunity to adapt the signal representation to the signal. The adaptation is based on sparsity, resolution and stability of the signal representation. In this paper, we propose an algebraic approach for identifying the sparsest representation of a given signal in terms of a given over-complete dictionary. Unlike other current techniques, our approach is guaranteed to find the solution, given that certain conditions apply. We explain these conditions.

[1]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[2]  Ingrid Daubechies,et al.  Time-frequency localization operators: A geometric phase space approach , 1988, IEEE Trans. Inf. Theory.

[3]  Ahmed H. Tewfik,et al.  Reduced complexity M-ary hypotheses testing in wireless communications , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[4]  A. Atkinson Subset Selection in Regression , 1992 .

[5]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[6]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[7]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[8]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[9]  Ahmed H. Tewfik,et al.  Optimal subset selection for adaptive signal representation , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.