REGULARIZED FOCUSS FOR SUBSET SELECTION IN NOISE

This paper considers subset selection in the presence of noise via algorithms that minimize diversity measures. This leads to iterative procedures like regularized FOCUSS in which each iteration involves the solution to a regularized least squares problem. Several di erent methods for choosing the regularization parameter such as the discrepancy principle and the L-curve technique are evaluated for this purpose and compared. To overcome some of the limitations in existing methods, a modi ed L-curve approach is proposed. Experiments using regularized FOCUSS with the di erent methods for choosing the regularization parameter are conducted and compared with a sequential subset selection method, the Orthogonal Matching Pursuit (OMP) method. Results show that a modi ed L-curve approach works well for nding the regularization parameter in this application.

[1]  Manbir Singh,et al.  An Evaluation of Methods for Neuromagnetic Image Reconstruction , 1987, IEEE Transactions on Biomedical Engineering.

[2]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[3]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[4]  Dianne P. O'Leary,et al.  The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems , 1993, SIAM J. Sci. Comput..

[5]  Zhifeng Zhang,et al.  Adaptive Nonlinear Approximations , 1994 .

[6]  B. Rao Analysis and extensions of the FOCUSS algorithm , 1996, Conference Record of The Thirtieth Asilomar Conference on Signals, Systems and Computers.

[7]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[8]  Kjersti Engan,et al.  Multi-frame compression: theory and design , 2000, Signal Process..