A weighted zero-attracting leaky-LMS algorithm

In this paper, a novel weighted zero-attracting leaky-LMS (WZA-LLMS) adaptive algorithm for sparse systems is proposed. In the proposed algorithm, a log-sum penalty is incorporated into the cost function of the leaky-LMS algorithm, which results in a shrinkage in the update equation. This shrinkage gives the algorithm the ability of attracting zeros, i.e., when the system is sparse, and hence improves its performance. The performance of the proposed WZA-LLMS algorithm is compared to those of the standard leaky-LMS and ZA-LMS algorithms in sparse system identification settings. The WZA-LLMS algorithm shows superior performance compared to the algorithms.

[1]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Tyseer Aboulnasr,et al.  Leaky LMS algorithm: MSE analysis for Gaussian data , 1997, IEEE Trans. Signal Process..

[3]  D. Etter,et al.  Identification of sparse impulse response systems using an adaptive delay filter , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  M. Hatori,et al.  A TAP selection algorithm for adaptive filters , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  Kun Tang,et al.  Parallel Nlms Filters with Stochastic Active Taps and Step-Sizes for Sparse System Identification , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[6]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[7]  Peng Shi,et al.  Convergence analysis of sparse LMS algorithms with l1-norm penalty based on white input signal , 2010, Signal Process..

[8]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.