A zero-attracting variable step-size LMS algorithm for sparse system identification

In this paper, new adaptive algorithms are proposed to improve the performance of the variable step-size LMS (VSSLMS) algorithm when the system is sparse. The first proposed algorithm is the zero-attracting (ZA) VSSLMS. This algorithm outperforms the standard VSSLMS if the system is highly sparse. However, the performance of the ZA-VSSLMS algorithm deteriorates when the sparsity of the system decreases. To further improve the performance of the ZA-VSSLMS filter, the weighted zero-attracting (WZA)-VSSLMS algorithm is introduced. The algorithm performs the same or better than the ZA-VSSLMS if the system is highly sparse. On the other hand, when the sparsity of the system decreases, it performs better than the ZA-VSSLMS and better or the same as the standard VSSLMS algorithm. Also, both proposed algorithms have the same order of computational complexity as that of the VSSLMS algorithm (O(N)). For a system identification setting, the results indicate the high performance of the proposed algorithms in convergence speed and/or steady-state error under sparsity condition compared with the standard VSSLMS algorithm.

[1]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[2]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[3]  M. Hatori,et al.  A TAP selection algorithm for adaptive filters , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[5]  Xiaoli Ma,et al.  Transform domain LMS algorithms for sparse system identification , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Richard W. Harris,et al.  A variable step (VS) adaptive filter algorithm , 1986, IEEE Trans. Acoust. Speech Signal Process..

[7]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  W. Y. Chen,et al.  A variable step size LMS algorithm , 1990, Proceedings of the 33rd Midwest Symposium on Circuits and Systems.

[9]  S. Khoo,et al.  A class of modified variable step-size NLMS algorithms for system identification , 2009, 2009 4th IEEE Conference on Industrial Electronics and Applications.