Sparse-aware set-membership NLMS algorithms and their application for sparse channel estimation and echo cancelation

Abstract In this paper, we propose a type of sparsity-aware set-membership normalized least mean square (SM-NLMS) algorithm for sparse channel estimation and echo cancelation. The proposed algorithm incorporates an l 1 -norm penalty into the cost function of the conventional SM-NLMS algorithm to exploit the sparsity of the sparse systems, which is denoted as zero-attracting SM-NLMS (ZASM-NLMS) algorithm. Furthermore, an improved ZASM-NLMS algorithm is also derived by using a log-sum function instead of the l 1 -norm penalty in the ZASM-NLMS, which is denoted as reweighted ZASM-NLMS (RZASM-NLMS) algorithm. These zero-attracting SM-NLMS algorithms are equivalent to adding shrinkages in their update equations, which result in fast convergence speed and low estimation error when most of the unknown channel coefficients are zero or close to zero. These proposed algorithms are described and analyzed in detail, while the performances of these algorithms are investigated by using computer simulations. The simulation results obtained from sparse channel estimation and echo cancelation demonstrate that the proposed sparse SM-NLMS algorithms are superior to the previously proposed NLMS, SM-NLMS as well as zero-attracting NLMS (ZA-NLMS) algorithms.

[1]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[2]  Fumiyuki Adachi,et al.  Improved least mean square algorithm with application to adaptive sparse channel estimation , 2013, EURASIP Journal on Wireless Communications and Networking.

[3]  Mohammad Shukri Salman,et al.  Convergence analysis of the zero-attracting variable step-size LMS algorithm for sparse system identification , 2015, Signal Image Video Process..

[4]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Yingsong Li,et al.  Smooth Approximation l 0-Norm Constrained Affine Projection Algorithm and Its Applications in Sparse Channel Estimation , 2014, TheScientificWorldJournal.

[6]  Ender M. Eksioglu,et al.  Sparsity regularised recursive least squares adaptive filtering , 2011 .

[7]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[8]  Sergiy A. Vorobyov,et al.  Sparse channel estimation with lp-norm and reweighted l1-norm penalized least mean squares , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Shirish Nagaraj,et al.  Set-membership filtering and a set-membership normalized LMS algorithm with an adaptive step size , 1998, IEEE Signal Processing Letters.

[10]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[11]  Yahui Yu,et al.  The Exponential Diophantine Equation 2x + b y = c z , 2014, TheScientificWorldJournal.

[12]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[13]  Peng Shi,et al.  Convergence analysis of sparse LMS algorithms with l1-norm penalty based on white input signal , 2010, Signal Process..

[14]  Jian Wang,et al.  Performance Analysis of $l_0$ Norm Constraint Least Mean Square Algorithm , 2012, IEEE Transactions on Signal Processing.

[15]  A. Antoniou,et al.  A set-membership nlms algorithm with adaptive error bound , 2008, 2008 Canadian Conference on Electrical and Computer Engineering.

[16]  Isao Yamada,et al.  Steady-State Mean-Square Performance Analysis of a Relaxed Set-Membership NLMS Algorithm by the Energy Conservation Argument , 2009, IEEE Transactions on Signal Processing.

[17]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[18]  Stefan Werner,et al.  Set-membership binormalized data-reusing LMS algorithms , 2003, IEEE Trans. Signal Process..

[19]  Martin Brown,et al.  On the convergence rate performance of the normalized least-mean-square adaptation , 1997, IEEE Trans. Neural Networks.

[20]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[21]  Gerald Matz,et al.  Adaptive Wiener filters for time-varying channel estimation in wireless OFDM systems , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[22]  V. Nascimento,et al.  Sparsity-aware affine projection adaptive algorithms for system identification , 2011 .

[23]  Mohammad Shukri Salman,et al.  Sparse leaky‐LMS algorithm for system identification and its convergence analysis , 2014 .

[24]  Neil J. Bershad,et al.  Analysis of the normalized LMS algorithm with Gaussian inputs , 1986, IEEE Trans. Acoust. Speech Signal Process..

[25]  Yingsong Li,et al.  An Improved Proportionate Normalized Least-Mean-Square Algorithm for Broadband Multipath Channel Estimation , 2014, TheScientificWorldJournal.

[26]  Paulo S. R. Diniz,et al.  Affine projection algorithms for sparse system identification , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Sergiy A. Vorobyov,et al.  Reweighted l1-norm penalized LMS for sparse channel estimation and its analysis , 2014, Signal Process..

[28]  Paulo S. R. Diniz,et al.  Adaptive Filtering: Algorithms and Practical Implementation , 1997 .

[29]  Bhaskar D. Rao,et al.  Sparse channel estimation via matching pursuit with application to equalization , 2002, IEEE Trans. Commun..

[30]  Sheng Zhang,et al.  Set-Membership NLMS Algorithm With Robust Error Bound , 2014, IEEE Transactions on Circuits and Systems II: Express Briefs.