Reweighted l1-norm penalized LMS for sparse channel estimation and its analysis

A new reweighted l"1-norm penalized least mean square (LMS) algorithm for sparse channel estimation is proposed and studied in this paper. Since standard LMS algorithm does not take into account the sparsity information about the channel impulse response (CIR), sparsity-aware modifications of the LMS algorithm aim at outperforming the standard LMS by introducing a penalty term to the standard LMS cost function which forces the solution to be sparse. Our reweighted l"1-norm penalized LMS algorithm introduces in addition a reweighting of the CIR coefficient estimates to promote a sparse solution even more and approximate l"0-pseudo-norm closer. We provide in depth quantitative analysis of the reweighted l"1-norm penalized LMS algorithm. An expression for the excess mean square error (MSE) of the algorithm is also derived which suggests that under the right conditions, the reweighted l"1-norm penalized LMS algorithm outperforms the standard LMS, which is expected. However, our quantitative analysis also answers the question of what is the maximum sparsity level in the channel for which the reweighted l"1-norm penalized LMS algorithm is better than the standard LMS. Simulation results showing the better performance of the reweighted l"1-norm penalized LMS algorithm compared to other existing LMS-type algorithms are given.

[1]  Sergios Theodoridis,et al.  A Sparsity Promoting Adaptive Algorithm for Distributed Learning , 2012, IEEE Transactions on Signal Processing.

[2]  Azzedine Zerguine,et al.  A variable step size strategy for sparse system identification , 2013, 10th International Multi-Conferences on Systems, Signals & Devices 2013 (SSD13).

[3]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[4]  Jean-Yves Tourneret,et al.  Stochastic Analysis of the LMS Algorithm for System Identification With Subspace Inputs , 2008, IEEE Transactions on Signal Processing.

[5]  Neil J. Bershad,et al.  Fast coupled adaptation for sparse impulse responses using a partial haar transform , 2005, IEEE Transactions on Signal Processing.

[6]  Sergiy A. Vorobyov,et al.  Sparse channel estimation with lp-norm and reweighted l1-norm penalized least mean squares , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  K. Senne,et al.  Performance advantage of complex LMS for controlling narrow-band adaptive arrays , 1981 .

[8]  Ali H. Sayed,et al.  Sparse Distributed Learning Based on Diffusion Adaptation , 2012, IEEE Transactions on Signal Processing.

[9]  C. Richard Johnson,et al.  Exploiting sparsity in adaptive filters , 2002, IEEE Trans. Signal Process..

[10]  Jian Wang,et al.  Performance Analysis of $l_0$ Norm Constraint Least Mean Square Algorithm , 2012, IEEE Transactions on Signal Processing.

[11]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Jie Yang,et al.  Sparse LMS with segment zero attractors for adaptive estimation of sparse signals , 2010, 2010 IEEE Asia Pacific Conference on Circuits and Systems.

[13]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[14]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[15]  Namrata Vaswani,et al.  Kalman filtered Compressed Sensing , 2008, 2008 15th IEEE International Conference on Image Processing.

[16]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[17]  Scott C. Douglas,et al.  Exact expectation analysis of the LMS adaptive filter , 1995, IEEE Trans. Signal Process..

[18]  Peng Shi,et al.  Convergence analysis of sparse LMS algorithms with l1-norm penalty based on white input signal , 2010, Signal Process..

[19]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[20]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[21]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[22]  Xiaoli Ma,et al.  Transform domain LMS algorithms for sparse system identification , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Georgios B. Giannakis,et al.  Online Adaptive Estimation of Sparse Signals: Where RLS Meets the $\ell_1$ -Norm , 2010, IEEE Transactions on Signal Processing.

[24]  Mauricio D. Sacchi,et al.  Minimum weighted norm interpolation of seismic records , 2004 .

[25]  Behrouz Farhang-Boroujeny,et al.  Fast LMS/Newton Algorithms for Stereophonic Acoustic Echo Cancelation , 2009, IEEE Transactions on Signal Processing.

[26]  Alexandru Onose,et al.  Greedy Sparse RLS , 2012, IEEE Transactions on Signal Processing.

[27]  Mamadou Mboup,et al.  Steady-state superiority of LMS over LS for time-varying line enhancer in noisy environment , 1991 .

[28]  Sinem Coleri Ergen,et al.  Channel estimation techniques based on pilot arrangement in OFDM systems , 2002, IEEE Trans. Broadcast..

[29]  Isao Yamada,et al.  A sparse adaptive filtering using time-varying soft-thresholding techniques , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Sergiy A. Vorobyov,et al.  Decimated least mean squares for frequency sparse channel estimation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).