Robust zero-point attraction least mean square algorithm on near sparse system identification

The newly proposed l 1 norm constraint zero-point attraction least mean square algorithm (ZA-LMS) demonstrates excellent performance on exact sparse system identification. However, ZA-LMS has less advantage against standard LMS when the system is near sparse. Thus, in this study, firstly the near sparse system (NSS) modelling by generalised Gaussian distribution is recommended, where the sparsity is defined accordingly. Second, two modifications to the ZA-LMS algorithm have been made. The l 1 norm penalty is replaced by a partial l 1 norm in the cost function, enhancing robustness without increasing the computational complexity. Moreover, the ZA item is weighted by the magnitude of estimation error which adjusts the ZA force dynamically. By combining the two improvements, Dynamic Windowing ZA-LMS (DWZA-LMS) algorithm is further proposed, which shows better performance on NSS identification. In addition, the mean-square performance of DWZA-LMS algorithm is analysed. Finally, computer simulations demonstrate the effectiveness of the proposed algorithm and verify the result of theoretical analysis.

[1]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[2]  Joon-Hyuk Chang,et al.  Speech probability distribution based on generalized gama distribution , 2004, INTERSPEECH.

[3]  Kun Tang,et al.  Parallel Nlms Filters with Stochastic Active Taps and Step-Sizes for Sparse System Identification , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[4]  Yuantao Gu,et al.  A Stochastic Gradient Approach on Compressive Sensing Signal Reconstruction Based on Adaptive Filtering Framework , 2010, IEEE Journal of Selected Topics in Signal Processing.

[5]  W. Y. Chen,et al.  A variable step size LMS algorithm , 1990, Proceedings of the 33rd Midwest Symposium on Circuits and Systems.

[6]  Norman C. Beaulieu,et al.  Novel Low-Complexity Estimators for the Shape Parameter of the Generalized Gaussian Distribution , 2009, IEEE Transactions on Vehicular Technology.

[7]  Yuantao Gu,et al.  Network echo canceller with active taps stochastic localization , 2005, IEEE International Symposium on Communications and Information Technology, 2005. ISCIT 2005..

[8]  Jose C. Principe,et al.  Minimum entropy algorithms for source separation , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[9]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Alfred O. Hero,et al.  Partial update LMS algorithms , 2005, IEEE Transactions on Signal Processing.

[11]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[12]  Mike Brookes,et al.  Adaptive algorithms for sparse echo cancellation , 2006, Signal Process..

[13]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[14]  Kai-Sheng Song,et al.  A globally convergent and consistent method for estimating the shape parameter of a generalized Gaussian distribution , 2006, IEEE Transactions on Information Theory.

[15]  Jian Wang,et al.  Performance Analysis of $l_0$ Norm Constraint Least Mean Square Algorithm , 2012, IEEE Transactions on Signal Processing.

[16]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[17]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[18]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Mohammad Shams Esfand Abadi,et al.  Mean-square performance of the family of adaptive filters with selective partial updates , 2008, Signal Process..

[20]  W. F. Schreiber,et al.  Advanced television systems for terrestrial broadcasting: Some problems and some proposed solutions , 1995, Proc. IEEE.

[21]  Peng Shi,et al.  Convergence analysis of sparse LMS algorithms with l1-norm penalty based on white input signal , 2010, Signal Process..

[22]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..