Robust Normalized Least Mean Absolute Third Algorithms

This paper addresses the stability issues of the least mean absolute third (LMAT) algorithm using the normalization based on the third order in the estimation error. A novel robust normalized least mean absolute third (RNLMAT) algorithm is therefore proposed to be stable for all statistics of the input, noise, and initial weights. For further improving the filtering performance of RNLMAT in different noises and initial conditions, the variable step-size RNLMAT (VSSRNLMAT) and the switching RNLMAT (SWRNLMAT) algorithms are proposed using the statistics of the estimation error and a switching method, respectively. The filtering performance of RNLMAT is improved by VSSRNLMAT and SWRNLMAT at the expense of affordable computational cost. RNLMAT with less computational complexity than other normalized adaptive filtering algorithms, can provide better filtering accuracy and robustness against impulsive noises. The steady-state performance of RNLMAT and SWRNLMAT in terms of the excess mean-square error is performed for theoretical analysis. Simulations conducted in system identification under different noise environments confirm the theoretical results and the superiorities of the proposed algorithms from the aspects of filtering accuracy and robustness against large outliers.

[1]  José Carlos M. Bermudez,et al.  A Mean-Square Stability Analysis of the Least Mean Fourth Adaptive Algorithm , 2007, IEEE Transactions on Signal Processing.

[2]  Shiyuan Wang,et al.  Robust least mean logarithmic square adaptive filtering algorithms , 2019, J. Frankl. Inst..

[3]  Zhi Li,et al.  Nonparametric Variable Step-Size LMAT Algorithm , 2017, Circuits Syst. Signal Process..

[4]  Tareq Y. Al-Naffouri,et al.  Convergence and tracking analysis of a variable normalised LMF (XE-NLMF) algorithm , 2009, Signal Process..

[5]  Wei Xing Zheng,et al.  A Family of Robust M-Shaped Error Weighted Least Mean Square Algorithms: Performance Analysis and Echo Cancellation Application , 2017, IEEE Access.

[6]  Sung Ho Cho,et al.  Performance of least mean absolute third (LMAT) adaptive algorithm in various noise environments , 1998 .

[7]  Eweda Eweda,et al.  Global Stabilization of the Least Mean Fourth Algorithm , 2012, IEEE Transactions on Signal Processing.

[8]  José Carlos M. Bermudez,et al.  Probability of divergence for the least-mean fourth algorithm , 2006, IEEE Transactions on Signal Processing.

[9]  Yi Yu,et al.  A new normalized LMAT algorithm and its performance analysis , 2014, Signal Process..

[10]  Badong Chen,et al.  Improved-Variable-Forgetting-Factor Recursive Algorithm Based on the Logarithmic Cost for Volterra System Identification , 2016, IEEE Transactions on Circuits and Systems II: Express Briefs.

[11]  Sung Ho Cho,et al.  Statistical convergence of the adaptive least mean fourth algorithm , 1996, Proceedings of Third International Conference on Signal Processing (ICSP'96).

[12]  Paul Petrus,et al.  Robust Huber adaptive filter , 1999, IEEE Trans. Signal Process..

[13]  Tareq Y. Al-Naffouri,et al.  Adaptive Filters with Error Nonlinearities: Mean-Square Analysis and Optimum Design , 2001, EURASIP J. Adv. Signal Process..

[14]  Shiyuan Wang,et al.  Generalized Complex Correntropy: Application to Adaptive Filtering of Complex Data , 2018, IEEE Access.

[15]  Zhi Li,et al.  Optimal step size of least mean absolute third algorithm , 2017, Signal Image Video Process..

[16]  Junghsi Lee,et al.  A New Variable Step-Size NLMS Algorithm and Its Performance Analysis , 2012, IEEE Transactions on Signal Processing.

[17]  Eweda Eweda,et al.  Mean-Square Stability Analysis of a Normalized Least Mean Fourth Algorithm for a Markov Plant , 2014, IEEE Transactions on Signal Processing.

[18]  José Carlos M. Bermudez,et al.  New results on the stability analysis of the LMF (least mean fourth) adaptive algorithm , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[19]  Liu Xi,et al.  Maximum Correntropy Kalman Filter With State Constraints , 2017, IEEE Access.

[20]  Eweda Eweda,et al.  Stabilization of High-Order Stochastic Gradient Adaptive Filtering Algorithms , 2017, IEEE Transactions on Signal Processing.

[21]  Nanning Zheng,et al.  Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion , 2014, IEEE Signal Processing Letters.

[22]  Azzedine Zerguine,et al.  A normalized least mean fourth algorithm with improved stability , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[23]  Azzedine Zerguine Convergence and steady-state analysis of the normalized least mean fourth algorithm , 2007, Digit. Signal Process..

[24]  Tania Stathaki,et al.  A normalized robust mixed-norm adaptive algorithm for system identification , 2004, IEEE Signal Processing Letters.

[25]  Bo Ai,et al.  Variable step-size MLMS algorithm for digital predistortion in wideband OFDM systems , 2015, IEEE Transactions on Consumer Electronics.

[26]  Binwei Weng,et al.  Nonlinear system identification in impulsive environments , 2005, IEEE Transactions on Signal Processing.

[27]  Arie Feuer,et al.  Convergence and performance analysis of the normalized LMS algorithm with uncorrelated Gaussian data , 1988, IEEE Trans. Inf. Theory.

[28]  Bernard Widrow,et al.  The least mean fourth (LMF) adaptive algorithm and its family , 1984, IEEE Trans. Inf. Theory.

[29]  Nanning Zheng,et al.  Generalized Correntropy for Robust Adaptive Filtering , 2015, IEEE Transactions on Signal Processing.

[30]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[31]  Colin Cowan,et al.  Using a normalised LMF algorithm for channel equalisation with co-channel interference , 2002, 2002 11th European Signal Processing Conference.

[32]  Jiandong Duan,et al.  General Mixed-Norm-Based Diffusion Adaptive Filtering Algorithm for Distributed Estimation Over Network , 2017, IEEE Access.

[33]  Eweda Eweda,et al.  A Stable Normalized Least Mean Fourth Algorithm With Improved Transient and Tracking Behaviors , 2016, IEEE Transactions on Signal Processing.

[34]  A. Zerguine Convergence behavior of the normalized least mean fourth algorithm , 2000, Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers (Cat. No.00CH37154).

[35]  José Carlos M. Bermudez,et al.  An improved statistical analysis of the least mean fourth (LMF) adaptive algorithm , 2003, IEEE Trans. Signal Process..

[36]  J. Chambers,et al.  A robust mixed-norm adaptive filter algorithm , 1997, IEEE Signal Processing Letters.

[37]  Sung Ho Cho,et al.  Adaptive filters based on the high order error statistics , 1996, Proceedings of APCCAS'96 - Asia Pacific Conference on Circuits and Systems.

[38]  Suleyman Serdar Kozat,et al.  A Novel Family of Adaptive Filtering Algorithms Based on the Logarithmic Cost , 2013, IEEE Transactions on Signal Processing.

[39]  Sheng Zhang,et al.  Maximum Versoria Criterion-Based Robust Adaptive Filtering Algorithm , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[40]  Azzedine Zerguine,et al.  New insights into the normalization of the least mean fourth algorithm , 2013, Signal Image Video Process..

[41]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[42]  Eweda Eweda,et al.  Stochastic Analysis of a Stable Normalized Least Mean Fourth Algorithm for Adaptive Noise Canceling With a White Gaussian Reference , 2012, IEEE Transactions on Signal Processing.