Kernel recursive generalized mixed norm algorithm

Abstract This work studies the problem of kernel adaptive filtering (KAF) for nonlinear signal processing under non-Gaussian noise environments. A new KAF algorithm, called kernel recursive generalized mixed norm (KRGMN), is derived by minimizing the generalized mixed norm (GMN) cost instead of the well-known mean square error (MSE). A single error norm such as lp error norm can be used as a cost function in KAF to deal with non-Gaussian noises but it may exhibit slow convergence speed and poor misadjustments in some situations. To improve the convergence performance, the GMN cost is formed as a convex mixture of lp and lq norms to increase the convergence rate and substantially reduce the steady-state errors. The proposed KRGMN algorithm can solve efficiently the problems such as nonlinear channel equalization and system identification in non-Gaussian noises. Simulation results confirm the desirable performance of the new algorithm.

[1]  Zongze Wu,et al.  Kernel recursive maximum correntropy , 2015, Signal Process..

[2]  Shiyuan Wang,et al.  Regularized Kernel Least Mean Square Algorithm with Multiple-delay Feedback , 2016, IEEE Signal Processing Letters.

[3]  Badong Chen,et al.  Self-organizing kernel adaptive filtering , 2016, EURASIP J. Adv. Signal Process..

[4]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[5]  Xinge You,et al.  Kernel normalized mixed-norm algorithm for system identification , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[6]  Wentao Ma,et al.  Sparse least mean p-power algorithms for channel estimation in the presence of impulsive noise , 2016, Signal Image Video Process..

[7]  Weifeng Liu,et al.  An Information Theoretic Approach of Designing Sparse Kernel Adaptive Filters , 2009, IEEE Transactions on Neural Networks.

[8]  Xianzhong Xie,et al.  Combination of affine projection sign algorithms for robust adaptive filtering in non-gaussian impulsive interference , 2014 .

[9]  Sheng Zhang,et al.  Fast stable normalised least-mean fourth algorithm , 2015 .

[10]  Chien-Cheng Tseng,et al.  Least mean p-power error criterion for adaptive FIR filter , 1994, IEEE J. Sel. Areas Commun..

[11]  Weifeng Liu,et al.  The Kernel Least-Mean-Square Algorithm , 2008, IEEE Transactions on Signal Processing.

[12]  Badong Chen,et al.  Quantized Kernel Least Mean Square Algorithm , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Nanning Zheng,et al.  Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion , 2014, IEEE Signal Processing Letters.

[14]  J. Chambers,et al.  A robust mixed-norm adaptive filter algorithm , 1997, IEEE Signal Processing Letters.

[15]  Binwei Weng,et al.  Nonlinear system identification in impulsive environments , 2005, IEEE Transactions on Signal Processing.

[16]  Nanning Zheng,et al.  Generalized Correntropy for Robust Adaptive Filtering , 2015, IEEE Transactions on Signal Processing.

[17]  Xiong Luo,et al.  A novel entropy optimized kernel least-mean mixed-norm algorithm , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[18]  Weifeng Liu,et al.  Kernel Adaptive Filtering: A Comprehensive Introduction , 2010 .

[19]  Konstantinos Pelekanakis,et al.  Adaptive Sparse Channel Estimation under Symmetric alpha-Stable Noise , 2014, IEEE Transactions on Wireless Communications.

[20]  J. Chambers,et al.  Convergence and steady-state properties of the least-mean mixed-norm (LMMN) adaptive algorithm , 1996 .

[21]  A. Constantinides,et al.  Least mean mixed-norm adaptive filtering , 1994 .

[22]  Badong Chen,et al.  Kernel Least Mean Kurtosis Based Online Chaotic Time Series Prediction , 2013 .

[23]  Jiandong Duan,et al.  Diffusion maximum correntropy criterion algorithms for robust distributed estimation , 2015, Digit. Signal Process..

[24]  Badong Chen,et al.  A FIXED-BUDGET QUANTIZED KERNEL LEAST MEAN SQUARE ALGORITHM , 2012 .

[25]  Bernard Widrow,et al.  The least mean fourth (LMF) adaptive algorithm and its family , 1984, IEEE Trans. Inf. Theory.

[26]  Jin Liu,et al.  Kernel robust mixed-norm adaptive filtering , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[27]  Weifeng Liu,et al.  Kernel least mean square algorithm with constrained growth , 2009, Signal Process..

[28]  C. K. Michael Tse,et al.  Kernel Least Mean Square with Single Feedback , 2015, IEEE Signal Processing Letters.

[29]  Vojislav Z. Filipovic,et al.  Consistency of the robust recursive Hammerstein model identification algorithm , 2015, J. Frankl. Inst..

[30]  Weifeng Liu,et al.  Extended Kernel Recursive Least Squares Algorithm , 2009, IEEE Transactions on Signal Processing.

[31]  Feng Ding,et al.  The recursive least squares identification algorithm for a class of Wiener nonlinear systems , 2016, J. Frankl. Inst..

[32]  Fuxi Wen,et al.  Diffusion Least Mean P-Power Algorithms for Distributed Estimation in Alpha-Stable Noise Environments , 2013, ArXiv.

[33]  Wentao Ma,et al.  Maximum correntropy criterion based sparse adaptive filtering algorithms for robust channel estimation under non-Gaussian environments , 2015, J. Frankl. Inst..

[34]  Wentao Ma,et al.  Robust kernel adaptive filters based on mean p-power error for noisy chaotic time series prediction , 2017, Eng. Appl. Artif. Intell..

[35]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[36]  Nanning Zheng,et al.  Kernel minimum error entropy algorithm , 2013, Neurocomputing.

[37]  Badong Chen,et al.  Quantized Kernel Recursive Least Squares Algorithm , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Shukai Duan,et al.  Quantized kernel maximum correntropy and its mean square convergence analysis , 2017, Digit. Signal Process..

[39]  Azzedine Zerguine,et al.  The leaky least mean mixed norm algorithm , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[40]  Tania Stathaki,et al.  A normalized robust mixed-norm adaptive algorithm for system identification , 2004, IEEE Signal Processing Letters.

[41]  Nanning Zheng,et al.  Kernel least mean square with adaptive kernel size , 2014, Neurocomputing.

[42]  Badong Chen,et al.  Quantised kernel least mean square with desired signal smoothing , 2015 .

[43]  Jiandong Duan,et al.  General Mixed-Norm-Based Diffusion Adaptive Filtering Algorithm for Distributed Estimation Over Network , 2017, IEEE Access.

[44]  Eweda Eweda,et al.  A Stable Normalized Least Mean Fourth Algorithm With Improved Transient and Tracking Behaviors , 2016, IEEE Transactions on Signal Processing.

[45]  C. L. Philip Chen,et al.  Generalized Kernel Normalized Mixed-Norm Algorithm: Analysis and Simulations , 2015, ICONIP.

[46]  Feng Ding,et al.  Recursive and iterative least squares parameter estimation algorithms for observability canonical state space systems , 2015, J. Frankl. Inst..