A closed form recursive solution for Maximum Correntropy training

This paper presents a closed form recursive solution for training adaptive filters using the Maximum Correntropy Criterion (MCC). Correntropy has been recently proposed as a robust similarity measure between two random variables or signals, when the pdfs involved are heavy tailed and non-Gaussian. Maximizing the cross-correntropy between the output of an adaptive filter and the desired response leads to the Maximum Correntropy Criterion for adaptive systems training. We show that a closed form, recursive solution of the filter weights using this criterion yields a simple weighted least squares like formulation. Our simulations show that training the filter weights using this recursive solution is much faster than gradient based training, and more accurate than the RLS algorithm in cases where the error pdf is non-Gaussian and heavy tailed.

[1]  A. Granas,et al.  Fixed Point Theory , 2003 .

[2]  Bernard Widrow,et al.  The least mean fourth (LMF) adaptive algorithm and its family , 1984, IEEE Trans. Inf. Theory.

[3]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[4]  K. Deimling Fixed Point Theory , 2008 .

[5]  José Carlos Príncipe,et al.  Generalized correlation function: definition, properties, and application to blind equalization , 2006, IEEE Transactions on Signal Processing.

[6]  Allan Kardec Barros,et al.  Using non-linear even functions for error minimization in adaptive filters , 2006, Neurocomputing.

[7]  J. Hale,et al.  Ordinary Differential Equations , 2019, Fundamentals of Numerical Mathematics for Physicists and Engineers.

[8]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[9]  P. P. Pokharel,et al.  Error Entropy, Correntropy and M-Estimation , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[10]  José Carlos Príncipe,et al.  Using Correntropy as a cost function in linear adaptive filters , 2009, 2009 International Joint Conference on Neural Networks.

[11]  P. Hartman Ordinary Differential Equations , 1965 .

[12]  N. G. Parke,et al.  Ordinary Differential Equations. , 1958 .

[13]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .