Convergence Analysis of a Fixed Point Algorithm Under Maximum Complex Correntropy Criterion

With the emergence of complex correntropy, the maximum complex correntropy criterion (MCCC) has been applied to the complex-domain adaptive filtering. The MCCC uses the fixed point method to find the optimal solution, which provides good robustness in the non-Gaussian noise environment, especially for the impulse noise. However, the convergence analysis for the fixed point method is limited to the real-domain filtering. In this letter, we provide the convergence analysis of fixed point based MCCC algorithm in complex-domain filtering. First, by using the matrix inversion lemma, we rewrite the MCCC algorithm to a gradient-like version. In addition, we provide two computationally efficient versions of MCCC. Then, we provide the stability analysis and obtain the excess mean square error for MCCC. Finally, simulation results confirm the correctness of the convergence analysis in this letter.

[1]  Fei Wang,et al.  Kernel adaptive filtering under generalized Maximum Correntropy Criterion , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[2]  Hongbin Zhang,et al.  Kernel Recursive Generalized Maximum Correntropy , 2017, IEEE Signal Processing Letters.

[3]  Jiandong Duan,et al.  Kernel recursive generalized mixed norm algorithm , 2017, J. Frankl. Inst..

[4]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[5]  Azam Khalili,et al.  Steady-State Tracking Analysis of Adaptive Filter With Maximum Correntropy Criterion , 2017, Circuits Syst. Signal Process..

[6]  Liangjun Chen,et al.  Generalized Correntropy based deep learning in presence of non-Gaussian noises , 2018, Neurocomputing.

[7]  Jacob Benesty,et al.  A fast exact least mean square adaptive algorithm , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[8]  José Carlos Príncipe,et al.  A loss function for classification based on a robust similarity metric , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[9]  Xian-Da Zhang,et al.  Matrix Analysis and Applications , 2017 .

[10]  Bo Du,et al.  Robust Graph-Based Semisupervised Learning for Noisy Labeled Data via Maximum Correntropy Criterion , 2019, IEEE Transactions on Cybernetics.

[11]  Shukai Duan,et al.  Quantized kernel maximum correntropy and its mean square convergence analysis , 2017, Digit. Signal Process..

[12]  Yu Zhang,et al.  Convergence of a Fixed-Point Minimum Error Entropy Algorithm , 2015, Entropy.

[13]  Ghosheh Abed Hodtani,et al.  A New Information Theoretic Relation Between Minimum Error Entropy and Maximum Correntropy , 2018, IEEE Signal Processing Letters.

[14]  Badong Chen,et al.  Robust Adaptive Volterra Filter Under Maximum Correntropy Criteria in Impulsive Environments , 2017, Circuits Syst. Signal Process..

[15]  Shiyuan Wang,et al.  Generalized Complex Correntropy: Application to Adaptive Filtering of Complex Data , 2018, IEEE Access.

[16]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[17]  Liu Xi,et al.  Maximum Correntropy Kalman Filter With State Constraints , 2017, IEEE Access.

[18]  D. Mandic,et al.  Complex Valued Nonlinear Adaptive Filters: Noncircularity, Widely Linear and Neural Models , 2009 .

[19]  Wentao Ma,et al.  Maximum correntropy criterion based sparse adaptive filtering algorithms for robust channel estimation under non-Gaussian environments , 2015, J. Frankl. Inst..

[20]  Zongze Wu,et al.  Robust Hammerstein Adaptive Filtering under Maximum Correntropy Criterion , 2015, Entropy.

[21]  Xi Liu,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[22]  João P. F. Guimarães,et al.  Complex Correntropy Function: properties, and application to a channel equalization problem , 2017, Expert Syst. Appl..

[23]  Fei Wang,et al.  Maximum total correntropy adaptive filtering against heavy-tailed noises , 2017, Signal Process..

[24]  Liming Shi,et al.  Convex Combination of Adaptive Filters under the Maximum Correntropy Criterion in Impulsive Interference , 2014, IEEE Signal Processing Letters.

[25]  Nanning Zheng,et al.  Convergence of a Fixed-Point Algorithm under Maximum Correntropy Criterion , 2015, IEEE Signal Processing Letters.

[26]  Yonggang Zhang,et al.  Maximum correntropy unscented Kalman and information filters for non-Gaussian measurement noise , 2017, J. Frankl. Inst..

[27]  Chi K. Tse,et al.  Kernel Adaptive Filters With Feedback Based on Maximum Correntropy , 2018, IEEE Access.

[28]  Nanning Zheng,et al.  Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion , 2014, IEEE Signal Processing Letters.

[29]  Badong Chen,et al.  Kernel adaptive filtering with maximum correntropy criterion , 2011, The 2011 International Joint Conference on Neural Networks.

[30]  José Carlos Príncipe,et al.  Complex Correntropy: Probabilistic Interpretation and Application to Complex-Valued Data , 2017, IEEE Signal Processing Letters.

[31]  José Carlos Príncipe,et al.  Using Correntropy as a cost function in linear adaptive filters , 2009, 2009 International Joint Conference on Neural Networks.

[32]  Bernard C. Picinbono,et al.  On circularity , 1994, IEEE Trans. Signal Process..

[33]  Liang Wang,et al.  Robust Recognition via Information Theoretic Learning , 2014, SpringerBriefs in Computer Science.

[34]  Nanning Zheng,et al.  Generalized Correntropy for Robust Adaptive Filtering , 2015, IEEE Transactions on Signal Processing.

[35]  Paulo S. R. Diniz,et al.  Adaptive Filtering: Algorithms and Practical Implementation , 1997 .

[36]  Xin Wang,et al.  Mixture correntropy for robust learning , 2018, Pattern Recognit..

[37]  Simon Haykin,et al.  Adaptive filter theory (2nd ed.) , 1991 .

[38]  Hua Qu,et al.  Convergence performance analysis of an adaptive kernel width MCC algorithm , 2017 .

[39]  Ghosheh Abed Hodtani,et al.  A new robust fixed-point algorithm and its convergence analysis , 2017 .

[40]  Weifeng Liu,et al.  Correntropy: A Localized Similarity Measure , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[41]  Jiandong Duan,et al.  Robust proportionate adaptive filter based on maximum correntropy criterion for sparse system identification in impulsive noise environments , 2017, Signal, Image and Video Processing.