Complex Correntropy: Probabilistic Interpretation and Application to Complex-Valued Data

Recent studies have demonstrated that correntropy is an efficient tool for analyzing higher order statistical moments in non-Gaussian noise environments. Although correntropy has been used with complex data, no theoretical study was pursued to elucidate its properties, nor how to best use it for optimization. By using a probabilistic interpretation, this work presents a novel similarity measure between two complex random variables, which is defined as complex correntropy. A new recursive solution for the maximum complex correntropy criterion is introduced based on a fixed-point solution. This technique is applied to a system identification, and the results demonstrate prominent advantages when compared against three other algorithms: the complex least mean square, complex recursive least squares, and least absolute deviation. By the aforementioned probabilistic interpretation, correntropy can now be applied to solve several problems involving complex data in a more straightforward way.

[1]  A. Neto,et al.  Classification System of Pathological Voices Using Correntropy , 2014 .

[2]  Badong Chen,et al.  An adaptive kernel width update method of correntropy for channel estimation , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[3]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[4]  José Carlos Príncipe,et al.  Using Correntropy as a cost function in linear adaptive filters , 2009, 2009 International Joint Conference on Neural Networks.

[5]  D. Mandic,et al.  Complex Valued Nonlinear Adaptive Filters: Noncircularity, Widely Linear and Neural Models , 2009 .

[6]  Junghui Chen,et al.  Correntropy Kernel Learning for Nonlinear System Identification with Outliers , 2014 .

[7]  Francesco Vicario,et al.  Cardiovascular system identification: Simulation study using arterial and central venous pressures , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Juan José Murillo-Fuentes,et al.  Complex kernels for proper complex-valued signals: A review , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[9]  Tao Liu,et al.  Identification and Autotuning of Temperature-Control System With Application to Injection Molding , 2009, IEEE Transactions on Control Systems Technology.

[10]  Donghua Zhou,et al.  Real-time Reliability Prediction for a Dynamic System Based on the Hidden Degradation Process Identification , 2008, IEEE Transactions on Reliability.

[11]  Sergios Theodoridis,et al.  Ieee Transactions on Signal Processing Extension of Wirtinger's Calculus to Reproducing Kernel Hilbert Spaces and the Complex Kernel Lms , 2022 .

[12]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[13]  Jose C. Principe,et al.  Information Theoretic Learning - Renyi's Entropy and Kernel Perspectives , 2010, Information Theoretic Learning.

[14]  José Carlos Príncipe,et al.  Performance evaluation of the correntropy coefficient in automatic modulation classification , 2015, Expert Syst. Appl..

[15]  Namyong Kim,et al.  Complex-Channel Blind Equalization Using Cross-Correntropy , 2010 .

[16]  Tieniu Tan,et al.  Robust Recovery of Corrupted Low-rank Matrix by Implicit Regularizers. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[17]  Weifeng Liu,et al.  Correntropy: A Localized Similarity Measure , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[18]  José Carlos Príncipe,et al.  Generalized correlation function: definition, properties, and application to blind equalization , 2006, IEEE Transactions on Signal Processing.

[19]  Azam Khalili,et al.  A Robust Adaptive Carrier Frequency Offset Estimation Algorithm for OFDM , 2015 .

[20]  José Carlos Príncipe,et al.  Cyclostationary correntropy: Definition and applications , 2017, Expert Syst. Appl..

[21]  Tieniu Tan,et al.  Robust Recovery of Corrupted Low-RankMatrix by Implicit Regularizers , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Aluisio I. R. Fontes,et al.  Fuzzy Wavelet Neural Network Using a Correntropy Criterion for Nonlinear System Identification , 2015 .

[24]  José Carlos Príncipe,et al.  A closed form recursive solution for Maximum Correntropy training , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[25]  M. Bellanger.  Adaptive filter theory: by Simon Haykin, McMaster University, Hamilton, Ontario L8S 4LB, Canada, in: Prentice-Hall Information and System Sciences Series, published by Prentice-Hall, Englewood Cliffs, NJ 07632, U.S.A., 1986, xvii+590 pp., ISBN 0-13-004052-5 025 , 1987 .

[26]  Danilo P. Mandic,et al.  Complex Valued Nonlinear Adaptive Filters , 2009 .