Mean square cross error: performance analysis and applications in non-Gaussian signal processing

Most of the cost functions of adaptive filtering algorithms include the square error, which depends on the current error signal. When the additive noise is impulsive, we can expect that the square error will be very large. By contrast, the cross error, which is the correlation of the error signal and its delay, may be very small. Based on this fact, we propose a new cost function called the mean square cross error for adaptive filters, and provide the mean value and mean square performance analysis in detail. Furthermore, we present a two-stage method to estimate the closed-form solutions for the proposed method, and generalize the two-stage method to estimate the closed-form solution of the information theoretic learning methods, including least mean fourth, maximum correntropy criterion, generalized maximum correntropy criterion, and minimum kernel risk-sensitive loss. The simulations of the adaptive solutions and closed-form solution show the effectivity of the new method.

[1]  Ali H. Sayed,et al.  Adaptive Networks , 2014, Proceedings of the IEEE.

[2]  José Carlos Príncipe,et al.  Using Correntropy as a cost function in linear adaptive filters , 2009, 2009 International Joint Conference on Neural Networks.

[3]  C. K. Michael Tse,et al.  A class of improved least sum of exponentials algorithms , 2016, Signal Process..

[4]  José Carlos Príncipe,et al.  Complex Correntropy: Probabilistic Interpretation and Application to Complex-Valued Data , 2017, IEEE Signal Processing Letters.

[5]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[6]  Badong Chen,et al.  Risk-sensitive loss in kernel space for robust adaptive filtering , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[7]  Gang Wang,et al.  Extraction of Desired Signal Based on AR Model with Its Application to Atrial Activity Estimation in Atrial Fibrillation , 2008, EURASIP J. Adv. Signal Process..

[8]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[9]  Aapo Hyvärinen,et al.  Sparse Code Shrinkage: Denoising of Nongaussian Data by Maximum Likelihood Estimation , 1999, Neural Computation.

[10]  A. Hyvarinen Blind source separation by nonstationarity of variance: a cumulant-based approach. , 2001, IEEE transactions on neural networks.

[11]  Jiandong Duan,et al.  Diffusion maximum correntropy criterion algorithms for robust distributed estimation , 2015, Digit. Signal Process..

[12]  Yiguang Liu,et al.  Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Nanning Zheng,et al.  Generalized Correntropy for Robust Adaptive Filtering , 2015, IEEE Transactions on Signal Processing.

[14]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[15]  Tülay Adali,et al.  Complex-Valued Linear and Widely Linear Filtering Using MSE and Gaussian Entropy , 2012, IEEE Transactions on Signal Processing.

[16]  José Carlos M. Bermudez,et al.  An improved statistical analysis of the least mean fourth (LMF) adaptive algorithm , 2003, IEEE Trans. Signal Process..

[17]  José Carlos Príncipe,et al.  Performance evaluation of the correntropy coefficient in automatic modulation classification , 2015, Expert Syst. Appl..

[18]  Bernard Widrow,et al.  The least mean fourth (LMF) adaptive algorithm and its family , 1984, IEEE Trans. Inf. Theory.

[19]  Nanning Zheng,et al.  Kernel Risk-Sensitive Loss: Definition, Properties and Application to Robust Adaptive Filtering , 2016, IEEE Transactions on Signal Processing.

[20]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Wenyuan Wang,et al.  Performance analysis of diffusion least mean fourth algorithm over network , 2017, Signal Process..

[22]  José Carlos M. Bermudez,et al.  Stochastic analysis of the Least Mean Kurtosis algorithm for Gaussian inputs , 2016, Digit. Signal Process..

[23]  Eweda Eweda,et al.  Dependence of the Stability of the Least Mean Fourth Algorithm on Target Weights Non-Stationarity , 2014, IEEE Transactions on Signal Processing.

[24]  Tülay Adali,et al.  Optimization and Estimation of Complex-Valued Signals: Theory and applications in filtering and blind source separation , 2014, IEEE Signal Processing Magazine.

[25]  Eweda Eweda,et al.  Mean-Square Stability Analysis of a Normalized Least Mean Fourth Algorithm for a Markov Plant , 2014, IEEE Transactions on Signal Processing.

[26]  Eweda Eweda,et al.  Global Stabilization of the Least Mean Fourth Algorithm , 2012, IEEE Transactions on Signal Processing.

[27]  Gang Wang,et al.  Noise Estimation Using Mean Square Cross Prediction Error for Speech Enhancement , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[28]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[29]  Ali H. Sayed,et al.  Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks , 2011, IEEE Transactions on Signal Processing.

[30]  Gang Wang,et al.  A Framework of Target Detection in Hyperspectral Imagery Based on Blind Source Extraction , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.