Tracking Analysis of Minimum Kernel Risk-Sensitive Loss Algorithm Under General Non-Gaussian Noise

In this brief, the steady-state tracking performance of minimum kernel risk-sensitive loss in a non-stationary environment is analyzed. In order to model a non-stationary environment, a first-order random-walk model is used to describe the variations of optimum weight vector over time. Moreover, the measurement noise is considered to have non-Gaussian distribution. The energy conservation relation is utilized to extract an approximate closed-form expression for the steady-state excess mean square error (EMSE). Our analysis shows that unlike for the stationary case, the EMSE curve is not an increasing function of step-size parameter. Hence, the optimum step-size which minimizes the EMSE is derived. We also discuss that our approach can be used to extract steady-state EMSE for a general class of adaptive filters. The simulation results with different noise distributions support the theoretical derivations.

[1]  Nanning Zheng,et al.  Kernel Risk-Sensitive Loss: Definition, Properties and Application to Robust Adaptive Filtering , 2016, IEEE Transactions on Signal Processing.

[2]  Azam Khalili,et al.  Steady-State Tracking Analysis of Adaptive Filter With Maximum Correntropy Criterion , 2017, Circuits Syst. Signal Process..

[3]  José Carlos Príncipe,et al.  An introduction to information theoretic learning , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[4]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[5]  Fei Wang,et al.  Kernel adaptive filtering under generalized Maximum Correntropy Criterion , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[6]  José Carlos Príncipe,et al.  Using Correntropy as a cost function in linear adaptive filters , 2009, 2009 International Joint Conference on Neural Networks.

[7]  W. Marsden I and J , 2012 .

[8]  Panos M. Pardalos,et al.  On the optimization properties of the correntropic loss function in data analysis , 2014, Optim. Lett..

[9]  Ian R. Petersen,et al.  Robustness and risk-sensitive filtering , 2002, IEEE Trans. Autom. Control..

[10]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[11]  Badong Chen,et al.  Robust Constrained Adaptive Filtering Under Minimum Error Entropy Criterion , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[12]  Ali H. Sayed,et al.  A unified approach to the steady-state and tracking analyses of adaptive filters , 2001, IEEE Trans. Signal Process..

[13]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[14]  Wentao Ma,et al.  Bias-compensated normalized maximum correntropy criterion algorithm for system identification with noisy input , 2017, Signal Process..

[15]  Jose C. Principe,et al.  Information Theoretic Learning - Renyi's Entropy and Kernel Perspectives , 2010, Information Theoretic Learning.

[16]  Badong Chen,et al.  Maximum Correntropy Criterion–Based Kernel Adaptive Filters , 2018 .

[17]  Nanning Zheng,et al.  Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion , 2014, IEEE Signal Processing Letters.

[18]  Thomas Bliem Weight Multiplicities for so5(C) , 2008, ITSL.

[19]  Ali H. Sayed,et al.  Adaptive Filters , 2008 .

[20]  Magno T. M. Silva,et al.  Improving the Tracking Capability of Adaptive Filters via Convex Combination , 2008, IEEE Transactions on Signal Processing.

[21]  J.C. Principe,et al.  From linear adaptive filtering to nonlinear information processing - The design and analysis of information processing systems , 2006, IEEE Signal Processing Magazine.

[22]  Badong Chen,et al.  Constrained maximum correntropy adaptive filtering , 2016, Signal Process..