On the optimization properties of the correntropic loss function in data analysis

Similarity measures play a critical role in the solution quality of data analysis methods. Outliers or noise often taint the solution, hence, practical data analysis calls for robust measures. The correntropic loss function is a smooth and robust measure. In this paper, we present the properties of the correntropic loss function that can be utilized in optimization based data analysis methods.

[1]  O. Mangasarian.  PSEUDO-CONVEX FUNCTIONS , 1965 .

[2]  Stan Uryasev,et al.  Risk Tuning With Generalized Linear Regression , 2007, Math. Oper. Res..

[3]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[4]  Jose C. Principe,et al.  Information Theoretic Learning - Renyi's Entropy and Kernel Perspectives , 2010, Information Theoretic Learning.

[5]  José Carlos Príncipe,et al.  Generalized correlation function: definition, properties, and application to blind equalization , 2006, IEEE Transactions on Signal Processing.

[6]  Panos M. Pardalos,et al.  Correntropy in Data Classification , 2012 .

[7]  P. P. Pokharel,et al.  Error Entropy, Correntropy and M-Estimation , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[8]  Adi Ben-Israel,et al.  What is invexity? , 1986, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[9]  Werner A. Stahel,et al.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[10]  P. J. Huber.  Robust Statistical Procedures , 1977 .

[11]  A. Cambini,et al.  Generalized Convexity and Optimization: Theory and Applications , 2008 .

[12]  José Carlos Príncipe,et al.  Using Correntropy as a cost function in linear adaptive filters , 2009, 2009 International Joint Conference on Neural Networks.

[13]  M. A. Hanson.  On sufficiency of the Kuhn-Tucker conditions , 1981 .

[14]  Ran He,et al.  A Regularized Correntropy Framework for Robust Pattern Recognition , 2011, Neural Computation.

[15]  Peter J. Huber,et al.  Robust Statistical Procedures: Second Edition , 1996 .

[16]  Weifeng Liu,et al.  Correntropy: A Localized Similarity Measure , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[17]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[18]  José Carlos Príncipe,et al.  A loss function for classification based on a robust similarity metric , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[19]  O. L. Mangasarian.  Stability Criteria for Nonlinear Ordinary Differential Equations , 1963 .

[20]  A. Cambini,et al.  Generalized Convexity and Optimization , 2009 .

[21]  A. Eddington.  Stellar movements and the structure of the universe , 1914 .

[22]  R. Fisher.  A mathematical Examination of the Methods of determining the Accuracy of Observation by the Mean Error, and by the Mean Square Error , 1920 .

[23]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[24]  Phan Quoc Khanh.  Invex-convexlike functions and duality , 1995 .