Novel Kernels and Kernel PCA for Pattern Recognition

Kernel methods are a mathematical tool that provides a generally higher dimensional representation of given data set in feature space for feature recognition and image analysis problems. Typically, the kernel trick is thought of as a method for converting a linear classification learning algorithm into non-linear one, by mapping the original observations into a higher-dimensional non-linear space so that linear classification in the new space is equivalent to non-linear classification in the original space. Moreover, optimal kernels can be designed to capture the natural variation present in the data. In this paper we present the performance results of fifteen novel kernel functions and their respective performance for kernel principal component analysis on five select databases. Empirical results show that our kernels perform as well and better than existing kernels on these databases.

[1]  E. Crow,et al.  Lognormal Distributions: Theory and Applications , 1987 .

[2]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[3]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[4]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[5]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[6]  日野 寛三,et al.  対数正規分布(Lognormal Distribution)のあてはめについて , 1994 .

[7]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[9]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[10]  Horst Stöcker,et al.  Thermodynamics and Statistical Mechanics , 2002 .

[11]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[12]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[13]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[14]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[15]  Paul Horton,et al.  Better Prediction of Protein Cellular Localization Sites with the it k Nearest Neighbors Classifier , 1997, ISMB.