An Explicit Description of the Reproducing Kernel Hilbert Spaces of Gaussian RBF Kernels

Although Gaussian radial basis function (RBF) kernels are one of the most often used kernels in modern machine learning methods such as support vector machines (SVMs), little is known about the structure of their reproducing kernel Hilbert spaces (RKHSs). In this work, two distinct explicit descriptions of the RKHSs corresponding to Gaussian RBF kernels are given and some consequences are discussed. Furthermore, an orthonormal basis for these spaces is presented. Finally, it is discussed how the results can be used for analyzing the learning performance of SVMs

[1]  R. Range Holomorphic Functions and Integral Representations in Several Complex Variables , 1998 .

[2]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[3]  Don R. Hush,et al.  Function Classes That Approximate the Bayes Risk , 2006, COLT.

[4]  S. Smale,et al.  ESTIMATING THE APPROXIMATION ERROR IN LEARNING THEORY , 2003 .

[5]  Jorma Rissanen,et al.  Generalized Kraft Inequality and Arithmetic Coding , 1976, IBM J. Res. Dev..

[6]  E. Hille,et al.  Introduction to general theory of reproducing kernels , 1972 .

[7]  P. Duren Theory of H[p] spaces , 1970 .

[8]  P. Duren Theory of Hp Spaces , 2000 .

[9]  R. G. Cooke Functional Analysis and Semi-Groups , 1949, Nature.

[10]  N. Aronszajn Theory of Reproducing Kernels. , 1950 .

[11]  T. Broadbent Integral Transforms , 1952, Nature.

[12]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[13]  Ingo Steinwart,et al.  Fast Rates for Support Vector Machines , 2005, COLT.

[14]  P. Shields,et al.  Redundancy rates for renewal and other processes , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[15]  Ingo Steinwart,et al.  Fast rates for support vector machines using Gaussian kernels , 2007, 0708.1838.

[16]  Ingo Steinwart,et al.  On the Influence of the Kernel on the Consistency of Support Vector Machines , 2002, J. Mach. Learn. Res..

[17]  Ingo Steinwart,et al.  Consistency of support vector machines and other regularized kernel classifiers , 2005, IEEE Transactions on Information Theory.

[18]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[19]  Herbert Meschkowski,et al.  Hilbertsche Räume mit Kernfunktion , 1962 .

[20]  齋藤 三郎 Integral transforms, reproducing kernels and their applications , 1997 .

[21]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[22]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[23]  Hidehiko Yamabe,et al.  A unique continuation theorem for solutions of a parabolic differential equation , 1958 .

[24]  V. Bargmann On a Hilbert space of analytic functions and an associated integral transform part I , 1961 .

[25]  W. Beckner Inequalities in Fourier analysis , 1975 .

[26]  Jorma Rissanen,et al.  The Minimum Description Length Principle in Coding and Modeling , 1998, IEEE Trans. Inf. Theory.