Diffusion Kernels on Graphs and Other Discrete Input Spaces

The application of kernel-based learning algorithms has, so far, largely been confined to realvalued data and a few special data types, such as strings. In this paper we propose a general method of constructing natural families of kernels over discrete structures, based on the matrix exponentiation idea. In particular, we focus on generating kernels on graphs, for which we propose a special class of exponential kernels called diffusion kernels, which are based on the heat equation and can be regarded as the discretization of the familiar Gaussian kernel of Euclidean space.

[1]  I. J. Schoenberg.  Metric spaces and completely monotone functions , 1938 .

[2]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[3]  W. Feller,et al.  An Introduction to Probability Theory and Its Applications. Vol. 1, Second Edition. , 1958 .

[4]  W. Feller,et al.  An Introduction to Probability Theory and Its Applications, Vol. II , 1972, The Mathematical Gazette.

[5]  C. Berg,et al.  Harmonic Analysis on Semigroups: Theory of Positive Definite and Related Functions , 1984 .

[6]  Yoav Freund,et al.  Large Margin Classification Using the Perceptron Algorithm , 1998, COLT' 98.

[7]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[8]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[9]  J. C. BurgesChristopher.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998 .

[10]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[11]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[12]  Shing-Tung Yau,et al.  Coverings, Heat Kernels and Spanning Trees , 1998, Electron. J. Comb..

[13]  David Haussler,et al.  Convolution kernels on discrete structures , 1999 .

[14]  C. Watkins.  Dynamic Alignment Kernels , 1999 .

[15]  Bernhard Schölkopf,et al.  Dynamic Alignment Kernels , 2000 .

[16]  Tommi S. Jaakkola,et al.  Partially labeled classification with Markov random walks , 2001, NIPS.

[17]  L. Saul,et al.  An Introduction to Locally Linear Embedding , 2001 .

[18]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[19]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.