Diffusion kernels on graphs and other discrete structures

The application of kernel-based learning algorithms has, so far, largely been confined to realvalued data and a few special data types, such as strings. In this paper we propose a general method of constructing natural families of kernels over discrete structures, based on the matrix exponentiation idea. In particular, we focus on generating kernels on graphs, for which we propose a special class of exponential kernels, based on the heat equation, called diffusion kernels, and show that these can be regarded as the discretization of the familiar Gaussian kernel of Euclidean space.

[1]  I. J. Schoenberg Metric spaces and completely monotone functions , 1938 .

[2]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[3]  W. Feller,et al.  An Introduction to Probability Theory and Its Applications. Vol. 1, Second Edition. , 1958 .

[4]  W. Feller,et al.  An Introduction to Probability Theory and Its Applications, Vol. II , 1972, The Mathematical Gazette.

[5]  C. Berg,et al.  Harmonic Analysis on Semigroups: Theory of Positive Definite and Related Functions , 1984 .

[6]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[7]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[8]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[9]  J. C. BurgesChristopher A Tutorial on Support Vector Machines for Pattern Recognition , 1998 .

[10]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[11]  Yoav Freund,et al.  Large Margin Classification Using the Perceptron Algorithm , 1998, COLT.

[12]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[13]  Shing-Tung Yau,et al.  Coverings, Heat Kernels and Spanning Trees , 1998, Electron. J. Comb..

[14]  David Haussler,et al.  Convolution kernels on discrete structures , 1999 .

[15]  C. Watkins Dynamic Alignment Kernels , 1999 .

[16]  Bernhard Schölkopf,et al.  Dynamic Alignment Kernels , 2000 .

[17]  Tommi S. Jaakkola,et al.  Partially labeled classification with Markov random walks , 2001, NIPS.

[18]  L. Saul,et al.  An Introduction to Locally Linear Embedding , 2001 .

[19]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[20]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.