A Generic Diffusion Kernel for Semi-supervised Learning

In this paper, we present a generic diffusion kernel for graph-based semi-supervised learning, whose kernel matrix is generated with a Taylor expansion on the generating function of diffusion similarity matrix. The generic diffusion kernel subsumes common known diffusion kernels, and provides a kernel framework for semi-supervised learning. Specifically, we first present the definition of diffusion similarity matrix, and lay the theoretical foundation for our approach. Then we derive the 2- and d-diffusion kernels, and naturally extend them to the generic diffusion kernel. Further we prove that small eigenvalues of the generic diffusion kernel correspond to smooth eigenvectors over the graph. This property is critical for the construction of generic diffusion kernels. Experiments on simulated and benchmark databases demonstrate that the generic diffusion kernel is sound and effective.

[1]  Alexander J. Smola,et al.  Kernels and Regularization on Graphs , 2003, COLT.

[2]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[3]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[4]  Bernhard Schölkopf,et al.  Cluster Kernels for Semi-Supervised Learning , 2002, NIPS.

[5]  David Haussler,et al.  Convolution kernels on discrete structures , 1999 .

[6]  Ronald Rosenfeld,et al.  Semi-supervised learning with graphs , 2005 .

[7]  Zoubin Ghahramani,et al.  Nonparametric Transforms of Graph Kernels for Semi-Supervised Learning , 2004, NIPS.

[8]  Bojan Mohar,et al.  Laplace eigenvalues of graphs - a survey , 1992, Discret. Math..

[9]  M. Fiedler A property of eigenvectors of nonnegative symmetric matrices and its application to graph theory , 1975 .

[10]  Zhi-Hua Zhou,et al.  Semi-Supervised Regression with Co-Training , 2005, IJCAI.

[11]  François Fouss,et al.  A novel way of computing similarities between nodes of a graph, with application to collaborative recommendation , 2005, The 2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI'05).

[12]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[13]  Risi Kondor,et al.  Diffusion kernels on graphs and other discrete structures , 2002, ICML 2002.

[14]  John D. Lafferty,et al.  Diffusion Kernels on Graphs and Other Discrete Input Spaces , 2002, ICML.

[15]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.