Mapping kernels for trees

We propose a comprehensive survey of tree kernels through the lens of the mapping kernels framework. We argue that most existing tree kernels, as well as many more that are presented for the first time in this paper, fall into a typology of kernels whose seemingly intricate computation can be efficiently factorized to yield polynomial time algorithms. Despite this fact, we argue that a naive implementation of such kernels remains prohibitively expensive to compute. We propose an approach whereby some computations for smaller trees are cached, which speeds up considerably the computation of all these tree kernels. We provide experimental evidence of this fact as well as preliminary results on the performance of these kernels.

[1]  Alex Smola,et al.  Kernel methods in machine learning , 2007, math/0701907.

[2]  K. Rieck,et al.  Large Scale Learning with String Kernels , 2006 .

[3]  Eleazar Eskin,et al.  The spectrum kernel , 2002 .

[4]  Bernhard Schölkopf,et al.  Kernel Methods in Computational Biology , 2005 .

[5]  Jason Weston,et al.  Large-Scale Learning with String Kernels , 2007 .

[6]  Tetsuji Kuboyama,et al.  A generalization of Haussler's convolution kernel: mapping kernel , 2008, ICML.

[7]  Hisashi Kashima,et al.  Marginalized Kernels Between Labeled Graphs , 2003, ICML.

[8]  Kiyoko F. Aoki-Kinoshita,et al.  KEGG as a glycome informatics resource. , 2006, Glycobiology.

[9]  Erik D. Demaine,et al.  An optimal decomposition algorithm for tree edit distance , 2006, TALG.

[10]  Michael Collins,et al.  Convolution Kernels for Natural Language , 2001, NIPS.

[11]  David Haussler,et al.  Convolution kernels on discrete structures , 1999 .

[12]  Karsten M. Borgwardt,et al.  Fast subtree kernels on graphs , 2009, NIPS.

[13]  Zaïd Harchaoui,et al.  Image Classification with Segmentation Graph Kernels , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Aron Culotta,et al.  Dependency Tree Kernels for Relation Extraction , 2004, ACL.

[15]  Tetsuji Kuboyama,et al.  A generalization of Haussler's convolution kernel: mapping kernel and its application to tree kernels , 2010 .

[16]  Kuo-Chung Tai,et al.  The Tree-to-Tree Correction Problem , 1979, JACM.

[17]  Jean-Philippe Vert,et al.  Local Alignment Kernels for Biological Sequences , 2004 .

[18]  Eric P. Xing,et al.  Nonextensive Information Theoretic Kernels on Measures , 2009, J. Mach. Learn. Res..