Inexact graph matching based on kernels for object retrieval in image databases

In the framework of online object retrieval with learning, we address the problem of graph matching using kernel functions. An image is represented by a graph of regions where the edges represent the spatial relationships. Kernels on graphs are built from kernel on walks in the graph. This paper firstly proposes new kernels on graphs and on walks, which are very efficient for graphs of regions. Secondly we propose fast solutions for exact or approximate computation of these kernels. Thirdly we show results for the retrieval of images containing a specific object with the help of very few examples and counter-examples in the framework of an active retrieval scheme.

[1]  Edwin R. Hancock,et al.  Pattern spaces from graph polynomials , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[2]  Kaspar Riesen,et al.  Fast Suboptimal Algorithms for the Computation of Graph Edit Distance , 2006, SSPR/SPR.

[3]  Barbara Caputo,et al.  Recognition with local features: the kernel recipe , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Jean Ponce,et al.  A Tensor-Based Algorithm for High-Order Graph Matching , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  John D. Lafferty,et al.  Diffusion Kernels on Graphs and Other Discrete Input Spaces , 2002, ICML.

[6]  Matthieu Cord,et al.  Precision-Oriented Active Selection for Interactive Image Retrieval , 2006, 2006 International Conference on Image Processing.

[7]  Jean-Philippe Vert,et al.  Graph kernels based on tree patterns for molecules , 2006, Machine Learning.

[8]  Sébastien Sorlin,et al.  Mesurer la similarité de graphes , 2006 .

[9]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[10]  Jun Huan,et al.  GPM: A graph pattern matching kernel with diffusion for chemical compound classification , 2008, 2008 8th IEEE International Conference on BioInformatics and BioEngineering.

[11]  Cordelia Schmid,et al.  A maximum entropy framework for part-based texture and object recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Thomas Gärtner,et al.  On Graph Kernels: Hardness Results and Efficient Alternatives , 2003, COLT.

[13]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[14]  Yixin Chen,et al.  Image Categorization by Learning and Reasoning with Regions , 2004, J. Mach. Learn. Res..

[15]  Neill W Campbell,et al.  IEEE International Conference on Computer Vision and Pattern Recognition , 2008 .

[16]  Kurt Mehlhorn,et al.  Efficient graphlet kernels for large graph comparison , 2009, AISTATS.

[17]  Thomas Gärtner,et al.  A survey of kernels for structured data , 2003, SKDD.

[18]  Arturo Espinosa-Romero,et al.  A robust Graph Transformation Matching for non-rigid registration , 2009, Image Vis. Comput..

[19]  Jean Ponce,et al.  A tensor-based algorithm for high-order graph matching , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Horst Bunke,et al.  Graph matching and similarity , 2000 .

[21]  Hisashi Kashima,et al.  Kernel-based discriminative learning algorithms for labeling sequences, trees, and graphs , 2004, ICML '04.

[22]  Mario Vento,et al.  Thirty Years Of Graph Matching In Pattern Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[23]  Hans-Peter Kriegel,et al.  Protein function prediction via graph kernels , 2005, ISMB.

[24]  Horst Bunke,et al.  Graph Edit Distance with Node Splitting and Merging, and Its Application to Diatom Idenfication , 2003, GbRPR.

[25]  Matthieu Cord,et al.  Kernels on Bags of Fuzzy Regions for Fast Object retrieval , 2007, 2007 IEEE International Conference on Image Processing.

[26]  J Eichhorn,et al.  Object categorization with SVM: kernels for local features , 2004 .

[27]  Elzbieta Pekalska,et al.  Indefinite Kernel Fisher Discriminant , 2008, 2008 19th International Conference on Pattern Recognition.

[28]  Cordelia Schmid,et al.  A maximum entropy framework for combining parts and relations for texture and object recognition , 2005 .

[29]  Alberto Del Bimbo,et al.  Efficient Matching and Indexing of Graph Models in Content-Based Retrieval , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Bernard Haasdonk,et al.  Feature space interpretation of SVMs with indefinite kernels , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  David Haussler,et al.  Convolution kernels on discrete structures , 1999 .

[32]  Douglas R. Heisterkamp,et al.  Learning in Region-Based Image Retrieval with Generalized Support Vector Machines , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[33]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis: List of kernels , 2004 .

[34]  Karsten M. Borgwardt,et al.  Fast subtree kernels on graphs , 2009, NIPS.

[35]  Siwei Lyu,et al.  Mercer kernels for object recognition with local features , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Pierre Baldi,et al.  Graph kernels for chemical informatics , 2005, Neural Networks.

[37]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[38]  F. Suard,et al.  Pedestrian detection using stereo-vision and graph kernels , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[39]  Wolfgang Bibel,et al.  An approach to a systematic theorem proving procedure in first-order logic , 1974, Computing.

[40]  Isabelle Bloch,et al.  Inexact graph matching by means of estimation of distribution algorithms , 2002, Pattern Recognit..

[42]  Mario Vento,et al.  Subgraph Transformations for the Inexact Matching of Attributed Relational Graphs , 1997, GbRPR.

[43]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[44]  Kaspar Riesen,et al.  A family of novel kernel graphs for structural pattern recognition , 2007 .

[45]  Kaspar Riesen,et al.  Bipartite Graph Matching for Computing the Edit Distance of Graphs , 2007, GbRPR.

[46]  Christine Solnon,et al.  Reactive Tabu Search for Measuring Graph Similarity , 2005, GbRPR.

[47]  S. V. N. Vishwanathan,et al.  Graph kernels , 2007 .

[48]  Christine Solnon,et al.  A Comparative Study of Ant Colony Optimization and Reactive Search for Graph Matching Problems , 2006, EvoCOP.

[49]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Anand Rangarajan,et al.  Graph matching by graduated assignment , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[51]  Frédéric Jurie,et al.  Randomized Clustering Forests for Image Classification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  David R. Bull,et al.  Projective image restoration using sparsity regularization , 2013, 2013 IEEE International Conference on Image Processing.