Selecting Structural Base Classifiers for Graph-Based Multiple Classifier Systems

Selecting a set of good and diverse base classifiers is essential for building multiple classifier systems. However, almost all commonly used procedures for selecting such base classifiers cannot be directly applied to select structural base classifiers. The main reason is that structural data cannot be represented in a vector space. For graph-based multiple classifier systems, only using subgraphs for building structural base classifiers has been considered so far. However, in theory, a full graph preserves more information than its subgraphs. Therefore, in this work, we propose a different procedure which can transform a labelled graph into a new set of unlabelled graphs and preserve all the linkages at the same time. By embedding the label information into edges, we can further ignore the labels. By assigning weights to the edges according to the labels of their linked nodes, the strengths of the connections are altered, but the topology of the graph as a whole is preserved. Since it is very difficult to embed graphs into a vector space, graphs are usually classified based on pairwise graph distances. We adopt the dissimilarity representation and build the structural base classifiers based on labels in the dissimilarity space. By combining these structural base classifiers, we can solve the labelled graph classification problem with a multiple classifier system. The performance of using the subgraphs and full graphs to build multiple classifier systems is compared in a number of experiments.

[1]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[2]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Robert P. W. Duin,et al.  Bagging and Boosting for the Nearest Mean Classifier: Effects of Sample Size on Diversity and Accuracy , 2002, Multiple Classifier Systems.

[4]  Jiří Matas,et al.  Computer Vision - ECCV 2004 , 2004, Lecture Notes in Computer Science.

[5]  Edwin R. Hancock,et al.  Spectral Simplification of Graphs , 2004, ECCV.

[6]  Abraham Kandel,et al.  Building Graph-Based Classifier Ensembles by Random Node Selection , 2004, Multiple Classifier Systems.

[7]  Horst Bunke,et al.  Graph Matching - Challenges and Potential Solutions , 2005, ICIAP.

[8]  Fabio Roli,et al.  Image Analysis and Processing - ICIAP 2005, 13th International Conference, Cagliari, Italy, September 6-8, 2005, Proceedings , 2005, ICIAP.

[9]  Horst Bunke,et al.  Edit distance-based kernel functions for structural pattern classification , 2006, Pattern Recognit..

[10]  Kaspar Riesen,et al.  Classifier Ensembles for Vector Space Embedding of Graphs , 2007, MCS.

[11]  Kaspar Riesen,et al.  Graph Classification Based on Dissimilarity Space Embedding , 2008, SSPR/SPR.

[12]  Wan-Jui Lee,et al.  An Inexact Graph Comparison Approach in Joint Eigenspace , 2008, SSPR/SPR.

[13]  Kaspar Riesen,et al.  IAM Graph Database Repository for Graph Based Pattern Recognition and Machine Learning , 2008, SSPR/SPR.

[14]  R. Duin,et al.  The dissimilarity representation for pattern recognition , a tutorial , 2009 .

[15]  Wan-Jui Lee,et al.  A Labelled Graph Based Multiple Classifier System , 2009, MCS.

[16]  Edwin R. Hancock,et al.  Structural, Syntactic, and Statistical Pattern Recognition, Joint IAPR International Workshop, SSPR&SPR 2010, Cesme, Izmir, Turkey, August 18-20, 2010. Proceedings , 2010, SSPR/SPR.

[17]  Adam Weintrit,et al.  Methods and Algorithms , 2011 .