Comparing Several Evaluation Functions in the Evolutionary Design of Multiclass Support Vector Machines

Support Vector Machines were originally designed to solve two-class classification problems. When they are applied to multiclass classification problems, the original problem is usually decomposed into multiple binary sub- problems. Afterwards, individual classifiers are induced to solve each of these binary problems. To obtain the final multiclass prediction, the outputs of these binary classifiers generated are combined. Genetic Algorithms can be used to optimize the combination of binary classifiers, defining the decomposition according to the performance obtained in the multiclass problem solution. This paper investigates several evaluation functions that can be used in order to evaluate the performance of the decompositions evolved by genetic algorithms.

[1]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Evolutionary design of multiclass support vector machines , 2007, J. Intell. Fuzzy Syst..

[2]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[3]  S. Sathiya Keerthi,et al.  Evaluation of simple performance measures for tuning SVM hyperparameters , 2003, Neurocomputing.

[4]  S. Dudoit,et al.  Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data , 2002 .

[5]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[6]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[7]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[8]  Koby Crammer,et al.  On the Learnability and Design of Output Codes for Multiclass Problems , 2002, Machine Learning.

[9]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[10]  Thorsten Joachims,et al.  The Maximum-Margin Approach to Learning Text Classifiers , 2001, Künstliche Intell..

[11]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[12]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[13]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[14]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[15]  G. Wahba.  Support vector machines, reproducing kernel Hilbert spaces, and randomized GACV , 1999 .

[16]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[17]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[18]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Multiclass SVM Model Selection Using Particle Swarm Optimization , 2006, 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS'06).

[19]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Multiclass SVM Design and Parameter Selection with Genetic Algorithms , 2006, 2006 Ninth Brazilian Symposium on Neural Networks (SBRN'06).