A New Multi-class Support Vector Machine with Multi-sphere in the Feature Space

Support vector machine (SVM) is a very promising classification technique developed by Vapnik. However, there are still some shortcomings in the original SVM approach. First, SVM was originally designed for binary classification. How to extend it effectively for multiclass classification is still an on-going research issue. Second, SVM does not consider the distribution of each class. In this paper, we propose an extension to the SVM method of pattern recognition for solving the multi-class problem in one formal step. Contrast to previous multi-class SVMs, our approach considers the distribution of each class. Experimental results show that the proposed method is more suitable for practical use than other multi-class SVMs, especially for unbalanced datasets.

[1]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[2]  Yue Wang,et al.  Sphere-Structured Support Vector Machines for Multi-class Pattern Recognition , 2003, RSFDGrC.

[3]  J. Chiang,et al.  A new kernel-based fuzzy clustering approach: support vector clustering with cell growing , 2003, IEEE Trans. Fuzzy Syst..

[5]  Isabelle Guyon,et al.  Comparison of classifier methods: a case study in handwritten digit recognition , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[6]  Ulrich H.-G. Kreßel,et al.  Pairwise classification and support vector machines , 1999 .

[7]  John Platt,et al.  Large Margin DAG's for Multiclass Classification , 1999 .

[8]  Qing Wu,et al.  Classifying the multiplicity of the EEG source models using sphere-shaped support vector Machines , 2005 .

[9]  Leon N. Cooper,et al.  Pattern Classification via Single Spheres , 2005, Discovery Science.

[10]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[11]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[12]  Malik Yousef,et al.  One-Class SVMs for Document Classification , 2002, J. Mach. Learn. Res..

[13]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[14]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[17]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[18]  Koby Crammer,et al.  On the Learnability and Design of Output Codes for Multiclass Problems , 2002, Machine Learning.