Non-parallel planes support vector machine for multi-class classification

In this paper, we propose a new multi-classification algorithm based on the non-parallel plane support vector machine (SVM). In the approach, data points of each class are proximal to one of nonparallel planes, and at the same time, are far from the other categories to certain extent. This leads to solve convex quadratic optimization problems which the number is the same as the varieties of category. Optimization problem for each is less than the size of the quadratic programming problem of standard SVM. We also induce the kernel method into our algorithm to solve the non-linear problems. Experimental results show that the proposed method which compared to the current multi-classification methods, not only in the overall accuracy rate but also in specific categories of accuracy, plays a good performance.

[1]  Koby Crammer,et al.  On the Learnability and Design of Output Codes for Multiclass Problems , 2002, Machine Learning.

[2]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[3]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[4]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Olvi L. Mangasarian,et al.  Multisurface proximal support vector machine classification via generalized eigenvalues , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[8]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Ulrich H.-G. Kreßel,et al.  Pairwise classification and support vector machines , 1999 .

[10]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[11]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[12]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[13]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[14]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[15]  Isabelle Guyon,et al.  Comparison of classifier methods: a case study in handwritten digit recognition , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[16]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..