Knowledge-based Support Vector Classification Based on C-SVC

Abstract In many real-world classification problems, we are not only given the traditional training sets, but also provided by some prior information. This paper focuses on the classification problems in such scenario where prior knowledge is available in the form of multiple polyhedral sets. In the traditional knowledge-based support vector machines (KBSVMs) introduced by Mangasarian and his co-workers, prior knowledge was incorporated into 1-norm SVC. However, these methods lost the superiority of the standard SVC (C-SVC) because they are based on 1-norm SVC. In this paper, the new KBSVC based on C-SVC are proposed in an intuitive way. After transforming the prior knowledge into linear constraints of the quadratical programming of C-SVC, we derive two models: the linear and nonlinear KBSVC, which corresponds to the linear and the nonlinear C-SVC respectively. We believe that our new models can preserve the performance of C-SVC.

[1]  Yong Shi,et al.  Structural twin support vector machine for classification , 2013, Knowl. Based Syst..

[2]  Glenn Fung,et al.  Knowledge-Based Support Vector Machine Classifiers , 2002, NIPS.

[3]  Yingjie Tian,et al.  Knowledge-based Support Vector Machine Classifiers via Nearest Points , 2012, ICCS.

[4]  Yong Shi,et al.  Twin support vector machine with Universum data , 2012, Neural Networks.

[5]  Jude W. Shavlik,et al.  Online Knowledge-Based Support Vector Machines , 2010, ECML/PKDD.

[6]  Jude W. Shavlik,et al.  Knowledge-Based Kernel Approximation , 2004, J. Mach. Learn. Res..

[7]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[8]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[9]  Thomas Gärtner,et al.  Simpler knowledge-based support vector machines , 2006, ICML.

[10]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[11]  Yong Shi,et al.  Robust twin support vector machine for pattern classification , 2013, Pattern Recognit..

[12]  Yong Shi,et al.  Laplacian twin support vector machine for semi-supervised classification , 2012, Neural Networks.

[13]  Yong Shi,et al.  Recent advances on support vector machines research , 2012 .

[14]  Olvi L. Mangasarian,et al.  Nonlinear Knowledge-Based Classification , 2008, IEEE Transactions on Neural Networks.

[15]  Ying Jie Tian,et al.  A Novel Knowledge-Based Twin Support Vector Machine , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[16]  C. M. Bishop,et al.  Improvements on Twin Support Vector Machines , 2011 .

[17]  Glenn Fung,et al.  Knowledge-Based Nonlinear Kernel Classifiers , 2003, COLT.

[18]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[19]  Yuh-Jye Lee,et al.  Survival-Time Classification of Breast Cancer Patients , 2003, Comput. Optim. Appl..