Dual margin approach on a Lagrangian support vector machine

In this paper, we propose a new support vector machine (SVM) called dual margin Lagrangian support vectors machine (DMLSVM). Unlike other SVMs which use only support vectors to determine the separating hyperplanes, DMLSVM utilizes all the available training data for training the classifier, thus producing robust performance. The training data are weighted differently depending on whether they are in a marginal region or surplus region. For fast training, DMLSVM borrows its training algorithm from Lagrangian SVM (LSVM) and tailors the algorithm to its formulation. The convergence of our training method is rigorously proven and its validity is tested on a synthetic test set and UCI dataset. The proposed method can be used in a variety of applications such as a recommender systems for web contents of IPTV services.

[1]  O. Mangasarian,et al.  Massive data discrimination via linear support vector machines , 2000 .

[2]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[3]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[4]  David R. Musicant,et al.  Lagrangian Support Vector Machines , 2001, J. Mach. Learn. Res..

[5]  Constantin Zopounidis,et al.  Additive Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Koby Crammer,et al.  Robust Support Vector Machine Training via Convex Outlier Ablation , 2006, AAAI.

[7]  Min Yoon,et al.  A role of total margin in support vector machines , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[8]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[9]  Vladimir Cherkassky,et al.  Learning from Data: Concepts, Theory, and Methods , 1998 .

[10]  David G. Stork,et al.  Pattern Classification , 1973 .

[11]  Li Zhang,et al.  Wavelet support vector machine , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[13]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[14]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[15]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[16]  J. Suykens,et al.  Recurrent least squares support vector machines , 2000 .

[17]  Wenjie Hu,et al.  Robust support vector machine with bullet hole image classification , 2002 .

[18]  Chia-Feng Juang,et al.  Fuzzy System Learned Through Fuzzy Clustering and Support Vector Machine for Human Skin Color Segmentation , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[19]  Ethem Alpaydin,et al.  Multiclass Posterior Probability Support Vector Machines , 2008, IEEE Transactions on Neural Networks.

[20]  Shigeo Abe,et al.  Fuzzy least squares support vector machines for multiclass problems , 2003, Neural Networks.

[21]  Shu-Xin Du,et al.  Weighted support vector machine for classification , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[22]  Xiuwen Liu,et al.  Face detection using spectral histograms and SVMs , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .