Relaxed constraints support vector machine

This paper presents a new model of support vector machines (SVMs) that handle data with tolerance and uncertainty. The constraints of the SVM are converted to fuzzy inequality. Giving more relaxation to the constraints allows us to consider an importance degree for each training samples in the constraints of the SVM. The new method is called relaxed constraints support vector machines (RSVMs). Also, the fuzzy SVM model is improved with more relaxed constraints. The new model is called fuzzy RSVM. With this method, we are able to consider importance degree for training samples both in the cost function and constraints of the SVM, simultaneously. In addition, we extend our method to solve one-class classification problems. The effectiveness of the proposed method is demonstrated on artificial and real-life data sets. © 2012 Wiley Periodicals, Inc.

[1]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[2]  Xiaohong Guan,et al.  An SVM-based machine learning method for accurate internet traffic classification , 2010, Inf. Syst. Frontiers.

[3]  Xindong Wu,et al.  Mining With Noise Knowledge: Error-Aware Data Mining , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  H. Yazdi,et al.  A recurrent neural network-based method for training probabilistic Support Vector Machine , 2009 .

[5]  Jean-Paul Jamont,et al.  Flood decision support system on agent grid: method and implementation , 2007, Enterp. Inf. Syst..

[6]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[7]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[8]  Tai-Yue Wang,et al.  Fuzzy support vector machine for multi-class text categorization , 2007, Inf. Process. Manag..

[9]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[10]  Ying Liu,et al.  Cluster-based outlier detection , 2009, Ann. Oper. Res..

[11]  Reshma Khemchandani,et al.  Fuzzy linear proximal support vector machines for multi-category data classification , 2005, Neurocomputing.

[12]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[13]  Lida Xu,et al.  A local-density based spatial clustering algorithm with noise , 2007, Inf. Syst..

[14]  Eric R. Ziegel,et al.  Mastering Data Mining , 2001, Technometrics.

[15]  Sheng-De Wang,et al.  Training algorithms for fuzzy support vector machines with noisy data , 2003, 2003 IEEE XIII Workshop on Neural Networks for Signal Processing (IEEE Cat. No.03TH8718).

[16]  Lian Duan,et al.  A Local Density Based Spatial Clustering Algorithm with Noise , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[17]  Chengdong Wu,et al.  A fuzzy support vector machine based on geometric model , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[18]  Yifei Wang,et al.  A normal least squares support vector machine (NLS-SVM) and its learning algorithm , 2009, Neurocomputing.

[19]  Georg Heigold,et al.  Object classification by fusing SVMs and Gaussian mixtures , 2010, Pattern Recognit..

[20]  Mu-Chen Chen,et al.  The adaptive approach for storage assignment by mining data of warehouse management system for distribution centres , 2011, Enterp. Inf. Syst..

[21]  Maoliu Lin,et al.  Research and application of noise suppression based on support vector machine , 2005, IEEE International Symposium on Communications and Information Technology, 2005. ISCIT 2005..

[22]  Kemal Polat,et al.  A new medical decision making system: Least square support vector machine (LSSVM) with Fuzzy Weighting Pre-processing , 2007, Expert Syst. Appl..

[23]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[24]  George Angelos Papadopoulos,et al.  Please Scroll down for Article Enterprise Information Systems a Survey of Software Adaptation in Mobile and Ubiquitous Computing a Survey of Software Adaptation in Mobile and Ubiquitous Computing , 2022 .

[25]  Kin Keung Lai,et al.  A new fuzzy support vector machine to evaluate credit risk , 2005, IEEE Transactions on Fuzzy Systems.

[26]  Hadi Sadoghi Yazdi,et al.  The probabilistic constraints in the support vector machine , 2007, Appl. Math. Comput..

[27]  Pei-Yi Hao,et al.  New support vector algorithms with parametric insensitive/margin model , 2010, Neural Networks.

[28]  Jian-Ping Sun,et al.  Support Vector Machine for Classification Based on Fuzzy Training Data , 2006 .

[29]  Michael E. Tipping.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[30]  Lida Xu,et al.  An Integrated Approach for Agricultural Ecosystem Management , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  John Durkin,et al.  Expert Systems , 1994 .

[32]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[33]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[34]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[35]  William Nick Street,et al.  Healthcare information systems: data mining methods in the creation of a clinical recommender system , 2011, Enterp. Inf. Syst..

[36]  Jian Zhang,et al.  Nonlinear Noise Filtering with Support Vector Regression , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[37]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .