FUZZY QUADRATIC SURFACE SUPPORT VECTOR MACHINE BASED ON FISHER DISCRIMINANT ANALYSIS

In this paper, using the concept of Fisher discriminant analysis and a new fuzzy membership function, a kernel-free fuzzy quadratic surface support vector machine model is proposed for binary classification. The membership function is specially designed to consider not only the ``quadratic-margin distance'' between a training point and its related ``quadratic center surface'' but also the affinity among training points. A decomposition algorithm is designed to solve the proposed model. Computational results on artificial and four real-world classifying data sets indicate that the proposed model outperforms fuzzy support vector machine models with Gaussian or Quadratic kernel and soft quadratic surface support vector machine model, especially, when the data sets contain a large amount of outliers and noises.

[1]  K. Schittkowski.  Optimal parameter selection in support vector machines , 2005 .

[2]  C. Lim,et al.  On regularisation parameter transformation of support vector machines , 2009 .

[3]  Yufeng Liu,et al.  Robust Truncated Hinge Loss Support Vector Machines , 2007 .

[4]  Lijuan Cao,et al.  Application of support vector machines in !nancial time series forecasting , 2001 .

[5]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[6]  Zhang Xiang,et al.  Fuzzy Support Vector Machine Based on Affinity Among Samples , 2006 .

[7]  Mangui Liang,et al.  Fuzzy support vector machine based on within-class scatter for classification problems with outliers or noises , 2013, Neurocomputing.

[8]  Issam Dagher,et al.  Quadratic kernel-free non-linear support vector machine , 2008, J. Glob. Optim..

[9]  M. Yuan,et al.  Reinforced Multicategory Support Vector Machines , 2011 .

[10]  M. Arfan Jaffar,et al.  Wavelets-based facial expression recognition using a bank of support vector machines , 2012, Soft Comput..

[11]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[12]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[13]  Mário A. T. Figueiredo,et al.  Soft clustering using weighted one-class support vector machines , 2009, Pattern Recognit..

[14]  F. Tay,et al.  Application of support vector machines in financial time series forecasting , 2001 .

[15]  Zhang Yi,et al.  Fuzzy SVM with a new fuzzy membership function , 2006, Neural Computing & Applications.

[16]  John E. Lavery,et al.  Comparison of an ℓ1-regression-based and a RANSAC-based planar segmentation procedure for urban terrain data with many outliers , 2013, Remote Sensing.

[17]  Changzhi Wu,et al.  A DC PROGRAMMING APPROACH FOR SENSOR NETWORK LOCALIZATION WITH UNCERTAINTIES IN ANCHOR POSITIONS , 2013 .

[18]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[19]  J. Paul Brooks,et al.  Support Vector Machines with the Ramp Loss and the Hard Margin Loss , 2011, Oper. Res..

[20]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[21]  Guoshan Zhang,et al.  LS-SVM approximate solution for affine nonlinear systems with partially unknown functions , 2013 .

[22]  Le Thi Hoai An,et al.  A continuous approach for the concave cost supply problem via DC programming and DCA , 2008, Discret. Appl. Math..