Fuzzy support vector machine with a new fuzzy membership function for pattern classification

The traditional support vector machine (SVM) often has an over-fitting problem when outliers exit in the training data set. Fuzzy support vector machine (FSVM) provides an effective approach to deal with the problem. It can reduce the effects of outliers by fuzzy membership functions. Choosing a proper fuzzy membership is very important. In this paper, a new fuzzy membership function is proposed to solving classification problems for FSVM. We define it not only basing on the distance between each data point and the center of class, but also an affinity among samples which can be defined by K nearest neighbor distances. Experimental results show the good performance of the present approach.

[1]  N. Mati,et al.  Discovering Informative Patterns and Data Cleaning , 1996 .

[2]  Wenjie Hu,et al.  Robust support vector machine with bullet hole image classification , 2002 .

[3]  Bernhard Schölkopf,et al.  Support vector learning , 1997 .

[4]  S. Abe,et al.  Fuzzy support vector machines for pattern classification , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[5]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[6]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  H. P. Huang,et al.  Fuzzy Support Vector Machines for Pattern Recognition and Data Mining , 2002 .

[8]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[9]  Ralf Herbrich,et al.  Adaptive margin support vector machines for classification , 1999 .

[10]  Xuegong Zhang,et al.  Using class-center vectors to build support vector machines , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[11]  Christopher J. C. Burges,et al.  Simplified Support Vector Decision Rules , 1996, ICML.

[12]  Alexander J. Smola,et al.  Classification in a normalized feature space using support vector machines , 2003, IEEE Trans. Neural Networks.

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[14]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .