Fuzzy multi-class classifier based on support vector data description and improved PCM

In this paper, a novel fuzzy classifier for multi-classification problems, based on support vector data description (SVDD) and improved PCM, is proposed. The proposed method is the robust version of SVDD by assigning a weight to each data point, which represents fuzzy membership degree of the cluster computed by the improved PCM method. Accordingly, this paper presents the multi-classification algorithm based on the robust weighted SVDD, and gives the simple classification rule. Experimental results show that the proposed method can reduce the effect of outliers and yield higher classification rate.

[1]  James M. Keller,et al.  The possibilistic C-means algorithm: insights and recommendations , 1996, IEEE Trans. Fuzzy Syst..

[2]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[3]  Leon N. Cooper,et al.  Bayes classification based on minimum bounding spheres , 2007, Neurocomputing.

[4]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[5]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[6]  Yong Zhang,et al.  A novel fuzzy compensation multi-class support vector machine , 2007, Applied Intelligence.

[7]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[8]  Bernhard Schölkopf,et al.  Extracting Support Data for a Given Task , 1995, KDD.

[9]  John Platt,et al.  Large Margin DAG's for Multiclass Classification , 1999 .

[10]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[11]  S. Abe,et al.  Fuzzy support vector machines for pattern classification , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[12]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[13]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[14]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[15]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[16]  Qing Song,et al.  An accelerated decomposition algorithm for robust support vector Machines , 2004, IEEE Transactions on Circuits and Systems II: Express Briefs.

[17]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[18]  Daewon Lee,et al.  Domain described support vector classifier for multi-classification problems , 2007, Pattern Recognit..

[19]  Yue Wang,et al.  Sphere-Structured Support Vector Machines for Multi-class Pattern Recognition , 2003, RSFDGrC.

[20]  Sheng-De Wang,et al.  Training algorithms for fuzzy support vector machines with noisy data , 2003, 2003 IEEE XIII Workshop on Neural Networks for Signal Processing (IEEE Cat. No.03TH8718).

[21]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[22]  Wenjie Hu,et al.  Robust support vector machine with bullet hole image classification , 2002 .