Support vector classifier based on fuzzy c-means and Mahalanobis distance

This paper presents a fuzzy support vector classifier by integrating modified fuzzy c-means clustering based on Mahalanobis distance into fuzzy support vector data description. The proposed algorithm can be used to deal with the outlier sensitivity problem in traditional multi-class classification problems. The modified fuzzy c-means clustering algorithm based on Mahalanobis distance takes into the samples’ correlation account, and is improved to generate different weight values for main training data points and outliers according to their relative importance in the training data. Experimental results show that the proposed method can reduce the effect of outliers and give high classification accuracy.

[1]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[2]  Qing Song,et al.  An accelerated decomposition algorithm for robust support vector Machines , 2004, IEEE Transactions on Circuits and Systems II: Express Briefs.

[3]  Hideaki Kawano,et al.  Sharpness preserving image enlargement by using self-decomposed codebook and Mahalanobis distance , 2009, Image Vis. Comput..

[4]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[5]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[6]  James C. Bezdek,et al.  A Convergence Theorem for the Fuzzy ISODATA Clustering Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Wenjie Hu,et al.  Robust support vector machine with bullet hole image classification , 2002 .

[8]  Jiawei Han,et al.  Classifying large data sets using SVMs with hierarchical clusters , 2003, KDD '03.

[9]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[10]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[11]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[12]  Yue Wang,et al.  Sphere-Structured Support Vector Machines for Multi-class Pattern Recognition , 2003, RSFDGrC.

[13]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[14]  Yong Zhang,et al.  A novel fuzzy compensation multi-class support vector machine , 2007, Applied Intelligence.

[15]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[16]  Leon N. Cooper,et al.  Bayes classification based on minimum bounding spheres , 2007, Neurocomputing.

[17]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[18]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  S. Abe,et al.  Fuzzy support vector machines for pattern classification , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[20]  John Platt,et al.  Large Margin DAG's for Multiclass Classification , 1999 .

[21]  Daewon Lee,et al.  Domain described support vector classifier for multi-classification problems , 2007, Pattern Recognit..