Classification of fuzzy data based on the support vector machines

Data may be afflicted with uncertainty. Uncertain data may be shown by an interval value or in general by a fuzzy set. A number of classification methods have considered uncertainty in features of samples. Some of these classification methods are extended version of the support vector machines (SVMs), such as the Interval-SVM (ISVM), Holder-ISVM and Distance-ISVM, which are used to obtain a classifier for separating samples whose features are interval values. In this paper, we extend the SVM for robust classification of linear/non-linear separable data whose features are fuzzy numbers. The support of such training data is shown by a hypercube. Our proposed method tries to obtain a hyperplane (in the input space or in a high-dimensional feature space) such that the nearest point of the hypercube of each training sample to the hyperplane is separated with the widest symmetric margin. This strategy can reduce the misclassification probability of our proposed method. Our experimental results on six real data sets show that the classification rate of our novel method is better than or equal to the classification rate of the well-known SVM, ISVM, Holder-ISVM and Distance-ISVM for all of these data sets.

[1]  Pei-Yi Hao,et al.  Fuzzy one-class support vector machines , 2008, Fuzzy Sets Syst..

[2]  Ilyes Jenhani,et al.  Decision trees as possibilistic classifiers , 2008, Int. J. Approx. Reason..

[3]  Robert P. W. Duin,et al.  Using two-class classifiers for multiclass classification , 2002, Object recognition supported by user interaction for service robots.

[4]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[5]  Theodore B. Trafalis,et al.  Robust classification and regression using support vector machines , 2006, Eur. J. Oper. Res..

[6]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[7]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[8]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Chin-Teng Lin,et al.  Support-vector-based fuzzy neural network for pattern classification , 2006, IEEE Transactions on Fuzzy Systems.

[11]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[12]  Ai-bing Ji,et al.  Support Vector Machine for Classification Based on Fuzzy Training Data , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[13]  Lipo Wang Support vector machines : theory and applications , 2005 .

[14]  Maria Cruz Gaya,et al.  Merging local patterns using an evolutionary approach , 2011, Knowledge and Information Systems.

[15]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[16]  L. Zadeh Fuzzy sets as a basis for a theory of possibility , 1999 .

[17]  Ming-Hu Ha,et al.  The Fuzzy- Number Based Key Theorem of Statistical Learning Theory , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[18]  G. Bortolan,et al.  A review of some methods for ranking fuzzy subsets , 1985 .

[19]  Paula Brito,et al.  Linear discriminant analysis for interval data , 2006, Comput. Stat..

[20]  Khaled Mellouli,et al.  Naïve possibilistic network classifiers , 2009, Fuzzy Sets Syst..

[21]  Thierry Denoeux,et al.  A k-nearest neighbor classification rule based on Dempster-Shafer theory , 1995, IEEE Trans. Syst. Man Cybern..

[22]  François Poulet,et al.  Kernel-based Algorithms and Visualization for Interval Data Mining , 2006, Sixth IEEE International Conference on Data Mining - Workshops (ICDMW'06).

[23]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[24]  Thierry Denoeux,et al.  ECM: An evidential version of the fuzzy c , 2008, Pattern Recognit..

[25]  Theodore B. Trafalis,et al.  Robust support vector machines for classification and computational issues , 2007, Optim. Methods Softw..

[26]  Yixin Chen,et al.  Support vector learning for fuzzy rule-based classification systems , 2003, IEEE Trans. Fuzzy Syst..

[27]  Shiang-Tai Liu A revisit to quadratic programming with fuzzy parameters , 2009 .

[28]  Francisco de A. T. de Carvalho,et al.  Unsupervised pattern recognition models for mixed feature-type symbolic data , 2010, Pattern Recognit. Lett..

[29]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[30]  P. Nagabhushan,et al.  Multivalued type proximity measure and concept of mutual similarity value useful for clustering symbolic patterns , 2004, Pattern Recognit. Lett..

[31]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.