Training fuzzy support vector machines by using boundary of rough set

Support Vector Machines (SVMs) are statistical learning methods based on two-class problems and exist unclassifiable regions when they are extended to multi-class problems. In order to reduce unclassifiable regions, S. Abe and T. Inoue proposed the improved multi-class SVMs called Fuzzy Support Vector Machines (FSVMs) by which the unclassifiable regions are reduced. In this paper, we train FSVMs by using the training data lying in the boundary of rough set. Firstly, the whole training set is divided into some equivalence classes by transforming all attribute values into discrete ones. Secondly, the lower approximation sets of the training data with the same categories are obtained by the formed equivalence classes. Thirdly, the boundary induced by the whole training set and the lower approximation sets is selected to form FSVMs. The experimental results on classic benchmark data sets show that the proposed learning machines can downsize the number of training data and achieve the higher predictions.

[1]  S. Abe,et al.  Fuzzy support vector machines for pattern classification , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[2]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[3]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[4]  Jinmao Wei,et al.  ROUGH SET BASED APPROACH TO SELECTION OF NODE , 2002 .

[5]  Wanchai Rivepiboon,et al.  Reordering Adaptive Directed Acyclic Graphs for Multiclass Support Vector Machines , 2003, J. Adv. Comput. Intell. Intell. Informatics.

[6]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[7]  Z. Pawlak Drawing conclusions from data—The rough set way , 2001 .