Fuzzy Rules Extraction from Support Vector Machines for Multi-class Classification with Feature Selection

Although Support Vector Machines (SVMs) have been successfully applied to many problems, they are considered "black box models". Some methods have been developed to reduce this limitation, among them the FREx_SVM, which extracts fuzzy rules from trained SVMs for multi-class problems. This work deals with an extension to the FREx_SVM method, including a wrapper feature subset selection algorithm for SVMs. The method was evaluated in four benchmark databases. Results show that the proposed extension improves the original FREX_SVM, providing better rule coverage and a lower number of rules, which is a considerable gain in terms of interpretability.

[1]  John E. Moody,et al.  Principled Architecture Selection for Neural Networks: Application to Corporate Bond Rating Prediction , 1991, NIPS.

[2]  Rajkumar Roy,et al.  Advances in Soft Computing , 2018, Lecture Notes in Computer Science.

[3]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[4]  Xiuju Fu,et al.  Extracting the knowledge embedded in support vector machines , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[5]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[6]  Harris Drucker,et al.  Support vector machines for spam categorization , 1999, IEEE Trans. Neural Networks.

[7]  Andreu Català,et al.  Rule extraction from support vector machines , 2002, ESANN.

[8]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[9]  Daniel Cremers,et al.  Efficient Feature Subset Selection for Support Vector Machines , 2001 .

[10]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[11]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[12]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[13]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[14]  Pavel Brazdil,et al.  Proceedings of the European Conference on Machine Learning , 1993 .