Inferring descriptive and approximate fuzzy rules for credit scoring using evolutionary algorithms

Generating both accurate as well as explanatory classification rules is becoming increasingly important in a knowledge discovery context. In this paper, we investigate the power and usefulness of fuzzy classification rules for data mining purposes. We propose two evolutionary fuzzy rule learners: an evolution strategy that generates approximate fuzzy rules, whereby each rule has its own specific definition of membership functions, and a genetic algorithm that extracts descriptive fuzzy rules, where all fuzzy rules share a common, linguistically interpretable definition of membership functions in disjunctive normal form. The performance of the evolutionary fuzzy rule learners is compared with that of Nefclass, a neurofuzzy classifier, and a selection of other well-known classification algorithms on a number of publicly available data sets and two real life Benelux financial credit scoring data sets. It is shown that the genetic fuzzy classifiers compare favourably with the other classifiers in terms of classification accuracy. Furthermore, the approximate and descriptive fuzzy rules yield about the same classification accuracy across the different data sets

[1]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[2]  Rudolf Kruse,et al.  How the learning of rule weights affects the interpretability of fuzzy systems , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[3]  Luciano Sánchez,et al.  Using the adabooth algorithm to induce fuzzy rules in classification problems , 2000 .

[4]  Antonio González Muñoz,et al.  Multi-stage genetic fuzzy systems based on the iterative rule learning approach , 1997 .

[5]  H. Ishibuchi Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[6]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[7]  Bart BaesensRudy Using Neural Network Rule Extraction and Decision Tables for Credit-Risk Evaluation , 2003 .

[8]  Nadine N. Tschichold-Gürman,et al.  Generation and improvement of fuzzy classifiers with incremental learning using fuzzy RuleNet , 1995, SAC '95.

[9]  Bart Baesens,et al.  COMPARING A GENETIC FUZZY AND A NEUROFUZZY CLASSIFIER FOR CREDIT SCORING , 2002 .

[10]  D. Fogel Evolutionary algorithms in theory and practice , 1997, Complex..

[11]  Saman K. Halgamuge,et al.  Neural networks in designing fuzzy systems for real world applications , 1994 .

[12]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[13]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[14]  María José del Jesús,et al.  Genetic learning of fuzzy rule-based classification systems cooperating with fuzzy reasoning methods , 1998, Int. J. Intell. Syst..

[15]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[16]  Frank Hoffmann,et al.  Combining boosting and evolutionary algorithms for learning of fuzzy classification rules , 2004, Fuzzy Sets Syst..

[17]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[18]  Luis Magdalena,et al.  Evolutionary-based learning applied to fuzzy controllers , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[19]  Anne Lohrli Chapman and Hall , 1985 .

[20]  Raúl Pérez,et al.  Completeness and consistency conditions for learning fuzzy rules , 1998, Fuzzy Sets Syst..

[21]  Hisao Ishibuchi,et al.  Voting in fuzzy rule-based systems for pattern classification problems , 1999, Fuzzy Sets Syst..

[22]  F. Hoffmann Boosting a genetic fuzzy classifier , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[23]  Johan A. K. Suykens,et al.  Benchmarking state-of-the-art classification algorithms for credit scoring , 2003, J. Oper. Res. Soc..

[24]  Rudolf Kruse,et al.  Recent advances in exploratory data analysis with neuro-fuzzy methods , 2004, Soft Comput..