A new rule reduction method for finding interpretable and small rule bases in high dimensional search spaces

In the field of fuzzy modeling, fuzzy control and fuzzy classification, the transparency and comprehensibility of a rule base depends essentially on two aspects: the local relevance of the individual rules and the compactness of the rule base with respect to the number of rules. Additionally, in most applications a certain quality of the input/output behavior has to be achieved. This leads to a multicriteria optimization problem and the global optimum can only be reached for small problem sizes. A possible solution to this problem is a two-step approach. In the first step, a set of relevant rules is incrementally collected. In the second step, the number of relevant rules is reduced to a rule base as small as possible. We present an optimizing conflict reduction, based on a genetic algorithm with bottom-up initialization. The aim is to reach a suitable compromise between the modeling error and the number of rules. Our two-step approach does not aim at locating the global optimum, but at finding a satisfying solution in an acceptable time, even in high dimensional search spaces. In contrast to known approaches, this approach allows rule bases with several ten thousand rules to be handled successfully. The results are illustrated for a benchmark problem and are compared with results of other rule reduction methods.

[1]  H. Ishibuchi,et al.  Multi-objective genetic local search for minimizing the number of fuzzy rules for pattern classification problems , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[2]  Francisco Herrera,et al.  A Three-Stage Method for Designing Genetic Fuzzy Systems by Learning from Examples , 1996, PPSN.

[3]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[4]  Andrea Bonarini,et al.  Evolutionary learning of general fuzzy rules with biased evaluation functions: competition and cooperation , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[5]  Ning Xiong,et al.  Design of flexible structured fuzzy controllers using genetic algorithms , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[6]  O. Nelles,et al.  Fuzzy rule extraction by a genetic algorithm and constrained nonlinear optimization of membership functions , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[7]  A. Krone,et al.  Generating fuzzy rules from contradictory data of different control strategies and control performances , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[8]  A. Krone,et al.  A hybrid evolutionary search concept for data-based generation of relevant fuzzy rules in high dimensional spaces , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[9]  A. Krone,et al.  Data-based generation of fuzzy rules for classification, prediction and control with the Fuzzy-ROSA method , 1999, 1999 European Control Conference (ECC).

[10]  Yaochu Jin,et al.  An approach to rule-based knowledge extraction , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[11]  K. Shida,et al.  A fuzzy self-tuning parallel genetic algorithm for optimization , 1996 .

[12]  Francisco Herrera,et al.  Encouraging Cooperation in the Genetic Iterative Rule Learning Approach for Qualitative Modeling , 1999 .