Use of Pareto-Optimal and Near Pareto-Optimal Candidate Rules in Genetic Fuzzy Rule Selection

Genetic fuzzy rule selection is an effective approach to the design of accurate and interpretable fuzzy rule-based classifiers. It tries to minimize the complexity of fuzzy rule-based classifiers while maximizing their accuracy by selecting only a small number of fuzzy rules from a large number of candidate rules. One important issue in genetic fuzzy rule selection is the prescreening of candidate rules. If we use too many candidate rules, a large computation load is required to search for good rule sets. On the other hand, good rule sets will not be found when promising fuzzy rules are not included in the candidate rule set. It is essential for the success of genetic fuzzy rule selection to use a tractable number of promising fuzzy rules as candidate rules. In this paper, we propose an idea of using Pareto-optimal and near Pareto-optimal fuzzy rules as candidate rules in genetic fuzzy rule selection. Pareto-optimality is defined by two well-known data mining criteria: support and confidence. To extract not only Paretooptimal but also near Pareto-optimal fuzzy rules, we modify Pareto dominance using a dominance margin e . Through computational experiments, we examine the effect of the proposed idea on multiobjective genetic fuzzy rule selection.

[1]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[2]  J. Casillas.  Interpretability issues in fuzzy modeling , 2003 .

[3]  Heikki Mannila,et al.  Fast Discovery of Association Rules , 1996, Advances in Knowledge Discovery and Data Mining.

[4]  Kim-Fung Man,et al.  Agent-based evolutionary approach for interpretable rule-based knowledge extraction , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  V. J. Rayward-Smith,et al.  Data mining rules using multi-objective evolutionary algorithms , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[6]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[7]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[8]  Hisao Ishibuchi,et al.  Classification and modeling with linguistic information granules - advanced approaches to linguistic data mining , 2004, Advanced information processing.

[9]  Mehmet Kaya,et al.  Multi-objective genetic algorithm based approaches for mining optimized fuzzy association rules , 2006, Soft Comput..

[10]  Hisao Ishibuchi,et al.  Relation between Pareto-Optimal Fuzzy Rules and Pareto-Optimal Fuzzy Rule Sets , 2007, 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making.

[11]  Sean Luke,et al.  Lexicographic Parsimony Pressure , 2002, GECCO.

[12]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[13]  Frans Coenen,et al.  Obtaining best parameter values for accurate classification , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[14]  Beatriz de la Iglesia,et al.  Rule Induction Using Multi-Objective Metaheuristics: Encouraging Rule Diversity , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[15]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[16]  Kalyanmoy Deb,et al.  Evaluating the -Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions , 2005, Evolutionary Computation.

[17]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[18]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[19]  F. Herrera,et al.  Accuracy Improvements in Linguistic Fuzzy Modeling , 2003 .

[20]  Kim-Fung Man,et al.  Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction , 2005, Fuzzy Sets Syst..