Effects of fine fuzzy partitions on the generalization ability of evolutionary multi-objective fuzzy rule-based classifiers

Evolutionary multiobjective optimization (EMO) algorithms have often been used to search for a number of non-dominated fuzzy rule-based classifiers with respect to their accuracy and complexity. It is, however, pointed out in some studies that the entire accuracy-complexity tradeoff surface is not always found by well-known and frequently-used EMO algorithms such as NSGA-II. Especially it is very difficult for EMO algorithms to find fuzzy rule-based classifiers with high accuracy around the edge of the tradeoff surface. One simple idea for the design of accurate fuzzy rule-based classifiers is the use of fine fuzzy partitions with a number of small antecedent fuzzy sets. The use of fine fuzzy partitions usually improves the accuracy of fuzzy rule-based classifiers on training data. It may, however, have some side-effects such as the deterioration of classification accuracy on test data and the increase in the search space for fuzzy system design. In this paper, we examine the use of fine fuzzy partitions in the evolutionary multiobjective design of fuzzy rule-based classifiers. Experimental results show that the use of fine fuzzy partitions almost always increases the number of obtained non-dominated fuzzy rule-based classifiers, almost always improve their training data accuracy, and often improve their test data accuracy for some data sets. We also examine the relation between the granularity of fuzzy partitions and the number of antecedent conditions (i.e., rule length).

[1]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[2]  Francisco Herrera,et al.  Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systems , 2008, Soft Comput..

[3]  Beatrice Lazzerini,et al.  Multi-objective genetic fuzzy classifiers for imbalanced and cost-sensitive datasets , 2010, Soft Comput..

[4]  Eghbal G. Mansoori,et al.  SGERD: A Steady-State Genetic Algorithm for Extracting Fuzzy Classification Rules From Data , 2008, IEEE Transactions on Fuzzy Systems.

[5]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[6]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[7]  Hisao Ishibuchi,et al.  Selecting linguistic classification rules by two-objective genetic algorithms , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[8]  Hisao Ishibuchi,et al.  Simple changes in problem formulations make a difference in multiobjective genetic fuzzy systems , 2010, 2010 4th International Workshop on Genetic and Evolutionary Fuzzy Systems (GEFS).

[9]  Hisao Ishibuchi,et al.  Multiobjective Genetic Fuzzy Systems: Review and Future Research Directions , 2007, 2007 IEEE International Fuzzy Systems Conference.

[10]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[11]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[12]  Hyun-Su Kim,et al.  Fuzzy Control of Base‐Isolation System Using Multi‐Objective Genetic Algorithm , 2006, Comput. Aided Civ. Infrastructure Eng..

[13]  Andrzej Jaszkiewicz,et al.  On the computational efficiency of multiple objective metaheuristics. The knapsack problem case study , 2004, Eur. J. Oper. Res..

[14]  Francisco Herrera,et al.  Genetic Fuzzy Systems: Status, Critical Considerations and Future Directions , 2005 .

[15]  Marco Cococcioni The Evolutionary Multiobjective Optimization of Fuzzy Rule-Based Systems Bibliography Page , 2009 .

[16]  Hisao Ishibuchi,et al.  Search ability of evolutionary multiobjective optimization algorithms for multiobjective fuzzy genetics-based machine learning , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[17]  Hisao Ishibuchi,et al.  Optimization of Scalarizing Functions Through Evolutionary Multiobjective Optimization , 2007, EMO.

[18]  Peter J. Fleming,et al.  Design of robust fuzzy-logic control systems by multi-objective evolutionary methods with hardware in the loop , 2004, Eng. Appl. Artif. Intell..

[19]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[20]  Kiyoshi Tanaka,et al.  Controlling Dominance Area of Solutions and Its Impact on the Performance of MOEAs , 2007, EMO.

[21]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[22]  Andrzej Jaszkiewicz,et al.  On the performance of multiple-objective genetic local search on the 0/1 knapsack problem - a comparative experiment , 2002, IEEE Trans. Evol. Comput..

[23]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[24]  Liang-Hsuan Chen,et al.  An intelligent control system with a multi-objective self-exploration process , 2004, Fuzzy Sets Syst..

[25]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .