Simple changes in problem formulations make a difference in multiobjective genetic fuzzy systems

Recently evolutionary multiobjective optimization (EMO) algorithms have been frequently used for the design of fuzzy rule-based systems. Such a study is often referred to as multiobjective genetic fuzzy systems (MoGFS). Whereas a large number of interesting results on MoGFS have already been reported in the literature, the search ability of EMO algorithms in MoGFS is not necessarily high because fuzzy system design is formulated as large-scale combinatorial optimization problems with many decision variables. In this paper, we show that simple changes in problem formulations of MoGFS often lead to large differences in obtained non-dominated fuzzy rule-based systems. Our idea for improving the search ability of EMO algorithms is to use multiple weighted sums with different weight vectors instead of original objectives. This idea is applicable not only to MoGFS but also to SoGFS (single-objective genetic fuzzy systems). When our idea is used in SoGFS, a two-objective problem is formulated as a weighted sum of an additional term with a small weight and the original objective. We examine the effectiveness of our idea through computational experiments on classification problems. It is clearly shown that simple changes in multiobjective problems in MoGFS often lead to large accuracy improvement.

[1]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[2]  Kazutoshi Sakakibara,et al.  Multi-objective approaches in a single-objective optimization environment , 2005, 2005 IEEE Congress on Evolutionary Computation.

[3]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[4]  Hisao Ishibuchi,et al.  Optimization of Scalarizing Functions Through Evolutionary Multiobjective Optimization , 2007, EMO.

[5]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[6]  Hisao Ishibuchi,et al.  Multiobjective Genetic Fuzzy Systems: Review and Future Research Directions , 2007, 2007 IEEE International Fuzzy Systems Conference.

[7]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[8]  Kim-Fung Man,et al.  Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction , 2005, Fuzzy Sets Syst..

[9]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[10]  Peter J. Fleming,et al.  Design of robust fuzzy-logic control systems by multi-objective evolutionary methods with hardware in the loop , 2004, Eng. Appl. Artif. Intell..

[11]  Francisco Herrera,et al.  Genetic Fuzzy Systems: Status, Critical Considerations and Future Directions , 2005 .

[12]  Marco Cococcioni The Evolutionary Multiobjective Optimization of Fuzzy Rule-Based Systems Bibliography Page , 2009 .

[13]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[14]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[15]  Hyun-Su Kim,et al.  Fuzzy Control of Base‐Isolation System Using Multi‐Objective Genetic Algorithm , 2006, Comput. Aided Civ. Infrastructure Eng..

[16]  Beatrice Lazzerini,et al.  Multi-objective genetic fuzzy classifiers for imbalanced and cost-sensitive datasets , 2010, Soft Comput..

[17]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[18]  Mikkel T. Jensen,et al.  Guiding Single-Objective Optimization Using Multi-objective Methods , 2003, EvoWorkshops.

[19]  Hisao Ishibuchi,et al.  Search ability of evolutionary multiobjective optimization algorithms for multiobjective fuzzy genetics-based machine learning , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[20]  Christian Setzkorn,et al.  On the use of multi-objective evolutionary algorithms for the induction of fuzzy classification rule systems. , 2005, Bio Systems.

[21]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[22]  Liang-Hsuan Chen,et al.  An intelligent control system with a multi-objective self-exploration process , 2004, Fuzzy Sets Syst..

[23]  Hannu Koivisto,et al.  Fuzzy classifier identification using decision tree and multiobjective evolutionary algorithms , 2008, Int. J. Approx. Reason..

[24]  Hisao Ishibuchi,et al.  Selecting linguistic classification rules by two-objective genetic algorithms , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[25]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[26]  Francisco Herrera,et al.  Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systems , 2008, Soft Comput..