A Dynamically Constrained Multiobjective Genetic Fuzzy System for Regression Problems

In this paper, a multiobjective genetic fuzzy system (GFS) to learn the granularities of fuzzy partitions, tuning the membership functions (MFs), and learning the fuzzy rules is presented. It uses dynamic constraints, which enable three-parameter MF tuning to improve the accuracy while guaranteeing the transparency of fuzzy partitions. The fuzzy models (FMs) are initialized by a method that combines the benefits of Wang-Mendel (WM) and decision-tree algorithms. Thus, the initial FMs have less rules, rule conditions, and input variables than if WM initialization were to be used. Moreover, the fuzzy partitions of initial FMs are always transparent. Our approach is tested against recent multiobjective and monoobjective GFSs on six benchmark problems. It is concluded that the accuracy and interpretability of our FMs are always comparable or better than those in the comparative studies. Furthermore, on some benchmark problems, our approach clearly outperforms some comparative approaches. Suitability of our approach for higher dimensional problems is shown by studying three benchmark problems that have up to 21 input variables.

[1]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[2]  Hannu Koivisto,et al.  Developing a bioaerosol detector using hybrid genetic fuzzy systems , 2008, Eng. Appl. Artif. Intell..

[3]  Michel Pasquier,et al.  Optimally Evolving Irregular-Shaped Membership Functions for Fuzzy Systems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[4]  J. M. Edmunds,et al.  On fuzzy logic controllers , 1991 .

[5]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[6]  Kim-Fung Man,et al.  Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction , 2005, Fuzzy Sets Syst..

[7]  Beatrice Lazzerini,et al.  Learning concurrently partition granularities and rule bases of Mamdani fuzzy systems in a multi-objective evolutionary framework , 2009, Int. J. Approx. Reason..

[8]  Francisco Herrera,et al.  A Multiobjective Evolutionary Approach to Concurrently Learn Rule and Data Bases of Linguistic Fuzzy-Rule-Based Systems , 2009, IEEE Transactions on Fuzzy Systems.

[9]  Jorge Casillas.  Embedded Genetic Learning of Highly Interpretable Fuzzy Partitions , 2009, IFSA/EUSFLAT Conf..

[10]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[11]  Francisco Herrera,et al.  Rule Base Reduction and Genetic Tuning of Fuzzy Systems Based on the Linguistic 3-tuples Representation , 2006, Soft Comput..

[12]  Y.I. Zhmak,et al.  Fuzzy logic in voltage control , 2004, Proceedings. The 8th Russian-Korean International Symposium on Science and Technology, 2004. KORUS 2004..

[13]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[14]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[15]  Hannu Koivisto,et al.  A Genetic Fuzzy System with Inconsistent Rule Removal and Decision Tree Initialization , 2009 .

[16]  Christian Setzkorn,et al.  On the use of multi-objective evolutionary algorithms for the induction of fuzzy classification rule systems. , 2005, Bio Systems.

[17]  Francisco Herrera,et al.  Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systems , 2008, Soft Comput..

[18]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[19]  Francisco Herrera,et al.  A taxonomy for the crossover operator for real‐coded genetic algorithms: An experimental study , 2003, Int. J. Intell. Syst..

[20]  Chang-Hyun Kim,et al.  Evolving Compact and Interpretable Takagi–Sugeno Fuzzy Models With a New Encoding Scheme , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  G. Ruxton.  The unequal variance t-test is an underused alternative to Student's t-test and the Mann–Whitney U test , 2006 .

[22]  José Valente de Oliveira,et al.  Semantic constraints for membership function optimization , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[23]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[24]  Francisco Herrera,et al.  A Multi-Objective Genetic Algorithm for Tuning and Rule Selection to Obtain Accurate and Compact Linguistic Fuzzy Rule-Based Systems , 2007, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[25]  Uzay Kaymak,et al.  Similarity measures in fuzzy rule base simplification , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[26]  Alessio Botta,et al.  Context adaptation of fuzzy systems through a multi-objective evolutionary approach based on a novel interpretability index , 2008, Soft Comput..

[27]  Beatrice Lazzerini,et al.  A Pareto-based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems , 2007, Soft Comput..

[28]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[29]  DebK.,et al.  A fast and elitist multiobjective genetic algorithm , 2002 .

[30]  Ferenc Szeifert,et al.  Data-driven generation of compact, accurate, and linguistically sound fuzzy classifiers based on a decision-tree initialization , 2003, Int. J. Approx. Reason..

[31]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[32]  Pietari Pulkkinen.  A Multiobjective Genetic Fuzzy System for Obtaining Compact and Accurate Fuzzy Classifiers with Transparent Fuzzy Partitions , 2009, 2009 International Conference on Machine Learning and Applications.

[33]  Francisco Herrera,et al.  Knowledge Base Learning of Linguistic Fuzzy Rule-Based Systems in a Multi-objective Evolutionary Framework , 2008, HAIS.

[34]  Welch Bl.  THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED , 1947 .

[35]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[36]  Jesús Alcalá-Fdez,et al.  A Proposal for the Genetic Lateral Tuning of Linguistic Fuzzy Systems and Its Interaction With Rule Selection , 2007, IEEE Transactions on Fuzzy Systems.

[37]  Hannu Koivisto,et al.  Fuzzy classifier identification using decision tree and multiobjective evolutionary algorithms , 2008, Int. J. Approx. Reason..

[38]  Beatrice Lazzerini,et al.  Learning Concurrently Granularity, Membership Function Parameters and Rules of Mamdani Fuzzy Rule-based Systems , 2009, IFSA/EUSFLAT Conf..