Evolving Compact and Interpretable Takagi–Sugeno Fuzzy Models With a New Encoding Scheme

Developing Takagi-Sugeno fuzzy models by evolutionary algorithms mainly requires three factors: an encoding scheme, an evaluation method, and appropriate evolutionary operations. At the same time, these three factors should be designed so that they can consider three important aspects of fuzzy modeling: modeling accuracy, compactness, and interpretability. This paper proposes a new evolutionary algorithm that fulfills such requirements and solves fuzzy modeling problems. Two major ideas proposed in this paper lie in a new encoding scheme and a new fitness function, respectively. The proposed encoding scheme consists of three chromosomes, one of which uses unique chained possibilistic representation of rule structure. The proposed encoding scheme can achieve simultaneous optimization of parameters of antecedent membership functions and rule structures with the new fitness function developed in this paper. The proposed fitness function consists of five functions that consider three evaluation criteria in fuzzy modeling problems. The proposed fitness function guides evolutionary search direction so that the proposed algorithm can find more accurate compact fuzzy models with interpretable antecedent membership functions. Several evolutionary operators that are appropriate for the proposed encoding scheme are carefully designed. Simulation results on three modeling problems show that the proposed encoding scheme and the proposed fitness functions are effective in finding accurate, compact, and interpretable Takagi-Sugeno fuzzy models. From the simulation results, it is shown that the proposed algorithm can successfully find fuzzy models that approximate the given unknown function accurately with a compact number of fuzzy rules and membership functions. At the same time, the fuzzy models use interpretable antecedent membership functions, which are helpful in understanding the underlying behavior of the obtained fuzzy models

[1]  John Yen,et al.  Application of statistical information criteria for optimal fuzzy model construction , 1998, IEEE Trans. Fuzzy Syst..

[2]  Chang-Hyun Kim,et al.  Structure/Parameter Optimization of Fuzzy Models by Evolutionary Algorithm , 2003 .

[3]  Witold Pedrycz Identification in fuzzy systems , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Abdollah Homaifar,et al.  Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[5]  Ju-Jang Lee,et al.  Evolutionary Optimization of Membership Functions in Fuzzy Logic System Using Newly Defined Fitness Function for Classification and Nonlinear Time-Series Prediction , 2002 .

[6]  J. Casillas Interpretability issues in fuzzy modeling , 2003 .

[7]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Fernando José Von Zuben,et al.  Multi-objective decision making: towards improvement of accuracy, interpretability and design autonomy in hierarchical genetic fuzzy systems , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[9]  Charles L. Karr,et al.  Adaptive process control using fuzzy logic and genetic algorithms , 1993 .

[10]  Lawrence W. Lan,et al.  Genetic fuzzy logic controller: an iterative evolution algorithm with new encoding method , 2005, Fuzzy Sets Syst..

[11]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[12]  Shinn-Jang Ho,et al.  Design of accurate classifiers with a compact fuzzy-rule base using an evolutionary scatter partition of feature space , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[13]  Fernando Gomide,et al.  Hierarchical Genetic Fuzzy Systems: Accuracy, Interpretability and Design Autonomy , 2003 .

[14]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[15]  W. E. Thompson,et al.  Design of intelligent fuzzy logic controllers using genetic algorithms , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[16]  Ahmad Lotfi,et al.  Interpretation preservation of adaptive fuzzy inference systems , 1996, Int. J. Approx. Reason..

[17]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[18]  C. L. Karr,et al.  Fuzzy control of pH using genetic algorithms , 1993, IEEE Trans. Fuzzy Syst..

[19]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[20]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[21]  Chang-Hyun Kim,et al.  Building a Fuzzy Model with Transparent Membership Functions through Constrained Evolutionary Optimization , 2004 .

[22]  John Yen,et al.  Simplifying fuzzy rule-based models using orthogonal transformation methods , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[23]  Hisao Ishibuchi,et al.  Multiobjective Optimization in Linguistic Rule Extraction from Numerical Data , 2001, EMO.

[24]  Ferenc Szeifert,et al.  Fuzzy modeling with multivariate membership functions: gray-box identification and control design , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[25]  C. J. Kim,et al.  An algorithmic approach for fuzzy inference , 1997, IEEE Trans. Fuzzy Syst..

[26]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[27]  Kazuo Tanaka,et al.  Successive identification of a fuzzy model and its applications to prediction of a complex system , 1991 .

[28]  Marco Russo,et al.  Genetic fuzzy learning , 2000, IEEE Trans. Evol. Comput..

[29]  Philip R. Thrift,et al.  Fuzzy Logic Synthesis with Genetic Algorithms , 1991, ICGA.

[30]  F. Gomide,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[31]  Kim-Fung Man,et al.  Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction , 2005, Fuzzy Sets Syst..

[32]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[33]  Russell C. Eberhart,et al.  Implementation of evolutionary fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[34]  Uzay Kaymak,et al.  Similarity measures in fuzzy rule base simplification , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[35]  Héctor Pomares,et al.  A systematic approach to a self-generating fuzzy rule-table for function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[36]  Bernhard Sendhoff,et al.  On generating FC3 fuzzy rule systems from data using evolution strategies , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[37]  Francisco Herrera,et al.  A CLASSIFIED REVIEW ON THE COMBINATION FUZZY LOGIC–GENETIC ALGORITHMS BIBLIOGRAPHY: 1989–1995 , 1997 .

[38]  James E. Andrews,et al.  Combinatorial rule explosion eliminated by a fuzzy rule configuration , 1998, IEEE Trans. Fuzzy Syst..

[39]  Hisao Ishibuchi,et al.  Interpretability Issues in Fuzzy Genetics-Based Machine Learning for Linguistic Modelling , 2003, Modelling with Words.

[40]  Chang-Hyun Kim,et al.  Evolutionary Optimization of Fuzzy Models with Asymmetric RBF Membership Functions Using Simplified Fitness Farrugia , 2003, IFSA.

[41]  Serge Guillaume,et al.  Designing fuzzy inference systems from data: An interpretability-oriented review , 2001, IEEE Trans. Fuzzy Syst..

[42]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..

[43]  Yaochu Jin,et al.  Advanced fuzzy systems design and applications , 2003, Studies in Fuzziness and Soft Computing.

[44]  María José del Jesús,et al.  Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction , 2005, IEEE Transactions on Fuzzy Systems.

[45]  Shyh Hwang,et al.  An identification algorithm in fuzzy relational systems , 1996, Soft Computing in Intelligent Systems and Information Processing. Proceedings of the 1996 Asian Fuzzy Systems Symposium.

[46]  Magne Setnes,et al.  GA-fuzzy modeling and classification: complexity and performance , 2000, IEEE Trans. Fuzzy Syst..

[47]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.