A GA-based fuzzy modeling approach for generating TSK models

This paper proposes a new genetic-based modeling method for building simple and well-defined TSK models with scatter-type input partitions. Our approach manages all attributes characterizing the structure of a TSK model, simultaneously. Particularly, it determines the number of rules, the input partition, the participating inputs in each rule and the consequent parameters. The model building process is divided into two phases. In phase one, the structure learning task is formulated as a multi-objective optimization problem which is resolved using a novel genetic-based structure learning (GBSL) scheme. Apart from the mean square error (MSE) and the number of rules, three additional criteria are introduced in the fitness function for measuring the quality of the partitions. Optimization of these measures leads to models with representative rules, small overlapping and efficient data cover. In order to obtain models with accurate data fitting and good local performance, the consequent parameters are determined using a local MSE function while the overall model is evaluated on the basis of a global MSE function. The search capabilities of the suggested structure learning scheme are significantly enhanced by including a highly effective local search operator implemented by a micro-genetic algorithm and four problem-specific operators. Finally, a genetic-based parameter learning (GBPL) scheme is suggested in phase two, which performs fine-tuning of the initial models obtained after structure learning. The performance of the proposed modeling approach is evaluated using a static example and a well-known dynamic benchmark problem. Simulation results demonstrate that our models outperform those suggested by other methods with regard to simplicity, model structure, and accuracy.

[1]  Ioannis B. Theocharis,et al.  Microgenetic algorithms as generalized hill-climbing operators for GA optimization , 2001, IEEE Trans. Evol. Comput..

[2]  Mu-Chun Su,et al.  Application of neural networks incorporated with real-valued genetic algorithms in knowledge acquisition , 2000, Fuzzy Sets Syst..

[3]  Francisco Herrera,et al.  A Two-stage Evolutionary Process for Designing Tsk Fuzzy Rule-based Systems a Two-stage Evolutionary Process for Designing Tsk Fuzzy Rule-based Systems , 1996 .

[4]  Germano Lambert-Torres,et al.  A genetic-based neuro-fuzzy approach for modeling and control of dynamical systems , 1998, IEEE Trans. Neural Networks.

[5]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[6]  James Bowen,et al.  Solving small and large scale constraint satisfaction problems using a heuristic-based microgenetic algorithm , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[7]  Philip R. Thrift,et al.  Fuzzy Logic Synthesis with Genetic Algorithms , 1991, ICGA.

[8]  Hisao Ishibuchi,et al.  A multi-objective genetic local search algorithm and its application to flowshop scheduling , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[9]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[10]  Norio Baba,et al.  A new approach for finding the global minimum of error function of neural networks , 1989, Neural Networks.

[11]  Jean-Michel Renders,et al.  Hybridizing genetic algorithms with hill-climbing methods for global optimization: two possible ways , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[12]  Hajime Kita,et al.  Multi-objective optimization by genetic algorithms: a review , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[13]  Abdollah Homaifar,et al.  Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[14]  H. Ishigami,et al.  Structure optimization of fuzzy neural network by genetic algorithm , 1995 .

[15]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[16]  M.A. Lee,et al.  Integrating design stage of fuzzy systems using genetic algorithms , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[17]  Hajime Kita,et al.  Multi-Objective Optimization by Means of the Thermodynamical Genetic Algorithm , 1996, PPSN.

[18]  Kazuo Tanaka,et al.  Successive identification of a fuzzy model and its applications to prediction of a complex system , 1991 .

[19]  John Yen,et al.  Improving the interpretability of TSK fuzzy models by combining global learning and local learning , 1998, IEEE Trans. Fuzzy Syst..

[20]  Euntai Kim,et al.  A new approach to fuzzy modeling , 1997, IEEE Trans. Fuzzy Syst..

[21]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[22]  T. Fukuda,et al.  Self-tuning fuzzy modeling with adaptive membership function, rules, and hierarchical structure based on genetic algorithm , 1995 .

[23]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[24]  Magne Setnes,et al.  GA-fuzzy modeling and classification: complexity and performance , 2000, IEEE Trans. Fuzzy Syst..

[25]  Dimitar Filev,et al.  Unified structure and parameter identification of fuzzy models , 1993, IEEE Trans. Syst. Man Cybern..

[26]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[27]  Liang Wang,et al.  Complex systems modeling via fuzzy logic , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[28]  Vassilios Petridis,et al.  Varying quality function in genetic algorithms and the cutting problem , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[29]  J. Liska,et al.  Complete design of fuzzy logic systems using genetic algorithms , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[30]  Kazuo Tanaka,et al.  Modeling and control of carbon monoxide concentration using a neuro-fuzzy technique , 1995, IEEE Trans. Fuzzy Syst..

[31]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[32]  Chuen-Tsai Sun,et al.  Fuzzy modeling based on generalized neural networks and fuzzy clustering objective functions , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[33]  Reza Langari,et al.  Building Sugeno-type models using fuzzy discretization and orthogonal parameter estimation techniques , 1995, IEEE Trans. Fuzzy Syst..

[34]  Chin-Teng Lin,et al.  A GA-based fuzzy adaptive learning control network , 2000, Fuzzy Sets Syst..

[35]  C. L. Karr,et al.  Fuzzy control of pH using genetic algorithms , 1993, IEEE Trans. Fuzzy Syst..

[36]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[37]  Yoshiki Uchikawa,et al.  On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm , 1992, IEEE Trans. Neural Networks.

[38]  E. H. Mamdani,et al.  Advances in the linguistic synthesis of fuzzy controllers , 1976 .