A hybrid evolutionary learning algorithm for TSK-type fuzzy model design

In this paper, a TSK-type fuzzy model (TFM) with a hybrid evolutionary learning algorithm (HELA) is proposed. The proposed HELA method combines the compact genetic algorithm (CGA) and the modified variable-length genetic algorithm (MVGA). Both the number of fuzzy rules and the adjustable parameters in the TFM are designed concurrently by the HELA method. In the proposed HELA method, individuals of the same length constitute the same group, and there are multiple groups in a population. Moreover, the proposed HELA adopts the compact genetic algorithm (CGA) to carry out the elite-based reproduction strategy. The CGA represents a population as a probability distribution over the set of solutions and is operationally equivalent to the order-one behavior of the simple GA. The evolution processes of a population consist of three major operations: group reproduction using the compact genetic algorithm, variable two-part individual crossover, and variable two-part mutation. Computer simulations have demonstrated that the proposed HELA method gives a better performance than some existing methods.

[1]  Xin Yao,et al.  Evolutionary computation : theory and applications , 1999 .

[2]  Cheng-Jian Lin,et al.  Using context‐sensitive neuro‐fuzzy systems for nonlinear system identification , 2004 .

[3]  Jude W. Shavlik,et al.  Extracting refined rules from knowledge-based neural networks , 2004, Machine Learning.

[4]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[5]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[6]  Khaled Belarbi,et al.  Genetic algorithm for the design of a class of fuzzy controllers: an alternative approach , 2000, IEEE Trans. Fuzzy Syst..

[7]  Reiko Tanese,et al.  Distributed Genetic Algorithms , 1989, ICGA.

[8]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[9]  Zbigniew Michalewicz,et al.  GAVaPS-a genetic algorithm with varying population size , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[10]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[11]  H. Ishibuchi.  Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[12]  Jacek M. Zurada,et al.  Computational Intelligence: Imitating Life , 1994 .

[13]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[14]  Kwang Y. Lee,et al.  Optimization method for reactive power planning by using a modified simple genetic algorithm , 1995 .

[15]  Sigeru Omatu,et al.  Process control by on-line trained neural controllers , 1992, IEEE Trans. Ind. Electron..

[16]  Chin-Teng Lin,et al.  An ART-based fuzzy adaptive learning control network , 1997, IEEE Trans. Fuzzy Syst..

[17]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[18]  Chih-Hong Lin,et al.  Self-constructing fuzzy neural network speed controller for permanent-magnet synchronous motor drive , 2001, IEEE Trans. Fuzzy Syst..

[19]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  W. Pinebrook.  The evolution of strategy. , 1990, Case studies in health administration.

[21]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[22]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 2004 .

[23]  David E. Goldberg,et al.  The compact genetic algorithm , 1999, IEEE Trans. Evol. Comput..

[24]  Lin C‐J,et al.  非線形系同定への文脈‐有感ニューロ‐ファジィシステムの利用 , 2004 .

[25]  David R. Jefferson,et al.  Selection in Massively Parallel Genetic Algorithms , 1991, ICGA.

[26]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 2000, Springer Berlin Heidelberg.

[27]  M.A. Lee,et al.  Integrating design stage of fuzzy systems using genetic algorithms , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[28]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[29]  Sanghamitra Bandyopadhyay,et al.  VGA-Classifier: design and applications , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[30]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[31]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[32]  Mohamad H. Hassoun.  Neural Fuzzy Systems: A Neuro-Fuzzy Synergism to Intelligent Systems [Book review] , 1996, IEEE Transactions on Neural Networks.

[33]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Francisco Herrera,et al.  Genetic Fuzzy Systems - Evolutionary Tuning and Learning of Fuzzy Knowledge Bases , 2002, Advances in Fuzzy Systems - Applications and Theory.

[35]  Abdollah Homaifar,et al.  Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[36]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[37]  H. Takagi,et al.  Integrating Design Stages of Fuzzy Systems using Genetic Algorithms 1 , 1993 .

[38]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[39]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[40]  Chin-Teng Lin,et al.  Genetic Reinforcement Learning through Symbiotic Evolution for Fuzzy Controller Design , 2022 .

[41]  Hideyuki Takagi,et al.  Neural networks designed on approximate reasoning architecture and their applications , 1992, IEEE Trans. Neural Networks.