Symbiotic Evolution Genetic Algorithms for Reinforcement Fuzzy Systems Design

The advent of fuzzy logic controllers has inspired the allocation of new resources for the possible realization of more efficient methods of control. In comparison with traditional controller design methods requiring mathematical models of the plants, one key advantage of fuzzy controller design lies in its model-free approach. Conventionally, the selection of fuzzy if-then rules often relies heavily upon the substantial amounts of heuristic observation to express the strategy's proper knowledge. It is very difficult for human experts to examine all the input-output data from a complex system, and then to design a number of proper rules for the fuzzy logic controllers. Many design approaches for automatic fuzzy rules generation have been developed in an effort to tackle this problem (Lin & Lee, 1996). The neural learning method is one of them. In (Miller et al., 1990), several neural learning methods including supervised and reinforcement based control configurations are studied. For many control problems, the training data are usually difficult and expensive, if not impossible, to obtain. Besides, many control problems require selecting control actions whose consequences emerge over uncertain periods for which training data are not readily available. In reinforcement learning, agents learn from signals that provide some measure of performance which may be delivered after a sequence of decisions being made. Hence, when the above mentioned control problems occur, reinforcement learning is more appropriate than supervised learning.

[1]  Qiangfu Zhao,et al.  A general framework for cooperative co-evolutionary algorithms: a society model , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[2]  Abdollah Homaifar,et al.  Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[3]  H. Ishibuchi Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[4]  Chia-Feng Juang,et al.  A recurrent self-organizing neural fuzzy inference network , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[5]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[6]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[7]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 1996, Machine Learning.

[8]  Chin-Teng Lin,et al.  Controlling chaos by GA-based reinforcement learning neural network , 1999, IEEE Trans. Neural Networks.

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  L. D. Whitley,et al.  Genetic Reinforcement Learning for Neurocontrol Problems , 2004, Machine Learning.

[11]  Uk-Youl Huh,et al.  Fuzzy model based predictive control , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[12]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[13]  John J. Grefenstette,et al.  Credit assignment in rule discovery systems based on genetic algorithms , 1988, Machine Learning.

[14]  Mahdi Mahfouf,et al.  Rule-base generation via symbiotic evolution for a Mamdani-type fuzzy control system , 2004 .

[15]  Cheng-Jian Lin,et al.  A self-adaptive neural fuzzy network with group-based symbiotic evolution and its prediction applications , 2006, Fuzzy Sets Syst..

[16]  Richard S. Sutton,et al.  Neural networks for control , 1990 .

[17]  Jie Zhang,et al.  Recurrent neuro-fuzzy networks for nonlinear process modeling , 1999, IEEE Trans. Neural Networks.

[18]  Risto Miikkulainen,et al.  Hierarchical evolution of neural networks , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[19]  Chin-Teng Lin,et al.  Genetic Reinforcement Learning through Symbiotic Evolution for Fuzzy Controller Design , 2022 .

[20]  Yoshiki Uchikawa,et al.  An efficient finding of fuzzy rules using a new approach to genetic based machine learning , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[21]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[22]  Moshe Sipper,et al.  Fuzzy CoCo: a cooperative-coevolutionary approach to fuzzy modeling , 2001, IEEE Trans. Fuzzy Syst..

[23]  Hsing-Chia Kuo,et al.  Symbiotic evolution-based design of fuzzy-neural diagnostic system for common acute abdominal pain , 2004, Expert Syst. Appl..

[24]  Chin-Teng Lin,et al.  A GA-based fuzzy adaptive learning control network , 2000, Fuzzy Sets Syst..

[25]  C.W. Anderson,et al.  Learning to control an inverted pendulum using neural networks , 1989, IEEE Control Systems Magazine.

[26]  Khaled Belarbi,et al.  Genetic algorithm for the design of a class of fuzzy controllers: an alternative approach , 2000, IEEE Trans. Fuzzy Syst..

[27]  Chia-Feng Juang Genetic recurrent fuzzy system by coevolutionary computation with divide-and-conquer technique , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  John J. Grefenstette,et al.  A Coevolutionary Approach to Learning Sequential Decision Rules , 1995, ICGA.

[29]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[30]  Jan Paredis,et al.  Coevolutionary Computation , 1995, Artificial Life.

[31]  Derek A. Linkens,et al.  Elicitation and fine-tuning of fuzzy control rules using symbiotic evolution , 2004, Fuzzy Sets Syst..

[32]  Chia-Feng Juang,et al.  Temporal problems solved by dynamic fuzzy network based on genetic algorithm with variable-length chromosomes , 2004, Fuzzy Sets Syst..

[33]  Richard S. Sutton,et al.  Reinforcement Learning , 1992, Handbook of Machine Learning.

[34]  Chih-Hsun Chou Genetic algorithm-based optimal fuzzy controller design in the linguistic space , 2006, IEEE Transactions on Fuzzy Systems.

[35]  Francisco Herrera,et al.  Genetic Fuzzy Systems - Evolutionary Tuning and Learning of Fuzzy Knowledge Bases , 2002, Advances in Fuzzy Systems - Applications and Theory.

[36]  Manuel Valenzuela-Rendón,et al.  The Fuzzy Classifier System: A Classifier System for Continuously Varying Variables , 1991, ICGA.

[37]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[38]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[39]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[40]  L. Darrell Whitley,et al.  Genetic Reinforcement Learning for Neurocontrol Problems , 2004, Machine Learning.

[41]  Russell C. Eberhart,et al.  Implementation of evolutionary fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[42]  Chia-Feng Juang,et al.  Combination of online clustering and Q-value based GA for reinforcement fuzzy system design , 2005, IEEE Trans. Fuzzy Syst..