A New GA-Based Real Time Controller for the Classical Cart-Pole Balancing Problem

This paper introduces a new application of the genetic algorithm for online control application. It acts as a model free optimization technique that belongs to the class of reinforcement learning. Its concepts and structure is first investigated and then the ability of this algorithm is highlighted by an application in a real-time control (pole balancing) problem. The simulation results approves the better the merit of the proposed technique.

[1]  Sam Kwong,et al.  Genetic structure for NN topology and weights optimization , 1995 .

[2]  Delores M. Etter,et al.  A comparison of algorithms for adaptive estimation of the time delay between sampled signals , 1981, ICASSP.

[3]  M. O. Odetayo.  Optimal population size for genetic algorithms: an investigation , 1993 .

[4]  G. Langholz,et al.  Genetic-Based New Fuzzy Reasoning Models with Application to Fuzzy Control , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[5]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.

[6]  Tanja Urbancic,et al.  Genetic algorithms in controller design and tuning , 1993, IEEE Trans. Syst. Man Cybern..

[7]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[8]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[9]  H. Tanaka,et al.  Individual aging in genetic algorithms , 1996, 1996 Australian New Zealand Conference on Intelligent Information Systems. Proceedings. ANZIIS 96.

[10]  Isao Hayashi,et al.  Extended forking genetic algorithm for order representation (o-fGA) , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[11]  Charles L. Karr,et al.  Genetic algorithms for fuzzy controllers , 1991 .

[12]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[13]  Reinhard Männer,et al.  Towards an Optimal Mutation Probability for Genetic Algorithms , 1990, PPSN.

[14]  David B. Fogel,et al.  System Identification Through Simulated Evolution: A Machine Learning Approach to Modeling , 1991 .

[15]  Shigeyoshi Tsutsui,et al.  Phenotypic forking genetic algorithm (p-fGA) , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[16]  Yoshiki Uchikawa,et al.  Single populated genetic algorithm and its application to jobshop scheduling , 1992, Proceedings of the 1992 International Conference on Industrial Electronics, Control, Instrumentation, and Automation.

[17]  Yiu-Tong Chan,et al.  Modeling of time delay and its application to estimation of nonstationary delays , 1981 .

[18]  J.T. Alander,et al.  On optimal population size of genetic algorithms , 1992, CompEuro 1992 Proceedings Computer Systems and Software Engineering.

[19]  Paolo Palazzari,et al.  A new crossover operator for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[20]  Francesco Palmieri,et al.  Theoretical analysis of evolutionary algorithms with an infinite population size in continuous space. Part II: Analysis of the diversification role of crossover , 1994, IEEE Trans. Neural Networks.

[21]  Guy Albert Dumont,et al.  System identification and control using genetic algorithms , 1992, IEEE Trans. Syst. Man Cybern..

[22]  Zbigniew Michalewicz,et al.  GAVaPS-a genetic algorithm with varying population size , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[23]  Donald E. Brown,et al.  Fast generic selection of features for neural network classifiers , 1992, IEEE Trans. Neural Networks.

[24]  David A. Wismer,et al.  Introduction to nonlinear optimization , 1978 .

[25]  Vittorio Maniezzo,et al.  Genetic evolution of the topology and weight distribution of neural networks , 1994, IEEE Trans. Neural Networks.

[26]  Derek A. Linkens,et al.  Genetic algorithms for fuzzy control.1. Offline system development and application , 1995 .

[27]  Cheng-Yan Kao,et al.  Applying the genetic approach to simulated annealing in solving some NP-hard problems , 1993, IEEE Trans. Syst. Man Cybern..

[28]  Liming Qian.  Fuzzy logic control system , 1992 .

[29]  R. Bellman.  Dynamic programming. , 1957, Science.

[30]  Agostinho C. Rosa,et al.  Fitness function design for genetic algorithms in cost evaluation based problems , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[31]  C. S. George Lee,et al.  Reinforcement structure/parameter learning for neural-network-based fuzzy logic control systems , 1994, IEEE Trans. Fuzzy Syst..

[32]  Charles V. Stewart,et al.  Reducing the search time of a steady state genetic algorithm using the immigration operator , 1991, [Proceedings] Third International Conference on Tools for Artificial Intelligence - TAI 91.

[33]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[34]  Yong Gao,et al.  Comments on "Theoretical analysis of evolutionary algorithms with an infinite population size in continuous space. I. Basic properties of selection and mutation" [and reply] , 1998, IEEE Trans. Neural Networks.

[35]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[36]  Z. Michalewicz,et al.  A genetic algorithm for the linear transportation problem , 1991, IEEE Trans. Syst. Man Cybern..

[37]  Surya B. Yadav,et al.  The Development and Evaluation of an Improved Genetic Algorithm Based on Migration and Artificial Selection , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[38]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[39]  V. Richard Benjamins,et al.  Device understanding and modeling for diagnosis , 1991, IEEE Expert.