Evolving Neuro-Controllers for a Dynamic System Using Structured Genetic Algorithms

This paper describes the application of the Structured Genetic Algorithm (sGA) to design neuro-controllers for an unstable physical system. In particular, the approach uses a single unified genetic process to automatically evolve complete neural nets (both architectures and their weights) for controlling a simulated pole-cart system. Experimental results demonstrate the effectiveness of the sGA-evolved neuro-controllers for the task—to keep the pole upright (within a specified vertical angle) and the cart within the limits of the given track.

[1]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[2]  M. O. Odetayo,et al.  Adaptive control of a dynamic system using genetic-based methods , 1992, Proceedings of the 1992 IEEE International Symposium on Intelligent Control.

[3]  D. Dasgupta,et al.  A MORE BIOLOGICALLY MOTIVATED GENETIC ALGORITHM: THE MODEL AND SOME RESULTS , 1994 .

[4]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[5]  A. Makarovic.  A qualitative way of solving the pole balancing problem , 1991 .

[6]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Claude Sammut,et al.  Experimental Results from an Evaluation of Algorithms that Learn to Control Dynamic Systems , 1988, ML.

[8]  Darrell Whitley,et al.  Optimizing small neural networks using a distributed genetic algorithm , 1990 .

[9]  Michael O. Odetayo,et al.  Genetic Algorithm for Inducing Control Rules for a Dynamic System , 1989, International Conference on Genetic Algorithms.

[10]  D. R. McGregor,et al.  Designing application-specific neural networks using the structured genetic algorithm , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[11]  Dipankar Dasgupta,et al.  Evolving Neuroeontrollers for Pole Balancing , 1993 .

[12]  Dirk Thierens,et al.  A Topology Exploiting Genetic Algorithm to Control Dynamic Systems , 1990, PPSN.

[13]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.

[14]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[15]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[16]  Tariq Samad,et al.  Designing Application-Specific Neural Networks Using the Genetic Algorithm , 1989, NIPS.

[17]  D. R. McGregor,et al.  Genetically designing neuro-controllers for a dynamic system , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[18]  Darrell Whitley,et al.  Genetic cascade learning for neural networks , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[19]  H. Kitano.  Neurogenetic learning: an integrated method of designing and training neural networks using genetic algorithms , 1994 .

[20]  B. Zhang,et al.  A neural-net approach to supervised learning of pole balancing , 1989, Proceedings. IEEE International Symposium on Intelligent Control 1989.

[21]  L. Darrell Whitley,et al.  Genetic Reinforcement Learning with Multilayer Neural Networks , 1991, ICGA.

[22]  Charles W. Anderson,et al.  Strategy Learning with Multilayer Connectionist Representations , 1987 .

[23]  John R. Koza,et al.  Genetic generation of both the weights and architecture for a neural network , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.