A Reinforcement Learning Automata Optimization Approach for Optimum Tuning of PID Controller in AVR System

In this paper, an efficient optimization method based on reinforcement learning automata (RLA) for optimum parameters setting of conventional proportional-integral-derivative (PID) controller for AVR system of power synchronous generator is proposed. The proposed method is Continuous Action Reinforcement Learning Automata (CARLA) which is able to explore and learn to improve control performance without the knowledge of the analytical system model. This paper demonstrates the full details of the CARLA technique and compares its performance with Particle Swarm Optimization (PSO) and Genetic Algorithms (GA) as two famous evolutionary optimization methods. The simulation results show the superior efficiency and performance of the proposed method in regard to other ones.

[1]  S. Omatu,et al.  Tuning of the PID control gains by GA , 1996, Proceedings 1996 IEEE Conference on Emerging Technologies and Factory Automation. ETFA '96.

[2]  Timothy Gordon,et al.  Continuous action reinforcement learning applied to vehicle suspension control , 1997 .

[3]  Matt C. Best,et al.  On-line PID tuning for engine idle-speed control using continuous action reinforcement learning automata , 2000 .

[4]  Zwe-Lee Gaing.  A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004, IEEE Transactions on Energy Conversion.

[5]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[6]  Fang Sheng,et al.  Genetic algorithm and simulated annealing for optimal robot arm PID control , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[7]  S. Dormido,et al.  Between fuzzy-PID and PID-conventional controllers: a good choice , 1996, Proceedings of North American Fuzzy Information Processing.

[8]  Hadi Saadat,et al.  Power System Analysis , 1998 .

[9]  A. H. Jones,et al.  Genetic auto-tuning of PID controllers , 1995 .

[10]  Yoshikazu Fukuyama,et al.  A particle swarm optimization for reactive power and voltage control considering voltage security assessment , 2000 .

[11]  Takanori Tagami,et al.  A real coded genetic algorithm for matrix inequality design approach of robust PID controller with two degrees of freedom , 1997, Proceedings of 12th IEEE International Symposium on Intelligent Control.

[12]  Renato A. Krohling,et al.  Designing PI/PID controllers for a motion control system based on genetic algorithms , 1997, Proceedings of 12th IEEE International Symposium on Intelligent Control.

[13]  Marzuki Khalid,et al.  Tuning of a neuro-fuzzy controller by genetic algorithm , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[14]  A. Visioli.  Tuning of PID controllers with fuzzy logic , 2001 .

[15]  J. G. Ziegler,et al.  Optimum Settings for Automatic Controllers , 1942, Journal of Fluids Engineering.

[16]  Timothy Gordon,et al.  Continuous action reinforcement learning automata and their application to adaptive digital filter design , 2001 .