Reinforcement learning tuned decentralized synergetic control of power systems

Abstract In this paper, decentralized synergetic controllers with varying parameters are developed to dampen oscillations in electric power systems via the excitation systems of the generators. Each generator is treated as a subsystem for which a synergetic controller is designed. Each subsystem is a dynamical system driven by a function that estimates the effect of the rest of the system. A particle swarm optimization (PSO) technique is employed to initialize the controllers’ gains. Then, reinforcement learning (RL) is used to vary the gains obtained after implementing the PSO so as to adapt the system to various operating conditions. Simulation results for a two area power system indicate that this technique gives a better performance than synergetic fixed gains controllers, or conventional power system stabilizers. Simulation results are obtained using the power analysis toolbox (PAT).

[1]  Gisbert Schneider,et al.  Optimized Particle Swarm Optimization (OPSO) and its application to artificial neural network training , 2006, BMC Bioinformatics.

[2]  D. Ernst,et al.  Power systems stability control: reinforcement learning framework , 2004, IEEE Transactions on Power Systems.

[3]  Ali Feliachi,et al.  Coordination of synergetic excitation controller and SVC damping controller using particle swarm optimization , 2011, 2011 IEEE Power and Energy Society General Meeting.

[4]  A. Feliachi,et al.  PAT: A Power Analysis Toolbox for MATLAB/Simulink , 2002, IEEE Power Engineering Review.

[5]  A. Feliachi,et al.  Stability enhancement through reinforcement learning: Load frequency control case study , 2007, 2007 iREP Symposium - Bulk Power System Dynamics and Control - VII. Revitalizing Operational Reliability.

[6]  Mevludin Glavic,et al.  Design of a resistive brake controller for power system stability enhancement using reinforcement learning , 2005, IEEE Transactions on Control Systems Technology.

[7]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[8]  William A. Crossley,et al.  Nonlinear Synergetic Optimal Controllers , 2007 .

[9]  Ali Feliachi,et al.  Reinforcement learning based backstepping control of power system oscillations , 2009 .

[10]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[11]  A. Feliachi,et al.  Robust PSS tuning through multiobjective optimization , 2004, IEEE PES Power Systems Conference and Exposition, 2004..

[12]  Mohamed A. El-Sharkawi,et al.  Modern heuristic optimization techniques :: theory and applications to power systems , 2008 .

[13]  Zhenhua Jiang,et al.  Design of a nonlinear power system stabilizer using synergetic control theory , 2009 .

[14]  Ramtin Hadidi,et al.  Reinforcement learning approach for controlling power system stabilizers , 2009, Canadian Journal of Electrical and Computer Engineering.

[15]  I. Kondratiev,et al.  Hierarchical control for electromechanical systems based on synergetic control theory , 2009, 2009 IEEE Control Applications, (CCA) & Intelligent Control, (ISIC).

[16]  Tao Yu,et al.  A reinforcement learning approach to power system stabilizer , 2009, 2009 IEEE Power & Energy Society General Meeting.

[17]  Ali Feliachi,et al.  Decentralized synergetic control of multimachine systems , 2011, 2011 IEEE/PES Power Systems Conference and Exposition.

[18]  P. Kundur,et al.  Power system stability and control , 1994 .