Genetic programming enabled evolution of control policies for dynamic stochastic optimal power flow

The optimal power flow (OPF) is one of the central optimization problems in power grid engineering, building an essential tool for numerous control as well as planning issues. Methods for solving the OPF that mainly treat steady-state situations have been studied extensively, ignoring uncertainties of system variables as well as their volatile behavior. While both the economical as well as well as technical importance of accurate control is high, especially for power flow control in dynamic and uncertain power systems, methods are needed that provide (near-) optimal actions quickly, eliminating issues on convergence speed or robustness of the optimization. This paper shows an approximate policy-based control approach where optimal actions are derived from policies that are learned offline, but that later provide quick and accurate control actions in volatile situations. These policies are evolved using genetic programming, where multiple and interdependent policies are learned synchronously with simulation-based optimization. Finally, an approach is available for learning fast and robust power flow control policies suitable to highly dynamic power systems such as smart electric grids.

[1]  Philip G. Hill,et al.  Power generation , 1927, Journal of the A.I.E.E..

[2]  R.J. Thomas,et al.  On Computational Issues of Market-Based Optimal Power Flow , 2007, IEEE Transactions on Power Systems.

[3]  J. Momoh Electric Power System Applications of Optimization , 2000 .

[4]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[5]  Paul J. Werbos,et al.  Computational Intelligence for the Smart Grid-History, Challenges, and Opportunities , 2011, IEEE Computational Intelligence Magazine.

[6]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[7]  Stephan M. Winkler,et al.  Genetic Algorithms and Genetic Programming - Modern Concepts and Practical Applications , 2009 .

[8]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[9]  Michael Affenzeller,et al.  Overview: A Simulation Based Metaheuristic Optimization Approach to Optimal Power Dispatch Related to a Smart Electric Grid , 2010, LSMS/ICSEE.

[10]  P. Werbos 1 ADP : Goals , Opportunities and Principles , 2022 .

[11]  Jennie Si,et al.  Toward Dynamic Stochastic Optimal Power Flow , 2004 .

[12]  Michael Affenzeller,et al.  Evolutionary optimization of multi-agent controlstrategies for electric vehicle charging , 2012, GECCO '12.

[13]  Jordan B. Pollack,et al.  A Game-Theoretic Approach to the Simple Coevolutionary Algorithm , 2000, PPSN.

[14]  G. Sheblé,et al.  Power generation operation and control — 2nd edition , 1996 .

[15]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[16]  Warren B. Powell,et al.  Approximate dynamic programming in transportation and logistics: a unified framework , 2012, EURO J. Transp. Logist..

[17]  Natalia Grafeeva,et al.  Genetic algorithms and genetic programming , 2013 .

[18]  Richard K. Belew,et al.  New Methods for Competitive Coevolution , 1997, Evolutionary Computation.

[19]  Michael Affenzeller,et al.  Evolutionary Algorithm Based Control Policies for Flexible Optimal Power Flow over Time , 2013, EvoApplications.

[20]  Michael C. Fu,et al.  Feature Article: Optimization for simulation: Theory vs. Practice , 2002, INFORMS J. Comput..