DeepOPF: A Feasibility-Optimized Deep Neural Network Approach for AC Optimal Power Flow Problems

The AC-OPF problem is the key and challenging problem in the power system operation. When solving the AC-OPF problem, the feasibility issue is critical. In this paper, we develop an efficient Deep Neural Network (DNN) approach, DeepOPF, to ensure the feasibility of the generated solution. The idea is to train a DNN model to predict a set of independent operating variables, and then to directly compute the remaining dependable variables by solving the AC power flow equations. While this guarantees the power-flow balances, the principal difficulty lies in ensuring that the obtained solutions satisfy the operation limits of generations, voltages, and branch flow. We tackle this hurdle by employing a penalty approach in training the DNN. As the penalty gradients make the common first-order gradient-based algorithms prohibited due to the hardness of obtaining an explicit-form expression of the penalty gradients, we further apply a zero-order optimization technique to design the training algorithm to address the critical issue. The simulation results of the IEEE test case demonstrate the effectiveness of the penalty approach. Also, they show that DeepOPF can speed up the computing time by one order of magnitude compared to a state-of-the-art solver, at the expense of minor optimality loss.

[1]  Ahmed S. Zamzam,et al.  Learning-Accelerated ADMM for Distributed Optimal Power Flow , 2019, ArXiv.

[2]  Michele Lombardi,et al.  Lagrangian Duality for Constrained Deep Learning , 2020, ECML/PKDD.

[3]  K. Jittorntrum Solution point differentiability without strict complementarity in nonlinear programming , 1984 .

[4]  Pascal Van Hentenryck,et al.  Combining Deep Learning and Optimization for Preventive Security-Constrained DC Optimal Power Flow , 2021, IEEE Transactions on Power Systems.

[5]  Kyri Baker,et al.  A Learning-boosted Quasi-Newton Method for AC Optimal Power Flow , 2020, 2007.06074.

[6]  Gabriela Hug,et al.  Data-Driven Local Control Design for Active Distribution Grids Using Off-Line Optimal Power Flow and Machine Learning Techniques , 2019, IEEE Transactions on Smart Grid.

[7]  Bevan K. Youse,et al.  Introduction to real analysis , 1972 .

[8]  Yurii Nesterov,et al.  Random Gradient-Free Minimization of Convex Functions , 2015, Foundations of Computational Mathematics.

[9]  Spyros Chatzivasileiadis,et al.  Lecture Notes on Optimal Power Flow (OPF) , 2018, ArXiv.

[10]  Shie Mannor,et al.  Supervised learning for optimal power flow as a real-time proxy , 2016, 2017 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT).

[11]  Tianyu Zhao,et al.  DeepOPF: Deep Neural Network for DC Optimal Power Flow , 2019, 2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm).

[12]  R. T. Rockafellar,et al.  The Generic Nature of Optimality Conditions in Nonlinear Programming , 1979, Math. Oper. Res..

[13]  Mahdi Jamei,et al.  Learning an Optimally Reduced Formulation of OPF through Meta-optimization , 2019, ArXiv.

[14]  Data-Driven Screening of Network Constraints for Unit Commitment , 2019, IEEE Transactions on Power Systems.

[15]  M. B. Cain,et al.  History of Optimal Power Flow and Formulations , 2012 .

[16]  Matt Wytock,et al.  Machine Learning for AC Optimal Power Flow , 2019, ArXiv.

[17]  K. Mani Chandy,et al.  Equivalence of branch flow and bus injection models , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[18]  Kyri Baker,et al.  Learning Optimal Solutions for Extremely Fast AC Optimal Power Flow , 2019, 2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm).

[19]  Frederik Diehl Warm-Starting AC Optimal Power Flow with Graph Neural Networks , 2019 .

[20]  Michele Lombardi,et al.  A Lagrangian Dual Framework for Deep Neural Networks with Constraints , 2020, ArXiv.

[21]  M. Ferris,et al.  The Power Grid Library for Benchmarking AC Optimal Power Flow Algorithms , 2019, ArXiv.

[22]  Alfredo Vaccaro,et al.  A knowledge-based framework for power flow and optimal power flow analyses , 2017, 2017 IEEE Power & Energy Society General Meeting.

[23]  James Requeima,et al.  Meta-Optimization of Optimal Power Flow , 2019 .

[24]  Gokcen Kestor,et al.  Smart-PGSim: Using Neural Network to Accelerate AC-OPF Power Grid Simulation , 2020, SC20: International Conference for High Performance Computing, Networking, Storage and Analysis.

[25]  Steffen Rebennack,et al.  Optimal power flow: a bibliographic survey I , 2012, Energy Systems.

[26]  Di Shi,et al.  Deriving AC OPF Solutions via Proximal Policy Optimization for Secure and Economic Grid Operation , 2020, 2003.12584.

[27]  Kyri Baker,et al.  Learning Warm-Start Points For Ac Optimal Power Flow , 2019, 2019 IEEE 29th International Workshop on Machine Learning for Signal Processing (MLSP).

[28]  Steven H. Low,et al.  DeepOPF-V: Solving AC-OPF Problems Efficiently , 2021, IEEE Transactions on Power Systems.

[29]  Q. T. T. Tran,et al.  A multi-agent system reinforcement learning based optimal power flow for islanded microgrids , 2016, 2016 IEEE 16th International Conference on Environment and Electrical Engineering (EEEIC).

[30]  Louis Wehenkel,et al.  Recent Developments in Machine Learning for Energy Systems Reliability Management , 2020, Proceedings of the IEEE.

[31]  Baosen Zhang,et al.  A Convex Neural Network Solver for DCOPF With Generalization Guarantees , 2020, IEEE Transactions on Control of Network Systems.

[32]  Quoc V. Le,et al.  Adding Gradient Noise Improves Learning for Very Deep Networks , 2015, ArXiv.

[33]  Yan Xu,et al.  Real-Time Optimal Power Flow: A Lagrangian Based Deep Reinforcement Learning Approach , 2020, IEEE Transactions on Power Systems.

[34]  Pascal Van Hentenryck,et al.  Predicting AC Optimal Power Flows: Combining Deep Learning and Lagrangian Dual Methods , 2019, AAAI.

[35]  Qian Gao,et al.  Data-Driven Optimal Power Flow: A Physics-Informed Machine Learning Approach , 2020, IEEE Transactions on Power Systems.

[36]  David Fridovich-Keil,et al.  Toward Distributed Energy Services: Decentralizing Optimal Power Flow With Machine Learning , 2018, IEEE Transactions on Smart Grid.

[37]  Sidhant Misra,et al.  Statistical Learning for DC Optimal Power Flow , 2018, 2018 Power Systems Computation Conference (PSCC).

[38]  Georgios B. Giannakis,et al.  Learning to Solve the AC-OPF Using Sensitivity-Informed Deep Neural Networks , 2021, IEEE Transactions on Power Systems.

[39]  Saeed Ghadimi,et al.  Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming , 2013, SIAM J. Optim..

[40]  Lin Xiao,et al.  Optimal Algorithms for Online Convex Optimization with Multi-Point Bandit Feedback. , 2010, COLT 2010.

[41]  R. Srikant,et al.  Why Deep Neural Networks for Function Approximation? , 2016, ICLR.

[42]  Brighten Godfrey,et al.  A Deep Reinforcement Learning Perspective on Internet Congestion Control , 2019, ICML.

[43]  Andrey Bernstein,et al.  Joint Chance Constraints in AC Optimal Power Flow: Improving Bounds Through Learning , 2018, IEEE Transactions on Smart Grid.

[44]  Tianyu Zhao,et al.  DeepOPF: A Deep Neural Network Approach for Security-Constrained DC Optimal Power Flow , 2019, IEEE Transactions on Power Systems.

[45]  Baosen Zhang,et al.  Learning to Solve Network Flow Problems via Neural Decoding , 2020, 2002.04091.

[46]  Steffen Rebennack,et al.  Optimal power flow: a bibliographic survey II , 2012, Energy Systems.

[47]  Emiliano Dall'Anese,et al.  Dynamic ADMM for real-time optimal power flow , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[48]  Steffen Rebennack,et al.  An introduction to optimal power flow: Theory, formulation, and examples , 2016 .

[49]  Pramod K. Varshney,et al.  A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning: Principals, Recent Advances, and Applications , 2020, IEEE Signal Processing Magazine.

[50]  Pierre Pinson,et al.  Data-driven Security-Constrained AC-OPF for Operations and Markets , 2018, 2018 Power Systems Computation Conference (PSCC).

[51]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[52]  David Rolnick,et al.  DC3: A learning method for optimization with hard constraints , 2021, ICLR.

[53]  Steven H. Low,et al.  Convex Relaxation of Optimal Power Flow—Part II: Exactness , 2014, IEEE Transactions on Control of Network Systems.

[54]  Tianyu Zhao,et al.  DeepOPF+: A Deep Neural Network Approach for DC Optimal Power Flow for Ensuring Feasibility , 2020, 2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm).

[55]  Alfredo Vaccaro,et al.  A Knowledge-Based Framework for Power Flow and Optimal Power Flow Analyses , 2018, IEEE Transactions on Smart Grid.

[56]  Ohad Shamir,et al.  Depth-Width Tradeoffs in Approximating Natural Functions with Neural Networks , 2016, ICML.

[57]  Lena Jaeger,et al.  Electric Circuit Analysis , 2016 .

[58]  G. S. Misyris,et al.  Neural Networks for Encoding Dynamic Security-Constrained Optimal Power Flow to Mixed-Integer Linear Programs , 2020, ArXiv.

[59]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[60]  Liangjie Chen,et al.  Hot-Starting the Ac Power Flow with Convolutional Neural Networks , 2020, ArXiv.

[61]  Krishnamurthy Dvijotham,et al.  Real-Time Optimal Power Flow , 2017, IEEE Transactions on Smart Grid.

[62]  Steven H. Low,et al.  Convex Relaxation of Optimal Power Flow—Part I: Formulations and Equivalence , 2014, IEEE Transactions on Control of Network Systems.

[63]  Daniel Bienstock,et al.  Strong NP-hardness of AC power flows feasibility , 2019, Oper. Res. Lett..

[64]  Fernando Gama,et al.  Optimal Power Flow Using Graph Neural Networks , 2019, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[65]  Line Roald,et al.  Learning for Convex Optimization , 2018 .

[66]  Xueping Gu,et al.  Neural-Network Security-Boundary Constrained Optimal Power Flow , 2011, IEEE Transactions on Power Systems.

[67]  Soumyadip Ghosh,et al.  Two-stage stochastic optimization for optimal power flow under renewable generation uncertainty , 2014, ACM Trans. Model. Comput. Simul..

[68]  Deepjyoti Deka,et al.  Learning for DC-OPF: Classifying active sets using neural nets , 2019, 2019 IEEE Milan PowerTech.

[69]  Line Roald,et al.  Learning for Constrained Optimization: Identifying Optimal Active Constraint Sets , 2018, INFORMS J. Comput..

[70]  R D Zimmerman,et al.  MATPOWER: Steady-State Operations, Planning, and Analysis Tools for Power Systems Research and Education , 2011, IEEE Transactions on Power Systems.

[71]  Daniel K. Molzahn,et al.  Recent advances in computational methods for the power flow equations , 2015, 2016 American Control Conference (ACC).

[72]  Jason R. Marden,et al.  A Model-Free Approach to Wind Farm Control Using Game Theoretic Methods , 2013, IEEE Transactions on Control Systems Technology.

[73]  Ferdinando Fioretto,et al.  High-Fidelity Machine Learning Approximations of Large-Scale Optimal Power Flow , 2020, ArXiv.