A Multi-Agent Deep Reinforcement Learning Based Voltage Regulation Using Coordinated PV Inverters

This paper proposes a multi-agent deep reinforcement learning-based approach for distribution system voltage regulation with high penetration of photovoltaics (PVs). The designed agents can learn the coordinated control strategies from historical data through the counter-training of local policy networks and centric critic networks. The learned strategies allow us to perform online coordinated control. Comparative results with other methods show the enhanced control capability of the proposed method under various conditions.

[1]  Ahmad Zahedi,et al.  Review of control strategies for voltage regulation of the smart distribution network with high penetration of renewable distributed generation , 2016 .

[2]  Johan Driesen,et al.  Optimal Local Reactive Power Control by PV Inverters , 2016, IEEE Transactions on Sustainable Energy.

[3]  Josep M. Guerrero,et al.  Distributed Control of Battery Energy Storage Systems for Voltage Regulation in Distribution Networks With High PV Penetration , 2018, IEEE Transactions on Smart Grid.

[4]  Wei Shi,et al.  Distributed Voltage Control in Distribution Networks: Online and Robust Implementations , 2018, IEEE Transactions on Smart Grid.

[5]  Josep M. Guerrero,et al.  Voltage Quality Improvement in Low Voltage Distribution Networks Using Reactive Power Capability of Single-Phase PV Inverters , 2019, IEEE Transactions on Smart Grid.

[6]  Yi Wu,et al.  Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments , 2017, NIPS.

[7]  T. Stetz,et al.  Improved Low Voltage Grid-Integration of Photovoltaic Systems in Germany , 2013, IEEE Transactions on Sustainable Energy.

[8]  Peng Li,et al.  A centralized-based method to determine the local voltage control strategies of distributed generator operation in active distribution networks , 2018, Applied Energy.

[9]  Di Shi,et al.  A Data-Driven Multi-Agent Autonomous Voltage Control Framework Using Deep Reinforcement Learning , 2020, IEEE Transactions on Power Systems.

[10]  Fei Sha,et al.  Actor-Attention-Critic for Multi-Agent Reinforcement Learning , 2018, ICML.

[11]  R Tonkoski,et al.  Coordinated Active Power Curtailment of Grid Connected PV Inverters for Overvoltage Prevention , 2011, IEEE Transactions on Sustainable Energy.

[12]  Andrey Bernstein,et al.  Network-Cognizant Voltage Droop Control for Distribution Grids , 2017, IEEE Transactions on Power Systems.