Deep Reinforcement Learning for Scenario-Based Robust Economic Dispatch Strategy in Internet of Energy

Currently, the integration of distributed energy generators through virtual power plants in the Internet of Energy is a mainstream method. The complex structure of virtual power plants and the characteristics of distributed energy make it difficult to solve the economic dispatch problems of virtual power plants. In addition, the load of a virtual power plant is unstable and uncertain and thus requires a robust economic dispatch strategy. Because the selection of the set of uncertain conditions is conservative, the traditional robust economic dispatch strategies cannot effectively reduce the cost of virtual power plants. In addition, the traditional methods for solving robust strategies cannot directly solve nonlinear and nonconvex problems. In this article, we propose a scenario-based robust economic dispatch strategy for virtual power plants, aiming to reduce the operational costs of virtual power plants. First, to reduce the conservatism of the strategy, scenario-based data augmentation is adopted for data generation. Through a generative adversarial network, a large amount of scene data are generated to extend the set of uncertain conditions. The scene data cannot only reduce the conservatism but also can be used in the determination of robust strategies. Second, deep reinforcement learning is adopted for historical data training, directly solving nonlinear and nonconvex problems to obtain a robust economic dispatch strategy. As experiments show, with the accurate generation of scene data, the proposed economic dispatch strategy is robust and effectively reduces the cost of virtual power plants.

[1]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[2]  Haile-Selassie Rajamani,et al.  Modeling and simulation of virtual power plant in energy management system applications , 2017, 2017 7th International Conference on Power Systems (ICPS).

[3]  Yi Zheng,et al.  No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysis , 2017, ICML.

[4]  Ziad Kobti,et al.  Data Augmentation using CA Evolved GANs , 2019, 2019 IEEE Symposium on Computers and Communications (ISCC).

[5]  Le Xie,et al.  Scenario-Based Economic Dispatch With Uncertain Demand Response , 2017, IEEE Transactions on Smart Grid.

[6]  Dong Yue,et al.  Economic dispatch of virtual power plant based on distributed primal-dual sub-gradient method , 2017, 2017 36th Chinese Control Conference (CCC).

[7]  Zhipeng Cai,et al.  A Private and Efficient Mechanism for Data Uploading in Smart Cyber-Physical Systems , 2020, IEEE Transactions on Network Science and Engineering.

[8]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[9]  Xiuping Zhang,et al.  Optimal Scheme of Energy Storage System with Wind Power Integration Considering Negative Peak Load Regulation Capacity , 2019, 2019 IEEE Innovative Smart Grid Technologies - Asia (ISGT Asia).

[10]  Chaojie Li,et al.  Parallel and Distributed Computation for Dynamical Economic Dispatch , 2017, IEEE Transactions on Smart Grid.

[11]  C. Nicolet,et al.  Virtual power plant with pumped storage power plant for renewable energy integration , 2014, 2014 International Conference on Electrical Machines (ICEM).

[12]  Yun Liu,et al.  A Robust Distributed Economic Dispatch Strategy of Virtual Power Plant Under Cyber-Attacks , 2018, IEEE Transactions on Industrial Informatics.

[13]  Yi Liang,et al.  Deep Learning Based Inference of Private Information Using Embedded Sensors in Smart Devices , 2018, IEEE Network.

[14]  Dong Yue,et al.  Economic dispatch of power systems with virtual power plant based interval optimization method , 2016 .

[15]  Haibo He,et al.  Data-Adaptive Robust Optimization Method for the Economic Dispatch of Active Distribution Networks , 2019, IEEE Transactions on Smart Grid.

[16]  Daniel Kirschen,et al.  Model-Free Renewable Scenario Generation Using Generative Adversarial Networks , 2017, IEEE Transactions on Power Systems.

[17]  Xie Jun,et al.  A distributed gradient algorithm based economic dispatch strategy for virtual power plant , 2016, 2016 35th Chinese Control Conference (CCC).

[18]  Yingshu Li,et al.  Data Linkage in Smart Internet of Things Systems: A Consideration from a Privacy Perspective , 2018, IEEE Communications Magazine.

[19]  Kai Strunz,et al.  Wind and Solar Power Integration in Electricity Markets and Distribution Networks Through Service-Centric Virtual Power Plants , 2018, IEEE Transactions on Power Systems.

[20]  Sailing He,et al.  Data Augmentation Using Conditional GANs for Facial Emotion Recognition , 2018, 2018 Progress in Electromagnetics Research Symposium (PIERS-Toyama).