Distributed Secondary Control of Droop-Controlled Microgrid Using Averaged Feedback Reward Pinning

An original method for distributed secondary control (DSC) using averaged feedback reward pinning (AFRP) is proposed to eliminate static error caused by droop controllers in a micorgrid (MG). The method uses local and global rewards to evaluate the frequency and voltage control effects, and it further optimizes the control performance by maximizing the global feedback reward. The AFRP can adaptively adjust the pinning values step-by-step and always converges in the direction that maximizes global feedback. Only certain parts of agents are pinned to the averaged feedback reward, and then all other existing agents converge along with the pinned agents through the neighboring communication coupling. In this way, the DSC can obtain a near-optimal solution, which asymptotically eliminates frequency deviations and optimally regulates voltages in consideration of power losses in the MG. The efficiency and superiority of the AFRP-based DSC are verified by discussion and analysis of the simulation results.

[1]  Junan Lu,et al.  Adaptive synchronization of an uncertain complex dynamical network , 2006, IEEE Transactions on Automatic Control.

[2]  Wei Zhang,et al.  Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Xiaodong Yuan,et al.  Pinning Group Consensus-Based Distributed Coordination Control for Active Distribution Systems , 2018, IEEE Access.

[4]  Josep M. Guerrero,et al.  Advanced Control Architectures for Intelligent Microgrids—Part I: Decentralized and Hierarchical Control , 2013, IEEE Transactions on Industrial Electronics.

[5]  Youyun Xu,et al.  Integrating Distributed Grids With Green Cellular Backhaul: From Competition to Cooperation , 2018, IEEE Access.

[6]  Muhammad Khalid,et al.  An Innovative Hybrid Wind-Solar and Battery-Supercapacitor Microgrid System—Development and Optimization , 2017, IEEE Access.

[7]  Jing J. Liang,et al.  Distributed Event-Triggered Secondary Control for Economic Dispatch and Frequency Restoration Control of Droop-Controlled AC Microgrids , 2020, IEEE Transactions on Sustainable Energy.

[8]  Dong Yue,et al.  MAS-Based Hierarchical Distributed Coordinate Control Strategy of Virtual Power Source Voltage in Low-Voltage Microgrid , 2017, IEEE Access.

[9]  Ali Mehrizi-Sani,et al.  Distributed Control Techniques in Microgrids , 2014, IEEE Transactions on Smart Grid.

[10]  Ufuk Topcu,et al.  Optimal Load Control via Frequency Measurement and Neighborhood Area Communication , 2013, IEEE Transactions on Power Systems.

[11]  Yasunori Mitani,et al.  Robust Virtual Inertia Control of an Islanded Microgrid Considering High Penetration of Renewable Energy , 2018, IEEE Access.

[12]  Sajad Najafi Ravadanegh,et al.  Optimal Power Dispatch of Multi-Microgrids at Future Smart Distribution Grids , 2015, IEEE Transactions on Smart Grid.

[13]  Fanghong Guo,et al.  Distributed Secondary Voltage and Frequency Restoration Control of Droop-Controlled Inverter-Based Microgrids , 2015, IEEE Transactions on Industrial Electronics.

[14]  Robert Lasseter,et al.  Smart Distribution: Coupled Microgrids , 2011, Proceedings of the IEEE.

[15]  Josep M. Guerrero,et al.  Design and Analysis of the Droop Control Method for Parallel Inverters Considering the Impact of the Complex Impedance on the Power Sharing , 2011, IEEE Transactions on Industrial Electronics.

[16]  Ronald Ortner,et al.  Noname manuscript No. (will be inserted by the editor) Adaptive Aggregation for Reinforcement Learning in Average Reward Markov Decision Processes , 2022 .

[17]  Haibin Yu,et al.  Fully Distributed Hierarchical Control of Parallel Grid-Supporting Inverters in Islanded AC Microgrids , 2018, IEEE Transactions on Industrial Informatics.

[18]  Juan C. Vasquez,et al.  Secondary Frequency and Voltage Control of Islanded Microgrids via Distributed Averaging , 2015, IEEE Transactions on Industrial Electronics.

[19]  Frank L. Lewis,et al.  Distributed Cooperative Secondary Control of Microgrids Using Feedback Linearization , 2013, IEEE Transactions on Power Systems.

[20]  Xinghuo Yu,et al.  Cluster-Oriented Distributed Cooperative Control for Multiple AC Microgrids , 2019, IEEE Transactions on Industrial Informatics.

[21]  Sridhar Mahadevan,et al.  Hierarchical Average Reward Reinforcement Learning , 2007, J. Mach. Learn. Res..

[22]  Xinghuo Yu,et al.  Stochastic Distributed Frequency and Load Sharing Control for Microgrids With Communication Delays , 2019, IEEE Systems Journal.

[23]  Wenwu Yu,et al.  Game Theoretic Non-Cooperative Distributed Coordination Control for Multi-Microgrids , 2018, IEEE Transactions on Smart Grid.

[24]  Fei Gao,et al.  Virtual cluster control for active distribution system using Pinning-based distributed secondary control , 2019 .

[25]  F. Orecchini,et al.  Beyond smart grids The need of intelligent energy networks for a higher global efficiency through , 2011 .

[26]  Yibing Liu,et al.  A Fully Distributed Reactive Power Optimization and Control Method for Active Distribution Networks , 2014, IEEE Transactions on Smart Grid.