Multiagent-Based Energy Trading Platform for Energy Storage Systems in Distribution Systems With Interconnected Microgrids

In this article, an agent-based transactive energy (TE) trading platform to integrate energy storage systems (ESSs) into the microgrids’ energy management system is proposed. Using this platform, two different types of energy storage market models are proposed to promote local-level (within the microgrid) and communal- or global-level ESSs’ participation in the intra- and intermicrogrid TE markets. Also, a reinforcement learning algorithm known as simulated-annealing-based $Q$-learning is used to develop bidding strategies for ESSs to participate in the TE markets. Besides energy trading, the proposed system also accounts for the losses caused by energy transactions between ESSs and microgrids using a complex current-tracing-based loss allocation method. The overall efficacy of the proposed energy market management system is demonstrated using a modified IEEE 123-bus distribution system with multiple microgrids and ESSs. Based on simulation results, it is observed that the proposed model can effectively reinforce the balance between the supply and the demand in the microgrids using the mix of local and global ESSs.

[1]  M Castilla,et al.  Hierarchical Control of Intelligent Microgrids , 2010, IEEE Industrial Electronics Magazine.

[2]  Miguel A. Ortega-Vazquez,et al.  Optimal scheduling of electric vehicle charging and vehicle-to-grid services at household level including battery degradation and price uncertainty , 2014 .

[3]  Thomas Morstyn,et al.  Designing Decentralized Markets for Distribution System Flexibility , 2019, IEEE Transactions on Power Systems.

[4]  Suryanarayana Doolla,et al.  Intelligent demand side management in smart-microgrids , 2013, 2013 IEEE International Workshop on Inteligent Energy Systems (IWIES).

[5]  Liu Xiangdong,et al.  Optimal microgrid economic operations under progressive second price auction mechanisms , 2013, Proceedings of the 32nd Chinese Control Conference.

[6]  Sreten Skuletic,et al.  Implementation of different methods for PTDF matrix calculation in flow-based coordinated auction , 2007, 2007 International Conference on Power Engineering, Energy and Electrical Drives.

[7]  Marcelo Godoy Simões,et al.  Distributed Intelligent Energy Management System for a Single-Phase High-Frequency AC Microgrid , 2007, IEEE Transactions on Industrial Electronics.

[8]  Mats Larsson,et al.  Active Management of Distributed Energy Resources Using Standardized Communications and Modern Information Technologies , 2009, IEEE Transactions on Industrial Electronics.

[9]  Suryanarayana Doolla,et al.  Multi-Agent based Energy Trading Platform for Energy Storage Systems in Distribution Systems with Inter-connected Microgrids , 2018, 2018 IEEE Industry Applications Society Annual Meeting (IAS).

[10]  C. Townsend,et al.  Decentralised Energy Market for Implementation into the Intergrid Concept - Part I: Isolated System , 2018, 2018 7th International Conference on Renewable Energy Research and Applications (ICRERA).

[11]  Xi Chen,et al.  A cooperative game approach for coordinating multi-microgrid operation within distribution systems , 2018, Applied Energy.

[12]  J. Iannucci,et al.  Energy Storage Concepts for a Restructured Electric Utility Industry , 2000 .

[13]  Dipti Srinivasan,et al.  Multiagent-Based Transactive Energy Framework for Distribution Systems With Smart Microgrids , 2017, IEEE Transactions on Industrial Informatics.

[14]  Sandia Report,et al.  Energy Storage for the Electricity Grid: Benefits and Market Potential Assessment Guide A Study for the DOE Energy Storage Systems Program , 2010 .

[15]  Yang Liu,et al.  A new Q-learning algorithm based on the metropolis criterion , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  WILLIAM W. HOGAN.  ON WHOLESALE COMPETITION IN REGIONS WITH ORGANIZED ELECTRIC MARKETS , 2007 .

[17]  HyungSeon Oh.  Optimal Planning to Include Storage Devices in Power Systems , 2011, IEEE Transactions on Power Systems.

[18]  Mohammad Shahidehpour,et al.  ISO's optimal strategies for scheduling the hourly demand response in day-ahead markets , 2015, 2015 IEEE Power & Energy Society General Meeting.

[19]  Suryanarayana Doolla,et al.  Multiagent-Based Distributed-Energy-Resource Management for Intelligent Microgrids , 2013, IEEE Transactions on Industrial Electronics.

[20]  Janusz Bialek,et al.  Tracing the flow of electricity , 1996 .

[21]  Nathan G. Johnson,et al.  Scalable multi-agent microgrid negotiations for a transactive energy market , 2018, Applied Energy.

[22]  Yonggang Wen,et al.  Virtual Storage-Based DSM With Error-Driven Prediction Modulation for Microgrids , 2019, IEEE Access.

[23]  Khosrow Moslehi,et al.  Autonomous Resilient Grids in an IoT Landscape Vision for a Nested Transactive Grid , 2019, IEEE Transactions on Power Systems.

[24]  Christopher D. Townsend,et al.  Decentralised Energy Market for Implementation into the Intergrid Concept - Part 2: Integrated System , 2018, 2018 7th International Conference on Renewable Energy Research and Applications (ICRERA).

[25]  Mohammad Shahidehpour,et al.  Blockchain for decentralized transactive energy management system in networked microgrids , 2019, The Electricity Journal.