SolarTrader: Enabling Distributed Solar Energy Trading in Residential Virtual Power Plants

Distributed solar energy resources (DSERs) in smart grid systems are rapidly increasing due to the steep decline in solar module prices. This DSER penetration has prompted utilities to balance the real-time supply and demand of electricity proactively. A direct consequence of this is virtual power plants (VPPs) that enable solar generated energy trading to mitigate the impact of the intermittent DSERs while also benefiting from distributed generation for more reliable and profitable grid management. However, existing energy trading approaches in residential VPPs do not actually allow DSER users to trade their surplus solar energy independently and concurrently to maximize benefit potential; they typically require a trusted third-party to play the role of an online middleman. Furthermore, due to a lack of fair trading algorithms, these approaches do not necessarily result in "fair" solar energy saving among all the VPP users in the long term. We propose Sola/Trader, a new solar energy trading system that enables unsupervised, distributed, and long term fair solar energy trading in residential VPPs. In essence, SolarTrader leverages a new multi-agent deep reinforcement learning approach that enables peer-to-peer solar energy trading among different DSERs to ensure that both the DSER users and the VPPs maximize benefit. We implement SolarTrader and evaluate it using both synthetic and real smart meter data from 4 U.S. residential VPP communities that are comprised of ~229 residential DSERs in total. Our results show that SolarTrader can reduce the aggregated VPP energy consumption by 83.8% when compared against a non-trading approach. Furthermore, SolarTrader achieves a ~105% average saving in VPP residents' monthly electricity cost. We also find that SolarTrader-enabled VPPs can achieve a fairness of 0.05, as measured by the Gini Coefficient, a level equivalent to that achieved by the fairness-maximizing Round-Robin approach.

[1]  David E. Irwin,et al.  Staring at the sun: a physical black-box solar performance model , 2018, BuildSys@SenSys.

[2]  Matthew Grimley,et al.  Design choices and equity implications of community shared solar , 2017 .

[3]  L. Irvine,et al.  A Guide to Community Shared Solar: Utility, Private, and Non-Profit Project Development (Book) , 2012 .

[4]  Donald F. Towsley,et al.  A secure energy routing mechanism for sharing renewable energy in smart microgrid , 2011, 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[5]  David E. Irwin,et al.  Black-box Solar Performance Modeling , 2017, SIGMETRICS Perform. Evaluation Rev..

[6]  Vladlen Koltun,et al.  Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learning , 2020, ICML.

[7]  Zhiyong Yuan,et al.  Microgrid planning and operation: Solar energy and wind energy , 2010, IEEE PES General Meeting.

[8]  Gaetano Zizzo,et al.  The Blockchain in Microgrids for Transacting Energy and Attributing Losses , 2017, 2017 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[9]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[10]  Frank H. P. Fitzek,et al.  Power to the Future: Use Cases and Challenges for Mobile, Self Configuring, and Distributed Power Grids , 2018, 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm).

[11]  Galen Barbose,et al.  Tracking the Sun VII: An Historical Summary of the Installed Price of Photovoltaics in the United States from 1998 to 2013 , 2012 .

[12]  Thomas Kunz,et al.  Peer-to-peer energy trading among smart homes , 2019, Applied Energy.

[13]  Prashant J. Shenoy,et al.  Sharing renewable energy in smart microgrids , 2013, 2013 ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS).

[14]  Davor Svetinovic,et al.  Security and Privacy in Decentralized Energy Trading Through Multi-Signatures, Blockchain and Anonymous Messaging Streams , 2018, IEEE Transactions on Dependable and Secure Computing.

[15]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[16]  M. Kuzlu,et al.  A Blockchain-based Platform for Exchange of Solar Energy: Laboratory-scale Implementation , 2018, 2018 International Conference and Utility Exhibition on Green Energy for Sustainable Development (ICUE).

[17]  Nicholas Jenkins,et al.  Peer-to-peer energy sharing through a two-stage aggregated battery control in a community Microgrid , 2018, Applied Energy.

[18]  Jonathan W. Kimball,et al.  Frequency regulation of a microgrid using solar power , 2011, 2011 Twenty-Sixth Annual IEEE Applied Power Electronics Conference and Exposition (APEC).

[19]  Yun Wei Li,et al.  An Enhanced Microgrid Load Demand Sharing Strategy , 2012, IEEE Transactions on Power Electronics.

[20]  R.H. Lasseter,et al.  Microgrid: a conceptual solution , 2004, 2004 IEEE 35th Annual Power Electronics Specialists Conference (IEEE Cat. No.04CH37551).

[21]  Danny Pudjianto,et al.  Virtual power plant and system integration of distributed energy resources , 2007 .

[22]  J. Zepter,et al.  Local electricity market designs for peer-to-peer trading: The role of battery flexibility , 2018, Applied Energy.

[23]  Alec Radford,et al.  Proximal Policy Optimization Algorithms , 2017, ArXiv.

[24]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..