Synchronization Games in P2P Energy Trading

The rise of distributed energy generation technologies along with grid constraints, and conventional non-consumer centric business models, is leading many to explore alternative configurations of the energy system. Particularly popular are peer-to-peer energy trading models in which the role of the energy company is replaced with a trustless transaction layer based on a public blockchain. However, to ensure stable operation of microgrids, an energy company is required to constantly balance supply and demand. In this paper, we study the problem that arises from the conflicting goals of prosumers (to make money) and network operators (to keep the network stable) that have to co-exist in future energy systems. We show that prosumers can play large-scale synchronization games to benefit from the system. If they synchronize their actions to artificially increase energy demand on the market, the resulting power peaks will force the microgrid operator to use backup generation capacities and, as a consequence, contribute to the increased profit margins for prosumers. We study synchronization games from a game-theoretical point of view and argue that even non-cooperative selfish prosumers can learn to play synchronization games independently and enforce undesired outcomes for consumers and the grid. We build a simple model where prosumers independently run Q-learning algorithms to learn their most profitable strategies and show that synchronization games constitute a Nash equilibrium. We discuss implications of our findings and argue the necessity of appropriate mechanism design for stable microgrid operation.

[1]  J. Nash,et al.  NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[2]  Costas S. Iliopoulos,et al.  Smart Meter Data Analysis , 2016, ICC 2016.

[3]  Nick Wilkinson,et al.  Behavioral Game Theory , 2012 .

[4]  Michael D. Murphy,et al.  A Decision Support Tool for Building Integrated Renewable Energy Microgrids Connected to a Smart Grid , 2017 .

[5]  Iain Staffell,et al.  A systems approach to quantifying the value of power generation and energy storage technologies in future electricity networks , 2017, Comput. Chem. Eng..

[6]  Colin Camerer Behavioral Game Theory , 1990 .

[7]  A. Dolara,et al.  Comparison of different physical models for PV power output prediction , 2015 .

[8]  S. Gächter Behavioral Game Theory , 2008, Encyclopedia of Evolutionary Psychological Science.

[9]  Satoshi Nakamoto Bitcoin : A Peer-to-Peer Electronic Cash System , 2009 .

[10]  Rabah Amir,et al.  On the Effects of Entry in Cournot Markets , 2000 .

[11]  Luluwah Al-Fagih,et al.  Game-Theoretic Approaches to Energy Trading: A Survey , 2017, ArXiv.

[12]  David L. Mills,et al.  Computer network time synchronization : the network time protocol on earth and in space , 2006 .

[13]  Moshe Zukerman,et al.  Distributed Energy Trading in Microgrids: A Game-Theoretic Model and Its Equilibrium Analysis , 2015, IEEE Transactions on Industrial Electronics.

[14]  Frede Blaabjerg,et al.  A Robust Synchronization to Enhance the Power Quality of Renewable Energy Systems , 2015, IEEE Transactions on Industrial Electronics.

[15]  Alexander Vasin,et al.  Game-theoretic Study of Electricity Market Mechanisms , 2014, ITQM.

[16]  Osama A. Mohammed,et al.  GPS Synchronization of Smart Distributed Converters for Microgrid Applications , 2018 .

[17]  S. Stoft Power System Economics: Designing Markets for Electricity , 2002 .

[18]  Anil Pahwa,et al.  Game theoretic model of energy trading strategies at equilibrium in microgrids , 2014, 2014 North American Power Symposium (NAPS).

[19]  Juan Benet,et al.  IPFS - Content Addressed, Versioned, P2P File System , 2014, ArXiv.

[20]  Liang Xiao,et al.  Reinforcement Learning-based Energy Trading for Microgrids , 2018, ArXiv.

[21]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[22]  Liang Xiao,et al.  Energy Trading Game for Microgrids Using Reinforcement Learning , 2017, GAMENETS.

[23]  Mohamed M. Abdallah,et al.  A survey on energy trading in smart grid , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[24]  David Shipworth,et al.  Behaviour, practice – whatever? A theory-agnostic framework for describing and informing demand-side response , 2017 .

[25]  Canbing Li,et al.  What's the difference between traditional power grid and smart grid? — From dispatching perspective , 2013, 2013 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC).

[26]  Ann Nowé,et al.  SCANERGY: a Scalable and Modular System for Energy Trading Between Prosumers , 2015, AAMAS.

[27]  Peter Cramton,et al.  Vickrey auctions with reserve pricing , 2004 .