Darwin in Smart Power Grids - Evolutionary Game Theory for Analyzing Self-Organization in Demand-Side Aggregation

Maintaining a balance between power consumption and production is paramount for the safe and efficient usage of our power infrastructure. With the increased adoption of less predictable producers such as windmills and photovoltaics, maintaining this balance has become even more challenging. Demand-side aggregators are relatively new actors in smart power systems, offering balancing services. Aggregators maintain a portfolio of flexible consumers (e.g. Production plants, electric vehicles or shift able household appliances) that they can use for such balancing purposes. Typically, these balancing actions involve some form of financial compensation. Together these actors form a complex, interacting, self-organizing system, where an individual's behavior fluctuates as a result of maximizing their own objectives. In this work, we analyze the influence of competing aggregator's pricing strategies on the flexibility providers by using evolutionary game theory with replicator dynamics. Applying this analysis approach to concrete multi-aggregator scenarios allows for predictions on stable system states under varying conditions. Concrete results show that pricing strategies favoring reservation payments over activation payments increases the aggregator's market share size and its associated balancing potential in stable equilibrium.

[1]  S. Karnouskos,et al.  Smart Houses for a Smart Grid , 2009 .

[2]  William H. Sandholm,et al.  Population Games And Evolutionary Dynamics , 2010, Economic learning and social evolution.

[3]  Michael P. Wellman,et al.  Learning Payoffs in Large Symmetric Games (Extended Abstract) , 2015 .

[4]  Geert Deconinck,et al.  Potential of Active Demand Reduction With Residential Wet Appliances: A Case Study for Belgium , 2015, IEEE Transactions on Smart Grid.

[5]  Mohammed H. Albadi,et al.  A summary of demand response in electricity markets , 2008 .

[6]  Tim Roughgarden,et al.  Algorithmic Game Theory , 2007 .

[7]  Noam Nisan,et al.  Algorithmic mechanism design (extended abstract) , 1999, STOC '99.

[8]  Hans-Jürgen Appelrath,et al.  Market-based self-organized provision of active power and ancillary services: An agent-based approach for Smart Distribution Grids , 2012, 2012 Complexity in Engineering (COMPENG). Proceedings.

[9]  R. Cooper,et al.  Coordination Games: Technological Complementarities , 1999 .

[10]  Fabio Polonara,et al.  State of the art of thermal storage for demand-side management , 2012 .

[11]  Tom Holvoet,et al.  A Scalable Three-Step Approach for Demand Side Management of Plug-in Hybrid Vehicles , 2013, IEEE Transactions on Smart Grid.

[12]  James Alexander,et al.  Evolutionary Game Theory , 2023 .

[13]  Lazaros Gkatzikis,et al.  The Role of Aggregators in Smart Grid Demand Response Markets , 2013, IEEE Journal on Selected Areas in Communications.

[14]  Robert Axelrod,et al.  Bibliography on the Evolution of Cooperation , 1988 .

[15]  K. Sigmund A Survey of Replicator Equations , 1986 .

[16]  Tom Holvoet,et al.  Anticipatory Coordination of Electric Vehicle Allocation to Fast Charging Infrastructure , 2014, PAAMS.

[17]  John Nachbar “Evolutionary” selection dynamics in games: Convergence and limit properties , 1990 .

[18]  Peter Palensky,et al.  Demand Side Management: Demand Response, Intelligent Energy Systems, and Smart Loads , 2011, IEEE Transactions on Industrial Informatics.

[19]  G. Tesauro,et al.  Analyzing Complex Strategic Interactions in Multi-Agent Systems , 2002 .

[20]  C Cannings,et al.  Multi-player matrix games. , 1997, Bulletin of mathematical biology.

[21]  B. Thomas Evolutionary stability: States and strategies , 1984 .

[22]  Johan Driesen,et al.  Comparative analysis of coordination strategies for electric vehicles , 2011, 2011 2nd IEEE PES International Conference and Exhibition on Innovative Smart Grid Technologies.

[23]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[24]  P. Taylor,et al.  Evolutionarily Stable Strategies and Game Dynamics , 1978 .

[25]  Noam Nisan,et al.  Algorithmic Mechanism Design , 2001, Games Econ. Behav..

[26]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Valentin Robu,et al.  Online mechanism design for scheduling non-preemptive jobs under uncertain supply and demand , 2014, AAMAS.

[28]  Bruce Bueno de Mesquita,et al.  An Introduction to Game Theory , 2014 .

[29]  E. David,et al.  Networks, Crowds, and Markets: Reasoning about a Highly Connected World , 2010 .

[30]  Simon Parsons,et al.  What evolutionary game theory tells us about multiagent learning , 2007, Artif. Intell..

[31]  Peter McBurney,et al.  An evolutionary game-theoretic comparison of two double-auction market designs , 2004, AAMAS'04.

[32]  Tom Holvoet,et al.  Decentralized coordination of plug-in hybrid vehicles for imbalance reduction in a smart grid , 2011, AAMAS.

[33]  Jose Medina,et al.  Demand Response and Distribution Grid Operations: Opportunities and Challenges , 2010, IEEE Transactions on Smart Grid.