Probabilistic investment strategy modeling for generation expansion planning

A multi-agent generation expansion planning (GEP) simulation is useful for electricity market design. However, most preceding studies which assume a deterministic strategy didn't consider important elements of the multi-agent GEP, e.g. probabilistic strategy and multiple determination timing over years. This paper models the multi-agent GEP problem as an uncooperative stochastic strategy dynamic game, and proposes the novel simulation method based on reinforcement learning. Because this simulation method assumes probabilistic strategy, subgame's Nash equilibriums in every situation and every year can be derived. From the simulation results of the proposed method and conventional iterative search method for simple test power system, it's shown that a reasonable probabilistic investment strategy which can get more expected profit than the conventional method by the early investment strategy can be derived by using this method.

[1]  Jamshid Aghaei,et al.  Generation expansion planning in Pool market: A hybrid modified game theory and particle swarm optimization , 2011 .

[2]  M. Shahidehpour,et al.  Market-Based Coordination of Transmission and Generation Capacity Planning , 2007, IEEE Transactions on Power Systems.

[3]  V. Nanduri,et al.  Generation Capacity Expansion in Energy Markets Using a Two-Level Game-Theoretic Model , 2009, IEEE Transactions on Power Systems.

[4]  D.S. Kirschen,et al.  Assessment of generation expansion mechanisms using multi-agent systems , 2008, 2008 IEEE Power and Energy Society General Meeting - Conversion and Delivery of Electrical Energy in the 21st Century.

[5]  James Webb Game Theory: Decisions, Interaction and Evolution , 2006 .

[6]  Felix Wu,et al.  A Game-Theoretic Model for Generation Expansion Planning: Problem Formulation and Numerical Comparisons , 2001, IEEE Power Engineering Review.

[7]  G. R. Yousefi,et al.  Generation expansion planning in a pool based electricity market, using game theory and genetic algorithm , 2012, 20th Iranian Conference on Electrical Engineering (ICEE2012).

[8]  Hiroyuki Kita,et al.  Generation Expansion Planning Considering Mass Penetration of Renewable Energy Generation and Supply Reliability , 2013 .

[9]  R Bellman,et al.  On the Theory of Dynamic Programming. , 1952, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Audun Botterud,et al.  MULTI-AGENT SYSTEM FOR SHORT AND LONG-TERM POWER MARKET SIMULATIONS , 2009 .

[11]  T. Veselka,et al.  Multi-Agent Simulation of Generation Expansion in Electricity Markets , 2007, 2007 IEEE Power Engineering Society General Meeting.

[12]  Hamidreza Zareipour,et al.  A Transmission Planning Framework Considering Future Generation Expansions in Electricity Markets , 2010, IEEE Transactions on Power Systems.