Reinforcement Learning Based Supplier-Agents for Electricity Markets

Bidding strategies play important roles in maximizing the profits of power suppliers in competitive electricity markets. Therefore, it will be an advantage for a supplier to search for optimal bidding strategies in the market. In this paper the problem of designing fuzzy reinforcement learning (FRL) supplier-agents that compete in forward electricity markets (e.g. Day-Ahead energy market) to maximize their revenues is studied. An IEEE 30-bus power system with 6 generators (supplier-agents) and three demand areas with stochastic loads are used for our simulation studies. This model is applicable to different types of commodity markets with numerous supply and demand agents

[1]  Ho-fung Leung,et al.  An agent bidding strategy based on fuzzy logic in a continuous double auction , 2001, AGENTS '01.

[2]  Zou Bin,et al.  The comparisons between pricing methods on pool-based electricity market using agent-based simulation , 2004, 2004 IEEE International Conference on Electric Utility Deregulation, Restructuring and Power Technologies. Proceedings.

[3]  Ly Fie Sugianto,et al.  Fuzzy model of generator bidding system in competitive electricity markets , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[4]  V. C. Ramesh,et al.  Intelligent agents for negotiations in market games. I. Model , 1998 .

[5]  S. Okuma,et al.  Multi-agent based experiments on uniform price and pay-as-bid electricity auction markets , 2004, 2004 IEEE International Conference on Electric Utility Deregulation, Restructuring and Power Technologies. Proceedings.

[6]  Isabel Praça,et al.  Mascem: A Multiagent System That Simulates Competitive Electricity Markets , 2003, IEEE Intell. Syst..

[7]  Susumu Matsui,et al.  Adaptive multiagent model of electric power market with congestion management , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[8]  Fernando A. C. Gomide,et al.  Evolving fuzzy bidding strategies in competitive electricity markets , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.