Genetic based fuzzy Q-learning energy management for smart grid

For the energy management problems for demand response in electricity grid, a genetic based fuzzy Q-learning consumer energy management controller (CEMC) is proposed. Because of the uncertainties and highly time-varying, it is not easy to accurately obtain the complete information for the consumer behavior in electricity grid. In this case, the Q-learning, which is independent of mathematic model has good performance. The fuzzy inference is introduced in order to facilitate generalization in large state space, and the genetic operators are used to obtain the consequent parts of fuzzy rules. Simulation results show that the proposed controller can learn to take the best action to regulate consumer behavior with the features of low average end-user financial costs and high consumer satisfaction.

[1]  Sila Kiliccote,et al.  Dynamic Controls for Energy Efficiency and Demand Response: Framework Concepts and a New Construction Study Case in New York , 2006 .

[2]  A.C. Tellidou,et al.  Agent-Based Analysis of Capacity Withholding and Tacit Collusion in Electricity Markets , 2007, IEEE Transactions on Power Systems.

[3]  Yi Zhou,et al.  A Hybrid Approach for Automatic Generation of Fuzzy Inference Systems without Supervised Learning , 2007, 2007 American Control Conference.

[4]  Carl A. Gunter,et al.  An Integrated Architecture for Demand Response Communications and Control , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[5]  Marco Levorato,et al.  Residential Demand Response Using Reinforcement Learning , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[6]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[7]  Q.B. Dam,et al.  Intelligent Demand Response Scheme for Customer Side Load Management , 2008, 2008 IEEE Energy 2030 Conference.

[8]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[9]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.