Building load management clusters using reinforcement learning

In this paper we introduce a customer selection model for decision making in a Demand response program. In particular, we focus on modelling demand response as a reinforcement learning problem that decomposes the customers into clusters based on their ability to provide curtailments at time of Demand response signal. The reinforcement learning approach allows the retailer to make fast informed decision on the customers reliable to provide demand management capabilities without the need of exploring the entire set of customers when needed in real-time and allow for classification of future customers in appropriate clusters. We demonstrate using this approach on a representative example to create clusters based on provided customer profiles for varying DR signals.

[1]  Lisa Werner,et al.  Principles of forecasting: A handbook for researchers and practitioners , 2002 .

[2]  François Bouffard,et al.  An online framework for integration of demand response in residential load management , 2017, 2017 IEEE Electrical Power and Energy Conference (EPEC).

[3]  D. Kirschen,et al.  Factoring the elasticity of demand in electricity prices , 2000 .

[4]  G. Rizzoni,et al.  A highly resolved modeling technique to simulate residential power demand , 2013 .

[5]  Francois Bouffard,et al.  Demand Response in Smart Grids , 2015 .

[6]  François Bouffard,et al.  Integrating Demand Response into agent-based models of electricity markets , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[7]  Gilbert M. Masters,et al.  Renewable and Efficient Electric Power Systems , 2004 .

[8]  Yik-Chung Wu,et al.  Load/Price Forecasting and Managing Demand Response for Smart Grids: Methodologies and Challenges , 2012, IEEE Signal Processing Magazine.

[9]  Viktor K. Prasanna,et al.  Curtailment Estimation Methods for Demand Response: Lessons Learned by Comparing Apples to Oranges , 2015, e-Energy.

[10]  Ian A. Hiskens,et al.  Achieving Controllability of Electric Loads , 2011, Proceedings of the IEEE.

[11]  Soummya Kar,et al.  Using smart devices for system-level management and control in the smart grid: A reinforcement learning framework , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[12]  Silja Meyer-Nieberg,et al.  Electric load forecasting methods: Tools for decision making , 2009, Eur. J. Oper. Res..

[13]  Ismet Erkmen,et al.  Intelligent short-term load forecasting in Turkey , 2006 .

[14]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[15]  Leon M. Tolbert,et al.  A method for modeling household occupant behavior to simulate residential energy consumption , 2014, ISGT 2014.

[16]  V. Geros,et al.  Modeling and predicting building's energy use with artificial neural networks: Methods and results , 2006 .

[17]  Z. Styczynski,et al.  Application of statistical and neural approaches to the daily load profiles modelling in power distribution systems , 1999, 1999 IEEE Transmission and Distribution Conference (Cat. No. 99CH36333).