The Evaluation of Agile Demand Response: An Applied Methodology

This paper formulates an applied methodology for an agile demand response using mathematical micromodels. The optimal strategy chosen by an aggregator is the maximization of social welfare derived from demand flexibility. The notion of complex demand bidding is already given in the literature, however heretofore it is formulated as the relationship of price with both demand elasticity and marginal cost along with temporal and profit constraints. Although the planning of flexible demand is already handled by using advance learning techniques in literature, herein simple ${Q}$ -learning technique in a decentralized fashion is proposed. Moreover, trade-offs between the proposed complex bidding rules are explored in a day-ahead market context. Due to the given complex bidding rules and principle of learning, the methodology can be easily applied in active distribution network. Several number of houses, equipped with the proposed complex bidding mechanism and decentralized learning capability, has been simulated, thus illustrating the application of methodology formulated herein.

[1]  Vincent W. S. Wong,et al.  Real-Time Pricing for Demand Response Based on Stochastic Approximation , 2014, IEEE Transactions on Smart Grid.

[2]  Wei Wei,et al.  Energy Pricing and Dispatch for Smart Grid Retailers Under Demand Response and Market Price Uncertainty , 2015, IEEE Transactions on Smart Grid.

[3]  Tom Holvoet,et al.  A Scalable Three-Step Approach for Demand Side Management of Plug-in Hybrid Vehicles , 2013, IEEE Transactions on Smart Grid.

[4]  Farrokh Rahimi Demand Response under the SmartGrid paradigm , 2009, 2009 IEEE/PES Power Systems Conference and Exposition.

[5]  J. G. Slootweg,et al.  Integration of In-Home Electricity Storage systems in a multi-agent active distribution network , 2014, 2014 IEEE PES General Meeting | Conference & Exposition.

[6]  Muhammad Babar,et al.  The rise of AGILE demand response: enabler and foundation for change , 2016 .

[7]  Abdullah Abusorrah,et al.  Demand Response Exchange in the Stochastic Day-Ahead Scheduling With Variable Renewable Generation , 2015, IEEE Transactions on Sustainable Energy.

[8]  Bart De Schutter,et al.  Residential Demand Response Applications Using Batch Reinforcement Learning , 2015, ArXiv.

[9]  Muhammad Babar,et al.  The Consumer Rationality Assumption in Incentive Based Demand Response Program via Reduction Bidding , 2015 .

[10]  Wil L. Kling,et al.  Decentralized Resource Allocation and Load Scheduling for Multicommodity Smart Energy Systems , 2015, IEEE Transactions on Sustainable Energy.

[11]  Ronnie Belmans,et al.  Demand response of a heterogeneous cluster of electric water heaters using batch reinforcement learning , 2014, 2014 Power Systems Computation Conference.

[12]  J.K.A.H.P.J. Kok,et al.  The PowerMatcher: Smart Coordination for the Smart Electricity Grid , 2013 .

[13]  Peter Vrancx,et al.  Convolutional Neural Networks for Automatic State-Time Feature Extraction in Reinforcement Learning Applied to Residential Load Control , 2016, IEEE Transactions on Smart Grid.

[14]  W. Marsden I and J , 2012 .

[15]  Manuel S. Santos,et al.  Analysis of a Numerical Dynamic Programming Algorithm Applied to Economic Models , 1998 .

[16]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[17]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[18]  I. G. Kamphuis,et al.  The development of demand elasticity model for demand response in the retail market environment , 2015, 2015 IEEE Eindhoven PowerTech.

[19]  Marina Gonzalez Vaya,et al.  Optimal bidding strategy of a plug-in electric vehicle aggregator in day-ahead electricity markets , 2013, 2013 10th International Conference on the European Energy Market (EEM).

[20]  Kankar Bhattacharya,et al.  A generic operations framework for discos in retail electricity markets , 2009, 2009 IEEE/PES Power Systems Conference and Exposition.

[21]  Fulli Gianluca,et al.  Smart Grid Projects Outlook 2014 , 2014 .