Ancillary service to the grid from deferrable loads: The case for intelligent pool pumps in Florida

Renewable energy sources such as wind and solar power have a high degree of unpredictability and time-variation, which makes balancing demand and supply challenging. One possible way to address this challenge is to harness the inherent flexibility in demand of many types of loads. We focus on pool pumps, and how they can be used to provide ancillary service to the grid for maintaining demand-supply balance. A Markovian Decision Process (MDP) model is introduced for an individual pool pump. A randomized control architecture is proposed, motivated by the need for decentralized decision making, and the need to avoid synchronization that can lead to large and detrimental spikes in demand. An aggregate model for a large number of pools is then developed by examining the mean field limit. A key innovation is an LTI-system approximation of the aggregate nonlinear model, with a scalar signal as the input and a measure of the aggregate demand as the output. This makes the approximation particularly convenient for control design at the grid level. Simulations are provided to illustrate the accuracy of the approximations and effectiveness of the proposed control approach.

[1]  E. Nummelin.  General irreducible Markov chains and non-negative operators: List of symbols and notation , 1984 .

[2]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[3]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[4]  Vivek S. Borkar,et al.  Convex Analytic Methods in Markov Decision Processes , 2002 .

[5]  S. Meyn,et al.  Large Deviations Asymptotics and the Spectral Theory of Multiplicatively Regular Markov Processes , 2005, math/0509310.

[6]  Emanuel Todorov,et al.  Linearly-solvable Markov decision problems , 2006, NIPS.

[7]  Sean P. Meyn.  Control Techniques for Complex Networks: Workload , 2007 .

[8]  E. Seneta.  Non-negative Matrices and Markov Chains , 2008 .

[9]  Duncan S. Callaway,et al.  Decentralized charging control for large populations of plug-in electric vehicles: Application of the Nash certainty equivalence principle , 2010, 2010 IEEE International Conference on Control Applications.

[10]  Jean-Yves Le Boudec,et al.  Satisfiability of Elastic Demand in the Smart Grid , 2010, ArXiv.

[11]  Sean P. Meyn,et al.  Universal and Composite Hypothesis Testing via Mismatched Divergence , 2009, IEEE Transactions on Information Theory.

[12]  Sean P. Meyn,et al.  How demand response from commercial buildings will provide the regulation needs of the grid , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[13]  Duncan S. Callaway,et al.  Demand Response Providing Ancillary Services A Comparison of Opportunities and Challenges in the US Wholesale Markets , 2012 .

[14]  Hamidou Tembine,et al.  A mean field game analysis of electric vehicles in the smart grid , 2012, 2012 Proceedings IEEE INFOCOM Workshops.

[15]  Sean P. Meyn,et al.  Low-frequency power-grid ancillary services from commercial building HVAC systems , 2013, 2013 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[16]  Sean P. Meyn,et al.  Ancillary service for the grid via control of commercial building HVAC systems , 2013, 2013 American Control Conference.

[17]  Duncan S. Callaway,et al.  State Estimation and Control of Electric Loads to Manage Real-Time Energy Imbalance , 2013, IEEE Transactions on Power Systems.