Mean field game based control of dispersed energy storage devices with constrained inputs

In this paper, we study the mean field control of a large population of electric space heaters with linear dynamics and saturation constraints on the inputs. The mean field model is described by the fixed point of a system of coupled partial differential equations. A numerical algorithm is proposed to find this fixed point, which takes advantage of the special form of the individual control problem. We derive a decentralized control mechanism based on the mean field equilibrium solution under which the mean temperature of the population follows a set target temperature, while controls for each device are generated locally and attempt to keep individual temperature deviations small. We illustrate the results using numerical simulations, and compare the solutions obtained to the case where control inputs are unconstrained.

[1]  Arman C. Kizilkale,et al.  Collective Target Tracking Mean Field Control for Markovian Jump-Driven Models of Electric Water Heating Loads , 2014 .

[2]  Arman C. Kizilkale,et al.  A class of collective target tracking problems in energy systems: Cooperative versus non-cooperative mean field control solutions , 2014, 53rd IEEE Conference on Decision and Control.

[3]  Andreas Kugi,et al.  Handling constraints in optimal control with saturation functions and system extension , 2010, Syst. Control. Lett..

[4]  Donald E. Kirk,et al.  Optimal control theory : an introduction , 1970 .

[5]  John Lygeros,et al.  On the range of feasible power trajectories for a population of thermostatically controlled loads , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[6]  R. Goebel,et al.  Continuous time constrained linear quadratic regulator - convex duality approach , 2005, Proceedings of the 2005, American Control Conference, 2005..

[7]  Stephan Koch,et al.  Potentials and applications of coordinated groups of thermal household appliances for power system control purposes , 2009, 2009 IEEE PES/IAS Conference on Sustainable Alternative Energy (SAE).

[8]  Arman C. Kizilkale,et al.  Mean field based control of power system dispersed energy storage devices for peak load relief , 2013, 52nd IEEE Conference on Decision and Control.

[9]  E. Boukas,et al.  Constrained Linear Quadratic Regulator : Continuous-Time Case , 2008 .

[10]  P. Cardaliaguet,et al.  Mean Field Games , 2020, Lecture Notes in Mathematics.

[11]  George M. Siouris,et al.  Applied Optimal Control: Optimization, Estimation, and Control , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  van Stef Stef Eijndhoven,et al.  Linear quadratic regulator problem with positive controls , 1997, 1997 European Control Conference (ECC).

[13]  James B. Rawlings,et al.  Constrained linear quadratic regulation , 1998, IEEE Trans. Autom. Control..

[14]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[15]  Eduardo D. Sontag,et al.  Mathematical Control Theory: Deterministic Finite Dimensional Systems , 1990 .

[16]  Duncan S. Callaway.  Tapping the energy storage potential in electric loads to deliver load following and regulation, with application to wind energy , 2009 .

[17]  Fabian Mueller,et al.  Metrics for evaluating the impacts of intermittent renewable generation on utility load-balancing , 2012 .

[18]  R. Malhamé,et al.  Electric load model synthesis by diffusion approximation of a high-order hybrid-state stochastic system , 1985 .

[19]  Roland P. Malhamé,et al.  A physically-based computer model of aggregate electric water heating loads , 1994 .

[20]  R. LeVeque.  Numerical methods for conservation laws , 1990 .

[21]  Francesca Parise,et al.  Decentralized Convergence to Nash Equilibria in Constrained Deterministic Mean Field Control , 2014, IEEE Transactions on Automatic Control.

[22]  G. Goodwin,et al.  Global analytical model predictive control with input constraints , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[23]  Francesca Parise,et al.  Decentralized Convergence to Nash Equilibria in Constrained Mean Field Control. , 2014 .

[24]  Torgeir Ericson,et al.  Direct load control of residential water heaters , 2009 .

[25]  M. W. Gustafson,et al.  Direct water heater load control-estimating program effectiveness using an engineering model , 1993 .

[26]  Dario Bauso,et al.  Mean-Field Games and Dynamic Demand Management in Power Grids , 2014, Dyn. Games Appl..

[27]  Francesca Parise,et al.  A Mean Field control approach for demand side management of large populations of Thermostatically Controlled Loads , 2015, 2015 European Control Conference (ECC).

[28]  Alberto Bemporad,et al.  The explicit solution of model predictive control via multiparametric quadratic programming , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[29]  N. Petit,et al.  Constructive Methods for Initialization and Handling Mixed State-Input Constraints in Optimal Control , 2008 .

[30]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..