Multi-Resolution Large Population Stochastic Differential Games and Their Application to Demand Response Management in the Smart Grid

Dynamic demand response (DR) management is becoming an integral part of power system and market operational practice. Motivated by the smart grid DR management problem, we propose a multi-resolution stochastic differential game-theoretic framework to model the players’ intra-group and inter-group interactions in a large population regime. We study the game in both risk-neutral and risk-sensitive settings, and provide closed-form solutions for symmetric mean-field responses in the case of homogeneous group populations, and characterize the symmetric mean-field Nash equilibrium using the Hamilton–Jacobi–Bellman (HJB) equation together with the Fokker–Planck–Kolmogorov (FPK) equation. Finally, we apply the framework to the smart grid DR management problem and illustrate with a numerical example.

[1]  Yasuo Tanabe,et al.  The propagation of chaos for interacting individuals in a large population , 2006, Math. Soc. Sci..

[2]  Eitan Altman,et al.  A survey on networking games in telecommunications , 2006, Comput. Oper. Res..

[3]  Tamer Basar,et al.  H∞-Optimal Control and Related , 1991 .

[4]  Jose Medina,et al.  Demand Response and Distribution Grid Operations: Opportunities and Challenges , 2010, IEEE Transactions on Smart Grid.

[5]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[6]  D. Symanski.  The Operating Experiences and Performance Characteristics During the First Year of Operation of the Crotched MT. New Hampshire Windfarm , 1983, IEEE Transactions on Power Apparatus and Systems.

[7]  Hamidou Tembine,et al.  Mean field stochastic games: Convergence, Q/H-learning and optimality , 2011, Proceedings of the 2011 American Control Conference.

[8]  A. Coolen.  The mathematical theory of minority games : statistical mechanics of interacting agents , 2005 .

[9]  T. Başar,et al.  Risk-sensitive mean field stochastic differential games , 2011 .

[10]  Thomas Garrity,et al.  Getting Smart , 2008, IEEE Power and Energy Magazine.

[11]  Quanyan Zhu,et al.  Hybrid risk-sensitive mean-field stochastic differential games with application to molecular biology , 2011, IEEE Conference on Decision and Control and European Control Conference.

[12]  A. V. Meier.  Electric power systems : a conceptual introduction , 2006 .

[13]  Quanyan Zhu,et al.  A differential game approach to distributed demand side management in smart grid , 2012, 2012 IEEE International Conference on Communications (ICC).

[14]  Quanyan Zhu,et al.  A game-theoretic framework for control of distributed renewable-based energy resources in smart grids , 2012, 2012 American Control Conference (ACC).

[15]  T. Başar,et al.  A Stackelberg Network Game with a Large Number of Followers , 2002 .

[16]  Goran Strbac,et al.  Demand side management: Benefits and challenges ☆ , 2008 .

[17]  Quanyan Zhu,et al.  Game theory meets network security and privacy , 2013, CSUR.

[18]  P. Lions,et al.  Mean field games , 2007 .

[19]  Farrokh Albuyeh,et al.  Grid of the future , 2009, IEEE Power and Energy Magazine.

[20]  Catherine Rosenberg,et al.  A game theoretic framework for bandwidth allocation and pricing in broadband networks , 2000, TNET.

[21]  Panos Parpas,et al.  A stochastic multiscale model for electricity generation capacity expansion , 2013, Eur. J. Oper. Res..

[22]  Mohammed H. Albadi,et al.  Demand Response in Electricity Markets: An Overview , 2007, 2007 IEEE Power Engineering Society General Meeting.

[23]  D. Kirschen.  Demand-side view of electricity markets , 2003 .

[24]  Quanyan Zhu,et al.  Price of anarchy and price of information in N-person linear-quadratic differential games , 2010, Proceedings of the 2010 American Control Conference.

[25]  Quanyan Zhu,et al.  Risk-Sensitive Mean-Field Games , 2012, IEEE Transactions on Automatic Control.

[26]  Quanyan Zhu,et al.  Dynamic Interference Minimization Routing Game for On-Demand Cognitive Pilot Channel , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[27]  T. Basar,et al.  H∞-0ptimal Control and Related Minimax Design Problems: A Dynamic Game Approach , 1996, IEEE Trans. Autom. Control..

[28]  Quanyan Zhu,et al.  Prices of Anarchy, Information, and Cooperation in Differential Games , 2011, Dyn. Games Appl..

[29]  Hamidou Tembine,et al.  A mean field game analysis of electric vehicles in the smart grid , 2012, 2012 Proceedings IEEE INFOCOM Workshops.

[30]  Clark W Gellings,et al.  The Smart Grid: Enabling Energy Efficiency and Demand Response , 2020 .

[31]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[32]  Zhu Han,et al.  Smart Grid Communications and Networking: Smart grid and wide-area networks , 2012 .

[33]  F. Richard Yu,et al.  An energy-efficient cooperative spectrum sensing scheme for cognitive radio networks , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[34]  Quanyan Zhu,et al.  A constrained evolutionary Gaussian multiple access channel game , 2009, 2009 International Conference on Game Theory for Networks.

[35]  T. Başar,et al.  Dynamic Noncooperative Game Theory, 2nd Edition , 1998 .

[36]  Quanyan Zhu,et al.  Dynamic Secure Routing Game in Distributed Cognitive Radio Networks , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.