A Game-Theoretic Method for Multi-Period Demand Response: Revenue Maximization, Power Allocation, and Asymptotic Behavior

We study a multi-period demand response management problem in the smart grid with multiple utility companies and consumers. The user-utility interactions are modeled by a Stackelberg game where the interactions among the utility companies are captured through a Nash price selection game. It is shown that this game has a unique Stackelberg equilibrium at which the utility companies set prices to maximize their revenues (within a Nash game) while the users respond accordingly to maximize their utilities subject to their budget constraints. Closed-form expressions are provided for the corresponding strategies of the users and the utility companies. It is shown, both analytically and numerically, that the multi-period scheme, compared with the single-period one, provides more incentives for energy consumers to participate in demand response programs. Based on closed-form solutions, a power allocation game for utility companies has been formulated, and it is shown to admit a unique pure-strategy Nash equilibrium, for which a full expression is obtained. We study the asymptotic behavior of the equilibrium strategies when the number of periods and users are large. We find an appropriate company-to-user ratio for the large population regime. For privacy, we provide a distributed algorithm for the computation of all optimal strategies.

[1]  Christos V. Verikoukis,et al.  A Survey on Demand Response Programs in Smart Grids: Pricing Methods and Optimization Algorithms , 2015, IEEE Communications Surveys & Tutorials.

[2]  Walid Saad,et al.  A Game Theoretic Approach for Multi-hop Power Line Communications , 2011, GAMENETS.

[3]  J. G. Slootweg,et al.  Responsiveness of residential electricity demand to dynamic tariffs: Experiences from a large field test in the Netherlands , 2016 .

[4]  P.T. Krein,et al.  Game-Theoretic Control of Small-Scale Power Systems , 2009, IEEE Transactions on Power Delivery.

[5]  Walid Saad,et al.  Challenges in the Smart Grid Applications: An Overview , 2014, Int. J. Distributed Sens. Networks.

[6]  B.F. Wollenberg,et al.  Toward a smart grid: power delivery for the 21st century , 2005, IEEE Power and Energy Magazine.

[7]  Rayadurgam Srikant,et al.  The Mathematics of Internet Congestion Control , 2003 .

[8]  Richard H. Middleton,et al.  Distributed Demand Peak Reduction With Non-Cooperative Players and Minimal Communication , 2019, IEEE Transactions on Smart Grid.

[9]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[10]  Mark O'Malley,et al.  Challenges and barriers to demand response deployment and evaluation , 2015 .

[11]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[12]  D. Chattopadhyay,et al.  A game-theoretic analysis of demand response in electricity markets , 2014, 2014 IEEE PES General Meeting | Conference & Exposition.

[13]  Mohammed H. Albadi,et al.  Demand Response in Electricity Markets: An Overview , 2007, 2007 IEEE Power Engineering Society General Meeting.

[14]  Quanyan Zhu,et al.  A differential game approach to distributed demand side management in smart grid , 2012, 2012 IEEE International Conference on Communications (ICC).

[15]  T. Başar,et al.  A Stackelberg Network Game with a Large Number of Followers , 2002 .

[16]  Walid Saad,et al.  Coalitional Game Theory for Cooperative Micro-Grid Distribution Networks , 2011, 2011 IEEE International Conference on Communications Workshops (ICC).

[17]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[18]  D. Kirschen Demand-side view of electricity markets , 2003 .

[19]  Yan Zhang,et al.  Demand Response Management With Multiple Utility Companies: A Two-Level Game Approach , 2014, IEEE Transactions on Smart Grid.

[20]  Hussein T. Mouftah,et al.  A distributed game theoretic approach to energy trading in the smart grid , 2015, 2015 IEEE Electrical Power and Energy Conference (EPEC).

[21]  Tongxin Zheng,et al.  Marginal loss modeling in LMP calculation , 2004, IEEE Transactions on Power Systems.

[22]  S. Massoud Amin,et al.  Smart Grid: Overview, Issues and Opportunities. Advances and Challenges in Sensing, Modeling, Simulation, Optimization and Control , 2011, Eur. J. Control.

[23]  H. Vincent Poor,et al.  Three-Party Energy Management With Distributed Energy Resources in Smart Grid , 2014, IEEE Transactions on Industrial Electronics.

[24]  Tamer Basar,et al.  Cash-settled options for wholesale electricity markets , 2017, ArXiv.

[25]  Zhong Fan,et al.  A Distributed Demand Response Algorithm and Its Application to PHEV Charging in Smart Grids , 2012, IEEE Transactions on Smart Grid.

[26]  Quanyan Zhu,et al.  Dependable Demand Response Management in the Smart Grid: A Stackelberg Game Approach , 2013, IEEE Transactions on Smart Grid.

[27]  Vincent W. S. Wong,et al.  Autonomous Demand-Side Management Based on Game-Theoretic Energy Consumption Scheduling for the Future Smart Grid , 2010, IEEE Transactions on Smart Grid.

[28]  E. Litvinov,et al.  Energy and Reserve Market Designs with Explicit Consideration to Lost Opportunity Costs , 2002, IEEE Power Engineering Review.

[29]  Chen Chen,et al.  An innovative RTP-based residential power scheduling scheme for smart grids , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Luluwah Al-Fagih,et al.  Recent Advances in Local Energy Trading in the Smart Grid Based on Game-Theoretic Approaches , 2017, IEEE Transactions on Smart Grid.

[31]  Mihaela van der Schaar,et al.  Demand Side Management in Smart Grids Using a Repeated Game Framework , 2013, IEEE Journal on Selected Areas in Communications.

[32]  Walid Saad,et al.  Economics of Electric Vehicle Charging: A Game Theoretic Approach , 2012, IEEE Transactions on Smart Grid.

[33]  R. Srikant,et al.  Revenue-maximizing pricing and capacity expansion in a many-users regime , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[34]  Zhu Han,et al.  Demand side management to reduce Peak-to-Average Ratio using game theory in smart grid , 2012, 2012 Proceedings IEEE INFOCOM Workshops.

[35]  Junkyun Choi,et al.  Evaluation of Demand-Side Management over Pricing Competition of Multiple Suppliers Having Heterogeneous Energy Sources , 2017 .

[36]  F. Richard Yu,et al.  A Game-Theoretical Scheme in the Smart Grid With Demand-Side Management: Towards a Smart Cyber-Physical Power Infrastructure , 2013, IEEE Transactions on Emerging Topics in Computing.

[37]  Kameshwar Poolla,et al.  Systems and Control Opportunities in the Integration of Renewable Energy into the Smart Grid , 2011 .

[38]  Yi Tang,et al.  Game-Theoretic Energy Management for Residential Users with Dischargeable Plug-in Electric Vehicles , 2014 .

[39]  Anthony M. Giacomoni,et al.  Smart Grid — Safe , Secure , Self-Healing Challenges and Opportunities in Power System Security , Resiliency , and Privacy , 2011 .

[40]  Bruce Hajek,et al.  Random Processes for Engineers , 2015 .

[41]  H. Vincent Poor,et al.  Energy management for a user interactive smart community: A Stackelberg game approach , 2014, 2014 IEEE Innovative Smart Grid Technologies - Asia (ISGT ASIA).

[42]  Peter Palensky,et al.  Demand Side Management: Demand Response, Intelligent Energy Systems, and Smart Loads , 2011, IEEE Transactions on Industrial Informatics.

[43]  J. Sherman,et al.  Adjustment of an Inverse Matrix Corresponding to a Change in One Element of a Given Matrix , 1950 .

[44]  Yik-Chung Wu,et al.  Load/Price Forecasting and Managing Demand Response for Smart Grids: Methodologies and Challenges , 2012, IEEE Signal Processing Magazine.

[45]  Quanyan Zhu,et al.  Demand Response Management in the Smart Grid in a Large Population Regime , 2016, IEEE Transactions on Smart Grid.

[46]  Jang-Won Lee,et al.  Residential Demand Response Scheduling With Multiclass Appliances in the Smart Grid , 2016, IEEE Transactions on Smart Grid.

[47]  Walid Saad,et al.  A Game-Theoretic Approach to Energy Trading in the Smart Grid , 2013, IEEE Transactions on Smart Grid.

[48]  Felix F. Wu,et al.  Network reconfiguration in distribution systems for loss reduction and load balancing , 1989 .

[49]  Katherine Hamilton,et al.  Taking Demand Response to the Next Level , 2010, IEEE Power and Energy Magazine.

[50]  H. Farhangi,et al.  The path of the smart grid , 2010, IEEE Power and Energy Magazine.

[51]  Lang Tong,et al.  Day ahead dynamic pricing for demand response in dynamic environments , 2013, 52nd IEEE Conference on Decision and Control.

[52]  Peter Luh,et al.  Load adaptive pricing: An emerging tool for electric utilities , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[53]  Chongqing Kang,et al.  Review and prospect of integrated demand response in the multi-energy system , 2017 .

[54]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[55]  Tamer Basar,et al.  A Stackelberg game for multi-period demand response management in the smart grid , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[56]  Kathleen L. Spees,et al.  Demand Response and Electricity Market Efficiency , 2007 .

[57]  Yan Zhang,et al.  User-Centric Demand Response Management in the Smart Grid With Multiple Providers , 2017, IEEE Transactions on Emerging Topics in Computing.

[58]  Wei Wei,et al.  Energy Pricing and Dispatch for Smart Grid Retailers Under Demand Response and Market Price Uncertainty , 2015, IEEE Transactions on Smart Grid.

[59]  Zhong Fan,et al.  Distributed demand response and user adaptation in smart grids , 2010, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[60]  Alberto Leon-Garcia,et al.  Game-Theoretic Demand-Side Management With Storage Devices for the Future Smart Grid , 2014, IEEE Transactions on Smart Grid.

[61]  Xu Andy Sun,et al.  Adaptive Robust Optimization for the Security Constrained Unit Commitment Problem , 2013, IEEE Transactions on Power Systems.

[62]  Walid Saad,et al.  A noncooperative game for double auction-based energy trading between PHEVs and distribution grids , 2011, 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm).