Discrete-Time Robust Hierarchical Linear-Quadratic Dynamic Games

In this paper, the theory of robust min–max control is extended to hierarchical and multiplayer dynamic games for linear quadratic discrete time systems. The proposed game model consists of one leader and many followers, while the performance of all players is affected by disturbance. The Stackelberg–Nash-saddle equilibrium point of the game is derived and a necessary and sufficient condition for the existence and uniqueness of such a solution is obtained. In the infinite time horizon, it is shown that the solution of the Riccati equation is upper bounded under a condition that is called individual controllability. By assuming such a condition and using a time-varying Lyapunov function the input-to-state stability of the hierarchical dynamic game is achieved, considering the optimal feedback strategies of the players and an arbitrary disturbance as the input.

[1]  Daniel Pérez Palomar,et al.  Noncooperative and Cooperative Optimization of Distributed Energy Generation and Storage in the Demand-Side of the Smart Grid , 2013, IEEE Transactions on Signal Processing.

[2]  Vincent W. S. Wong,et al.  Autonomous Demand-Side Management Based on Game-Theoretic Energy Consumption Scheduling for the Future Smart Grid , 2010, IEEE Transactions on Smart Grid.

[3]  Tansu Alpcan,et al.  Network Security , 2010 .

[4]  J. Schumacher,et al.  Robust Equilibria in Indefinite Linear-Quadratic Differential Games , 2003 .

[5]  Gábor Kun,et al.  Optimal Control of Disturbed Linear-Quadratic Differential Games , 2002, Eur. J. Control.

[6]  Dusit Niyato,et al.  Competitive Pricing for Spectrum Sharing in Cognitive Radio Networks: Dynamic Game, Inefficiency of Nash Equilibrium, and Collusion , 2008, IEEE Journal on Selected Areas in Communications.

[7]  Dusit Niyato,et al.  Pricing, Spectrum Sharing, and Service Selection in Two-Tier Small Cell Networks: A Hierarchical Dynamic Game Approach , 2014, IEEE Transactions on Mobile Computing.

[8]  Chi-Tsong Chen,et al.  Linear System Theory and Design , 1995 .

[9]  Tianyou Chai,et al.  Necessary and Sufficient Condition for Two-Player Stackelberg Strategy , 2015, IEEE Transactions on Automatic Control.

[10]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[11]  Quanyan Zhu,et al.  Game theory meets network security and privacy , 2013, CSUR.

[12]  B. Gardner,et al.  Feedback Stackelberg strategy for M-level hierarchical games , 1978 .

[13]  D. Lukes.  Equilibrium Feedback Control in Linear Games with Quadratic Costs , 1971 .

[14]  Tamer Basar,et al.  Team-optimal closed-loop Stackelberg strategies in hierarchical control problems , 1980, Autom..

[15]  J. Engwerda.  Robust open‐loop Nash equilibria in the noncooperative LQ game revisited , 2017 .

[16]  Yu-Chung Tsao,et al.  Retailer shelf-space management with trade allowance: A Stackelberg game between retailer and manufacturers , 2014 .

[17]  J. B. Cruz,et al.  Bidding strategies in oligopolistic dynamic electricity double-sided auctions , 2005, IEEE Transactions on Power Systems.

[18]  Tamer Basar,et al.  Control over lossy networks: A dynamic game approach , 2014, 2014 American Control Conference.

[19]  Tamer Başar,et al.  H1-Optimal Control and Related Minimax Design Problems , 1995 .

[20]  T. Basar,et al.  H∞-0ptimal Control and Related Minimax Design Problems: A Dynamic Game Approach , 1996, IEEE Trans. Autom. Control..

[21]  George Q. Huang,et al.  Stackelberg game-theoretic model for optimizing advertising, pricing and inventory policies in vendor managed inventory (VMI) production supply chains , 2009, Comput. Ind. Eng..

[22]  Marc Jungers,et al.  On Linear-Quadratic Stackelberg Games With Time Preference Rates , 2008, IEEE Transactions on Automatic Control.

[23]  Zhu Han,et al.  Dynamics of Multiple-Seller and Multiple-Buyer Spectrum Trading in Cognitive Radio Networks: A Game-Theoretic Modeling Approach , 2009, IEEE Transactions on Mobile Computing.

[24]  Tamer Basar,et al.  Control over TCP-like lossy networks: A dynamic game approach , 2013, 2013 American Control Conference.

[25]  Ilya V. Kolmanovsky,et al.  Game Theory Controller for Hybrid Electric Vehicles , 2014, IEEE Transactions on Control Systems Technology.

[26]  J. B. Cruz,et al.  Disturbance attenuation analysis of state feedback Nash strategy for two-player Linear Quadratic Sequential Games , 2007, 2007 European Control Conference (ECC).