Hierarchical Structures and Leadership Design in Mean-Field-Type Games with Polynomial Cost

This article presents a class of hierarchical mean-field-type games with multiple layers and non-quadratic polynomial costs. The decision-makers act in sequential order with informational differences. We first examine the single-layer case where each decision-maker does not have the information about the other control strategies. We derive the Nash mean-field-type equilibrium and cost in a linear state-and-mean-field feedback form by using a partial integro-differential system. Then, we examine the Stackelberg two-layer problem with multiple leaders and multiple followers. Numerical illustrations show that, in the symmetric case, having only one leader is not necessarily optimal for the total sum cost. Having too many leaders may also be suboptimal for the total sum cost. The methodology is extended to multi-level hierarchical systems. It is shown that the order of the play plays a key role in the total performance of the system. We also identify a specific range of parameters for which the Nash equilibrium coincides with the hierarchical solution independently of the number of layers and the order of play. In the heterogeneous case, it is shown that the total cost is significantly affected by the design of the hierarchical structure of the problem.

[1]  Hamidou Tembine,et al.  Mean-field-type games , 2017 .

[2]  Jingtao Shi,et al.  Leader-follower stochastic differential game with asymmetric information and applications , 2015, Autom..

[3]  T. Başar,et al.  Closed-loop Stackelberg strategies with applications in the optimal control of multilevel systems , 1979 .

[4]  Alain Bensoussan,et al.  Linear-Quadratic Mean Field Stackelberg Games with State and Control Delays , 2017, SIAM J. Control. Optim..

[5]  Юрий Владимирович Авербух Stackelberg solution of first-order mean field game with a major player , 2018 .

[6]  Hamidou Tembine,et al.  Risk-sensitive mean-field-type games with Lp-norm drifts , 2015, Autom..

[7]  Daniel Andersson,et al.  A Maximum Principle for SDEs of Mean-Field Type , 2011 .

[8]  Jr. J. Cruz,et al.  Leader-follower strategies for multilevel systems , 1978 .

[9]  Hamidou Tembine,et al.  Linear-Quadratic Mean-Field-Type Games: A Direct Method , 2018, Games.

[10]  Hamidou Tembine,et al.  Linear-Quadratic Mean-Field-Type Games With Multiple Input Constraints , 2019, IEEE Control Systems Letters.

[11]  Tamer Basar,et al.  Linear quadratic mean field Stackelberg differential games , 2018, Autom..

[12]  Hamidou Tembine,et al.  Mean-Field-Type Games in Engineering , 2016, ArXiv.

[13]  Hamidou Tembine,et al.  Mean-Field-Type Games with Jump and Regime Switching , 2020, Dyn. Games Appl..

[14]  Zhen Wu,et al.  Linear-Quadratic Stackelberg Game for Mean-Field Backward Stochastic Differential System and Application , 2019, Mathematical Problems in Engineering.

[15]  Guoqiang Hu,et al.  Distributed Tracking Control of an Interconnected Leader–Follower Multiagent System , 2017, IEEE Transactions on Automatic Control.

[16]  Boualem Djehiche,et al.  A General Stochastic Maximum Principle for SDEs of Mean-field Type , 2011 .

[17]  Liping Pan,et al.  A differential game with multi-level of hierarchy , 1991 .

[18]  T. Başar,et al.  Stackelberg strategies in linear-quadratic stochastic differential games , 1981 .

[19]  J. Cruz,et al.  On the Stackelberg strategy in nonzero-sum games , 1973 .

[20]  Panayiotis Theodossiou,et al.  Skewness and the Relation Between Risk and Return , 2016, Manag. Sci..

[21]  Weihai Zhang,et al.  An Open-Loop Stackelberg Strategy for the Linear Quadratic Mean-Field Stochastic Differential Game , 2019, IEEE Transactions on Automatic Control.

[22]  Jiongmin Yong,et al.  Linear Quadratic Stochastic Differential Games: Open-Loop and Closed-Loop Saddle Points , 2014, SIAM J. Control. Optim..

[23]  Suresh P. Sethi,et al.  The Maximum Principle for Global Solutions of Stochastic Stackelberg Differential Games , 2012, SIAM J. Control. Optim..

[24]  B. Gardner,et al.  Feedback Stackelberg strategy for M-level hierarchical games , 1978 .

[25]  Alain Bensoussan,et al.  Mean Field Stackelberg Games: Aggregation of Delayed Instructions , 2015, SIAM J. Control. Optim..

[26]  Hamidou Tembine,et al.  Linear–Quadratic Mean-Field-Type Games: Jump–Diffusion Process With Regime Switching , 2019, IEEE Transactions on Automatic Control.

[27]  Tongwen Chen,et al.  False Data Injection Attacks on Networked Control Systems: A Stackelberg Game Analysis , 2018, IEEE Transactions on Automatic Control.

[28]  Peter E. Caines,et al.  Mean Field LQG Control in Leader-Follower Stochastic Multi-Agent Systems: Likelihood Ratio Based Adaptation , 2012, IEEE Transactions on Automatic Control.