Incentive Stackelberg Games for Stochastic Linear Systems With $H_\infty$ Constraint

In this paper, incentive Stackelberg games with one leader and multiple followers are investigated for a class of stochastic linear systems with external disturbance. Unlike the existing ordinary Stackelberg games, the leader is required to design an incentive Stackelberg strategy set that can lead to the leader’s team-optimal solution and the follower’s Nash equilibrium, and attenuate the external disturbance in the system simultaneously. It is shown that the incentive Stackelberg strategy set is obtained by solving a set of the cross-coupled stochastic Riccati differential equations in a finite-horizon case and a set of the cross-coupled stochastic algebraic Riccati equations in an infinite-horizon case. Numerical examples are solved to demonstrate the effectiveness of the proposed incentive Stackelberg strategy set.

[1]  Bor-Sen Chen,et al.  Stochastic H2/H∞ control with state-dependent noise , 2004, IEEE Trans. Autom. Control..

[2]  Hiroaki Mukaidani,et al.  Infinite-Horizon Team-Optimal Incentive Stackelberg Games for Linear Stochastic Systems , 2016, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[3]  Tamer Basar,et al.  Equilibrium strategies in dynamic games with multi-levels of hierarchy , 1981, Autom..

[4]  Suresh P. Sethi,et al.  The Maximum Principle for Global Solutions of Stochastic Stackelberg Differential Games , 2012, SIAM J. Control. Optim..

[5]  Jose B. Cruz,et al.  An approach to discrete-time incentive feedback Stackelberg games , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[6]  Huanshui Zhang,et al.  Sufficient and Necessary Open-Loop Stackelberg Strategy for Two-Player Game With Time Delay , 2016, IEEE Transactions on Cybernetics.

[7]  B. Jose,et al.  Closed-Loop Stackelberg Strategies with Applications in the Optimal Control of Multilevel Systems , 2022 .

[8]  Tamer Baar,et al.  Brief papers: Equilibrium strategies in dynamic games with multi-levels of hierarchy , 1981 .

[9]  Peter B. Luh,et al.  A control-theoretic view on incentives , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[10]  Hiroaki Mukaidani,et al.  Multi-objective decision-making problems for discrete-time stochastic systems with state- and disturbance-dependent noise , 2011, IEEE Conference on Decision and Control and European Control Conference.

[11]  Jose B. Cruz,et al.  Stackelberg strategies and incentives in multiperson deterministic decision problems , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  B. Tolwinski.  Closed-loop Stackelberg solution to a multistage linear-quadratic game , 1981 .

[13]  Tsutomu Ishida,et al.  Three-level incentive strategies in differential games , 1983 .

[14]  J. V. Medanic,et al.  Closed-loop Stackelberg strategies in linear-quadratic problems , 1978 .

[15]  K. Mizukami,et al.  Incentive stackelberg strategies in linear quadratic differential games with two noncooperative followers , 1988 .

[16]  Richárd Kicsiny,et al.  Solution for a class of closed-loop leader-follower games with convexity conditions on the payoffs , 2017, Ann. Oper. Res..

[17]  Hiroaki Mukaidani,et al.  Soft-constrained stochastic Nash games for weakly coupled large-scale systems , 2009, Autom..

[18]  Mengmeng Yu,et al.  Supply–demand balancing for power management in smart grid: A Stackelberg game approach , 2016 .

[19]  E. Trélat,et al.  Min-max and min-min stackelberg strategies with closed-loop information structure , 2011 .

[20]  Hiroaki Mukaidani,et al.  Team-optimal Incentive Stackelberg Strategies for Markov Jump Linear Stochastic Systems with H∞ Constraint , 2017 .

[21]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[22]  Hiroaki Mukaidani,et al.  H ∞ -constrained incentive Stackelberg games for discrete-time stochastic systems with multiple followers , 2017 .

[23]  M. T. Qureshi,et al.  Lyapunov Matrix Equation in System Stability and Control , 2008 .

[24]  Bor-Sen Chen,et al.  On stabilizability and exact observability of stochastic systems with their applications , 2023, Autom..

[25]  Hiroaki Mukaidani,et al.  H∞ constraint incentive Stackelberg game for discrete-time stochastic systems , 2017, 2017 American Control Conference (ACC).

[26]  Tamer Basar,et al.  Team-optimal closed-loop Stackelberg strategies in hierarchical control problems , 1980, Autom..

[27]  T. Başar,et al.  Closed-loop Stackelberg strategies with applications in the optimal control of multilevel systems , 1979 .

[28]  C. Chen,et al.  Stackelburg solution for two-person games with biased information patterns , 1972 .