Event-Triggered Strategy Design for Discrete-Time Nonlinear Quadratic Games With Disturbance Compensations: The Noncooperative Case

In this paper, the event-triggered strategy design problem is addressed for a class of discrete-time nonlinear quadratic noncooperative games subject to matched disturbances. The event-triggered scheme is proposed based on the relative error of the input signals with aim to determine whether such signals should be transmitted to the actuator or not. The disturbance-observer-based game strategy is put forward to compensate the matched disturbance and also optimize the individual cost function for each player. The main purpose of the addressed problem is to design the time-varying strategy parameters such that the upper bound of the individual cost function of each player is minimized unilaterally over a finite horizon $[{0,N}]$ . Sufficient conditions are first established for the existence and uniqueness of the game strategies through backward Riccati-like recursions and then the desired strategy parameters are computed iteratively by utilizing the Moore–Penrose pseudo inverse. Finally, a simulation example is provided to verify the effectiveness of the proposed design method.

[1]  Tingwen Huang,et al.  Cooperative Distributed Optimization in Multiagent Networks With Delays , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[2]  Huaguang Zhang,et al.  An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games , 2011, Autom..

[3]  Hamid Reza Karimi,et al.  A linear matrix inequality approach to robust fault detection filter design of linear systems with mixed time-varying delays and nonlinear perturbations , 2010, J. Frankl. Inst..

[4]  Haopeng Zhang,et al.  Optimal balanced coordinated network resource allocation using swarm optimization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[5]  Tianyou Chai,et al.  Necessary and Sufficient Condition for Two-Player Stackelberg Strategy , 2015, IEEE Transactions on Automatic Control.

[6]  Marcus Johnson,et al.  Approximate $N$ -Player Nonzero-Sum Game Solution for an Uncertain Continuous Nonlinear System , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Huaguang Zhang,et al.  A New Approach to Solve a Class of Continuous-Time Nonlinear Quadratic Zero-Sum Game Using ADP , 2008, 2008 IEEE International Conference on Networking, Sensing and Control.

[8]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[9]  Donghua Zhou,et al.  Event-Based $H_{\infty}$ Consensus Control of Multi-Agent Systems With Relative Output Feedback: The Finite-Horizon Case , 2015, IEEE Transactions on Automatic Control.

[10]  Fuad E. Alsaadi,et al.  $H_\infty $ Control for 2-D Fuzzy Systems With Interval Time-Varying Delays and Missing Measurements , 2017, IEEE Transactions on Cybernetics.

[11]  Fuad E. Alsaadi,et al.  Robust ${\mathscr {H}}_{\infty }$ Filtering for a Class of Two-Dimensional Uncertain Fuzzy Systems With Randomly Occurring Mixed Delays , 2017, IEEE Transactions on Fuzzy Systems.

[12]  Jinde Cao,et al.  A New Framework for Analysis on Stability and Bifurcation in a Class of Neural Networks With Discrete and Distributed Delays , 2015, IEEE Transactions on Cybernetics.

[13]  Michael V. Basin,et al.  Central suboptimal H∞ filter design for linear time-varying systems with state and measurement delays , 2008, 2008 47th IEEE Conference on Decision and Control.

[14]  S. Shankar Sastry,et al.  Energy management via pricing in LQ dynamic games , 2013, 2013 American Control Conference.

[15]  Lei Guo,et al.  Resilient Control of Networked Control System Under DoS Attacks: A Unified Game Approach , 2016, IEEE Transactions on Industrial Informatics.

[16]  Dong Yue,et al.  A Delay System Method for Designing Event-Triggered Controllers of Networked Control Systems , 2013, IEEE Transactions on Automatic Control.

[17]  James Lam,et al.  Constrained predictive control synthesis for quantized systems with Markovian data loss , 2015, Autom..

[18]  Raquel Caballero-Águila,et al.  Optimal state estimation for networked systems with random parameter matrices, correlated noises and delayed measurements , 2015, Int. J. Gen. Syst..

[19]  Xinghuo Yu,et al.  High-Order Mismatched Disturbance Compensation for Motion Control Systems Via a Continuous Dynamic Sliding-Mode Approach , 2014, IEEE Transactions on Industrial Informatics.

[20]  Zidong Wang,et al.  Event-based security control for discrete-time stochastic systems , 2016 .

[21]  Alexander S. Poznyak,et al.  ε-Equilibrium in LQ differential games with bounded uncertain disturbances: robustness of standard strategies and new strategies with adaptation , 2006 .

[22]  Chen Peng,et al.  Event-triggered communication and H∞H∞ control co-design for networked control systems , 2013, Autom..

[23]  Jun Hu,et al.  Extended Kalman filtering with stochastic nonlinearities and multiple missing measurements , 2012, Autom..

[24]  Dan Shen,et al.  A Game Theoretic Data Fusion Aided Path Planning Approach for Cooperative UAV ISR , 2008, 2008 IEEE Aerospace Conference.

[25]  Quanyan Zhu,et al.  Price of anarchy and price of information in N-person linear-quadratic differential games , 2010, Proceedings of the 2010 American Control Conference.

[26]  Dan Simon,et al.  A game theory approach to constrained minimax state estimation , 2006, IEEE Transactions on Signal Processing.

[27]  George Leitmann,et al.  On ultimate boundedness control of uncertain systems in the absence of matching assumptions , 1982 .

[28]  Michael V. Basin,et al.  Central suboptimal H ∞ filter design for linear time-varying systems with state and measurement delays , 2010, Int. J. Syst. Sci..

[29]  Fuchun Sun,et al.  Resilient control of cyber-physical systems against intelligent attacker: a hierarchal stackelberg game approach , 2016, Int. J. Syst. Sci..

[30]  Wen-Hua Chen,et al.  Nonlinear Disturbance Observer-Enhanced Dynamic Inversion Control of Missiles , 2003 .

[31]  Songyin Cao,et al.  Anti-Disturbance Control for Systems with Multiple Disturbances , 2013 .

[32]  Huijun Gao,et al.  Finite-Horizon $H_{\infty} $ Filtering With Missing Measurements and Quantization Effects , 2013, IEEE Transactions on Automatic Control.

[33]  Haoyong Chen,et al.  Differential games based load frequency control of interconnected power system , 2013, 2013 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC).

[34]  Jose B. Cruz,et al.  Adaptive Noncooperative $N$-Person Games With Unknown General Quadratic Objectives , 2010, IEEE Transactions on Control Systems Technology.

[35]  Jiaping Wang,et al.  Mean value inequalities , 1999 .

[36]  Quanyan Zhu,et al.  Heterogeneous learning in zero-sum stochastic games with incomplete information , 2011, 49th IEEE Conference on Decision and Control (CDC).

[37]  Hamid Reza Karimi,et al.  Disturbance observer-based disturbance attenuation control for a class of stochastic systems , 2016, Autom..

[38]  Xiaodong Wang,et al.  Stochastic Optimal Linear Control of Wireless Networked Control Systems with Delays and Packet Losses , 2014, ArXiv.

[39]  Hong Wang,et al.  Fault Diagnosis and Tolerant Control for Discrete Stochastic Distribution Collaborative Control Systems , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[40]  Michael V. Basin,et al.  Open-loop Nash equilibrium in polynomial differential games via state-dependent Riccati equation , 2013, 2013 American Control Conference.

[41]  Huanshui Zhang,et al.  Sufficient and Necessary Open-Loop Stackelberg Strategy for Two-Player Game With Time Delay , 2016, IEEE Transactions on Cybernetics.

[42]  Yichuan Jiang,et al.  Diffusion in Social Networks: A Multiagent Perspective , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[43]  Derui Ding,et al.  Event-triggered consensus control for discrete-time stochastic multi-agent systems: The input-to-state stability in probability , 2015, Autom..

[44]  Yang Xu,et al.  Event-Driven Control for Networked Control Systems With Quantization and Markov Packet Losses , 2017, IEEE Transactions on Cybernetics.

[45]  Jun Yang,et al.  Disturbance Observer-Based Control: Methods and Applications , 2014 .

[46]  Yugyung Lee,et al.  SMARTSPACE: Multiagent Based Distributed Platform for Semantic Service Discovery , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[47]  Bernard Yannou,et al.  Resolving Design Conflicts and Evaluating Solidarity in Distributed Design , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[48]  Naixue Xiong,et al.  A class of general transient faults propagation analysis for networked control systems , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[49]  Donghua Zhou,et al.  Event-Based Distributed Filtering With Stochastic Measurement Fading , 2015, IEEE Transactions on Industrial Informatics.