Two-Level Game-Based Distributed Optimal Fault-Tolerant Control for Nonlinear Interconnected Systems

This article addresses the distributed optimal fault-tolerant control (FTC) issue by using the two-level game approach for a class of nonlinear interconnected systems, in which each subsystem couples with its neighbors through not only the states but also the inputs. At the first level, the FTC problem for each subsystem is formulated as a zero-sum differential game, in which the controller and the fault are regarded as two players with opposite interests. At the second level, the whole interconnected system is formulated as a graphical game, in which each subsystem is a player to achieve the global Nash equilibrium for the overall system. The rigorous proof of the stability of the interconnected system is given by means of the cyclic-small-gain theorem, and the relationship between the local optimality and the global optimality is analyzed. Moreover, based on the adaptive dynamic programming (ADP) technology, a distributed optimal FTC learning scheme is proposed, in which a group of critic neural networks (NNs) are established to approximate the cost functions. Finally, an example is taken to illustrate the efficiency and applicability of the obtained theoretical results.

[1]  Derong Liu,et al.  Decentralized Stabilization for a Class of Continuous-Time Nonlinear Interconnected Systems Using Online Learning Optimal Control Approach , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[2]  David J. Hill,et al.  Lyapunov formulation of ISS cyclic-small-gain in continuous-time dynamical networks , 2011, Autom..

[3]  Huaguang Zhang,et al.  Leader-Based Optimal Coordination Control for the Consensus Problem of Multiagent Differential Games via Fuzzy Adaptive Dynamic Programming , 2015, IEEE Transactions on Fuzzy Systems.

[4]  Andrew J. Sinclair,et al.  Nonlinear Control for Spacecraft Pursuit-Evasion Game Using the State-Dependent Riccati Equation Method , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[5]  Kun Zhang,et al.  Adaptive Fuzzy Fault-Tolerant Tracking Control for Partially Unknown Systems With Actuator Faults via Integral Reinforcement Learning Method , 2019, IEEE Transactions on Fuzzy Systems.

[6]  Shaocheng Tong,et al.  Observer-Based Adaptive Fuzzy Fault-Tolerant Optimal Control for SISO Nonlinear Systems , 2019, IEEE Transactions on Cybernetics.

[7]  Guang-Hong Yang,et al.  Active Complementary Control for Affine Nonlinear Control Systems With Actuator Faults , 2017, IEEE Transactions on Cybernetics.

[8]  Frank L. Lewis,et al.  Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton-Jacobi equations , 2011, Autom..

[9]  P. Olver Nonlinear Systems , 2013 .

[10]  Naixue Xiong,et al.  A class of general transient faults propagation analysis for networked control systems , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Frank L. Lewis,et al.  Multi-agent zero-sum differential graphical games for disturbance rejection in distributed control , 2016, Autom..

[12]  Jingliang Sun,et al.  Decentralised zero-sum differential game for a class of large-scale interconnected systems via adaptive dynamic programming , 2019, Int. J. Control.

[13]  Shaocheng Tong,et al.  Adaptive Fuzzy Robust Fault-Tolerant Optimal Control for Nonlinear Large-Scale Systems , 2018, IEEE Transactions on Fuzzy Systems.

[14]  N. Eva Wu,et al.  Control reconfigurability of linear time-invariant systems , 2000, Autom..

[15]  Bin Jiang,et al.  Fault-Tolerant Control of Multilayer Interconnected Nonlinear Systems: An Inclusion Principle Approach , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[16]  Peng Shi,et al.  A New Approach to Characterize Successive Packet Losses in Stochastic Networked Systems , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Guang-Hong Yang,et al.  Distributed adaptive robust tracking and model matching control with actuator faults and interconnection failures , 2009 .

[18]  Avimanyu Sahoo,et al.  A Min–Max Approach to Event- and Self-Triggered Sampling and Regulation of Linear Systems , 2019, IEEE Transactions on Industrial Electronics.

[19]  Huibert Kwakernaak,et al.  Linear Optimal Control Systems , 1972 .

[20]  Yi Zheng,et al.  Networked Coordination-Based Distributed Model Predictive Control for Large-Scale System , 2013, IEEE Transactions on Control Systems Technology.

[21]  Hiroaki Mukaidani,et al.  A numerical analysis of the Nash strategy for weakly coupled large-scale systems , 2006, IEEE Transactions on Automatic Control.

[22]  Jiang Bin Fault accommodation for a class of nonlinear systems based on neural network observer , 2007 .

[23]  Li Jia,et al.  Research on directed fault propagation graph model and optimization , 2009, 2009 9th International Conference on Electronic Measurement & Instruments.

[24]  Marcus Johnson,et al.  Approximate $N$ -Player Nonzero-Sum Game Solution for an Uncertain Continuous Nonlinear System , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Derong Liu,et al.  Observer based adaptive dynamic programming for fault tolerant control of a class of nonlinear systems , 2017, Inf. Sci..

[26]  Sarangapani Jagannathan,et al.  Event-Triggered Distributed Approximate Optimal State and Output Control of Affine Nonlinear Interconnected Systems , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Frank L. Lewis,et al.  Adaptive Optimal Control of Unknown Constrained-Input Systems Using Policy Iteration and Neural Networks , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Frank L. Lewis,et al.  Multi-agent differential graphical games , 2011, Proceedings of the 30th Chinese Control Conference.

[29]  Bin Jiang,et al.  Decentralized Fault Tolerant Control for a Class of Interconnected Nonlinear Systems , 2018, IEEE Transactions on Cybernetics.

[30]  Jianbin Qiu,et al.  Network-Based Fuzzy Control for Nonlinear Industrial Processes With Predictive Compensation Strategy , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[31]  Guang-Hong Yang,et al.  Neural-Network-Based Adaptive Decentralized Fault-Tolerant Control for a Class of Interconnected Nonlinear Systems , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Zhong-Ping Jiang,et al.  Adaptive dynamic programming and optimal control of nonlinear nonaffine systems , 2014, Autom..

[33]  Zhijiang Shao,et al.  Balancing Computation Speed and Quality: A Decentralized Motion Planning Method for Cooperative Lane Changes of Connected and Automated Vehicles , 2018, IEEE Transactions on Intelligent Vehicles.

[34]  Marios M. Polycarpou,et al.  Distributed Fault Accommodation for a Class of Interconnected Nonlinear Systems With Partial Communication , 2011, IEEE Transactions on Automatic Control.

[35]  Frank L. Lewis,et al.  A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems , 2013, Autom..

[36]  Peng Shi,et al.  Neural-Network-Based Adaptive Backstepping Control With Application to Spacecraft Attitude Regulation , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Huaguang Zhang,et al.  Optimal Fault-Tolerant Control for Discrete-Time Nonlinear Strict-Feedback Systems Based on Adaptive Critic Design , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Shaocheng Tong,et al.  Adaptive Fuzzy Output-Constrained Fault-Tolerant Control of Nonlinear Stochastic Large-Scale Systems With Actuator Faults , 2017, IEEE Transactions on Cybernetics.

[39]  Bruce Bueno de Mesquita,et al.  An Introduction to Game Theory , 2014 .

[40]  Qing Ye,et al.  Robust differential game guidance laws design for uncertain interceptor-target engagement via adaptive dynamic programming , 2017, Int. J. Control.

[41]  Frank L. Lewis,et al.  Online solution of nonlinear two-player zero-sum games using synchronous policy iteration , 2010, 49th IEEE Conference on Decision and Control (CDC).

[42]  Gang Tao,et al.  Adaptive Fault-Tolerant Control of Uncertain Nonlinear Large-Scale Systems With Unknown Dead Zone , 2016, IEEE Transactions on Cybernetics.

[43]  Frank L. Lewis,et al.  Distributed Fault-Tolerant Control of Networked Uncertain Euler–Lagrange Systems Under Actuator Faults , 2017, IEEE Transactions on Cybernetics.

[44]  Shaocheng Tong,et al.  Adaptive Neural Networks Decentralized FTC Design for Nonstrict-Feedback Nonlinear Interconnected Large-Scale Systems Against Actuator Faults , 2017, IEEE Transactions on Neural Networks and Learning Systems.