Observer‐based single‐network incremental adaptive dynamic programming for fault‐tolerant control of nonlinear systems with actuator faults

A model‐free incremental adaptive fault‐tolerant control (FTC) scheme is proposed for a class of nonlinear systems with actuator faults. To deal with actuator faults and guarantee the approximate optimal performance of the nominal nonlinear system without any prior knowledge of system dynamics, a single‐network incremental adaptive dynamic programming (SIADP) algorithm based on incremental neural network observer is developed to design an active fault‐tolerant control (AFTC) policy. An approximate linear time‐varying system is obtained by incremental nonlinear technique, in which the relevant matrix parameters are identified by recursive least square estimation. Then, a SIADP algorithm‐based fault‐tolerant controller is developed. Based on the redundancy characteristic and function of actuators, a grouping scheme of actuators is introduced. An incremental neural network observer is designed to approximate the actuator faults. The novel SIADP scheme is constructed with a simplified single critic neural network to shorten the learning time and decrease the computational burden in the control process, in which the norm of the weight estimations of critic neural network is updated. Moreover, based on the Lyapunov theorem, the uniformly ultimately bounded stability of the closed‐loop incremental system is proved. Finally, simulations are given to verify the effectiveness of the proposed FTC scheme.

[1]  Gaofeng Che.  Single critic network based fault-tolerant tracking control for underactuated AUV with actuator fault , 2022, Ocean Engineering.

[2]  Jun Zhang,et al.  Adaptive Fuzzy Finite-Time Output-Feedback Fault-Tolerant Control of Nonstrict-Feedback Systems Against Actuator Faults , 2022, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  Jinde Cao,et al.  Non-Fragile H∞ Synchronization for Markov Jump Singularly Perturbed Coupled Neural Networks Subject to Double-Layer Switching Regulation , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Yong-ming Li,et al.  Adaptive NN Optimal Consensus Fault-Tolerant Control for Stochastic Nonlinear Multiagent Systems , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Lei Guo,et al.  Fault-Tolerant Optimal Control for Discrete-Time Nonlinear System Subjected to Input Saturation: A Dynamic Event-Triggered Approach , 2021, IEEE Transactions on Cybernetics.

[6]  Hao Shen,et al.  Observer-Based Sliding Mode Control for Networked Fuzzy Singularly Perturbed Systems Under Weighted Try-Once-Discard Protocol , 2021, IEEE Transactions on Fuzzy Systems.

[7]  Kun Ji,et al.  Prescribed performance incremental adaptive optimal fault-tolerant control for nonlinear systems with actuator faults. , 2021, ISA transactions.

[8]  Changyin Sun,et al.  Prescribed Performance Fault-Tolerant Control for Uncertain Nonlinear MIMO System Using Actor–Critic Learning Structure , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[9]  S. Tong,et al.  Observer-Based Neuro-Adaptive Optimized Control of Strict-Feedback Nonlinear Systems With State Constraints , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Silverio Bolognani,et al.  Motor Parameter-Free Predictive Current Control of Synchronous Motors by Recursive Least-Square Self-Commissioning Model , 2020, IEEE Transactions on Industrial Electronics.

[11]  Zhen Yu,et al.  Neural-network estimators based fault-tolerant tracking control for AUV via ADP with rudders faults and ocean current disturbance , 2020, Neurocomputing.

[12]  Ye Zhou,et al.  Incremental model based online heuristic dynamic programming for nonlinear adaptive tracking control with partial observability , 2020 .

[13]  Cesare Alippi,et al.  Data-based fault tolerant control for affine nonlinear systems through particle swarm optimized neural networks , 2020, IEEE/CAA Journal of Automatica Sinica.

[14]  A. Yazdizadeh,et al.  Optimal state estimation and fault diagnosis for a class of nonlinear systems , 2020, IEEE/CAA Journal of Automatica Sinica.

[15]  B Rabaoui,et al.  A reconfigurable PID fault tolerant tracking controller design for LPV systems. , 2020, ISA transactions.

[16]  Jing Zhu,et al.  Optimal Control of Nonlinear Systems With Time Delays: An Online ADP Perspective , 2019, IEEE Access.

[17]  Shaojie Zhang,et al.  An anti-windup INDI fault-tolerant control scheme for flying wing aircraft with actuator faults. , 2019, ISA transactions.

[18]  Zhong-Ping Jiang,et al.  Reinforcement learning for linear continuous-time systems: an incremental learning approach , 2019, IEEE/CAA Journal of Automatica Sinica.

[19]  Najib Essounbouli,et al.  Indirect adaptive fuzzy fault-tolerant tracking control for MIMO nonlinear systems with actuator and sensor failures. , 2018, ISA transactions.

[20]  Shaocheng Tong,et al.  Adaptive Fuzzy Fault-Tolerant Control of Nontriangular Structure Nonlinear Systems With Error Constraint , 2018, IEEE Transactions on Fuzzy Systems.

[21]  Xing Liu,et al.  Adaptive fault tolerant control and thruster fault reconstruction for autonomous underwater vehicle , 2018 .

[22]  Erik-Jan Van Kampen,et al.  Incremental model based online dual heuristic programming for nonlinear adaptive control , 2018 .

[23]  Huaguang Zhang,et al.  Optimal Guaranteed Cost Sliding Mode Control for Constrained-Input Nonlinear Systems With Matched and Unmatched Disturbances , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Mohammad Haeri,et al.  Robust adaptive fault-tolerant control for leader-follower flocking of uncertain multi-agent systems with actuator failure. , 2017, ISA transactions.

[25]  Derong Liu,et al.  Observer based adaptive dynamic programming for fault tolerant control of a class of nonlinear systems , 2017, Inf. Sci..

[26]  E. van Kampen,et al.  Nonlinear Adaptive Flight Control Using Incremental Approximate Dynamic Programming and Output Feedback , 2017 .

[27]  Peng Lu,et al.  Aircraft Fault-Tolerant Trajectory Control Using Incremental Nonlinear Dynamic Inversion , 2016 .

[28]  Huaguang Zhang,et al.  Neural network-based online H∞ control for discrete-time affine nonlinear system using adaptive dynamic programming , 2016, Neurocomputing.

[29]  Shengyuan Xu,et al.  Neural-Network-Based Decentralized Adaptive Output-Feedback Control for Large-Scale Stochastic Nonlinear Systems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[30]  Youmin Zhang,et al.  Bibliographical review on reconfigurable fault-tolerant control systems , 2003, Annu. Rev. Control..

[31]  A. Tsourdos,et al.  Fault Detection, Isolation and Adaptive Augmentation for Incremental Backstepping Flight Control , 2020 .

[32]  Huaguang Zhang,et al.  Adaptive Fault-Tolerant Tracking Control for MIMO Discrete-Time Systems via Reinforcement Learning Algorithm With Less Learning Parameters , 2017, IEEE Transactions on Automation Science and Engineering.

[33]  Shaocheng Tong,et al.  Reinforcement Learning Design-Based Adaptive Tracking Control With Less Learning Parameters for Nonlinear Discrete-Time MIMO Systems , 2015, IEEE Transactions on Neural Networks and Learning Systems.