Reinforcement-learning based fault-tolerant control

Engineering systems are always subjected to faults or malfunctions due to age or unexpected events, which would degrade the operation performance and even lead to the operation failure-Therefore, there is a strong motivation to develop fault-tolerant control strategy so that the system can operate with tolerated perform ance de ggr ad ation-In this p ap er, a novel approach based on reinforcement leaning is proposed to design a fault-tolerant controller without need of the information on faults-T simulation example.

[1]  Guang-Hong Yang,et al.  Data-based fault-tolerant control for uncertain linear systems with actuator faults , 2016 .

[2]  Guang-Hong Yang,et al.  Data-driven output-feedback fault-tolerant L2 control of unknown dynamic systems. , 2016, ISA transactions.

[3]  Mogens Blanke,et al.  Fault-tolerant control systems — A holistic view , 1997 .

[4]  Ali Cinar,et al.  Monitoring, fault diagnosis, fault-tolerant control and optimization: Data driven methods , 2012, Comput. Chem. Eng..

[5]  Steven X. Ding,et al.  Real-Time Implementation of Fault-Tolerant Control Systems With Performance Optimization , 2014, IEEE Transactions on Industrial Electronics.

[6]  F. Lewis,et al.  Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers , 2012, IEEE Control Systems.

[7]  Youmin Zhang,et al.  Bibliographical review on reconfigurable fault-tolerant control systems , 2003, Annu. Rev. Control..

[8]  Xiang Yu,et al.  A survey of fault-tolerant controllers based on safety-related issues , 2015, Annu. Rev. Control..

[9]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[10]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part I: Fault Diagnosis With Model-Based and Signal-Based Approaches , 2015, IEEE Transactions on Industrial Electronics.

[11]  Huaguang Zhang,et al.  Fault-Tolerant Controller Design for a Class of Nonlinear MIMO Discrete-Time Systems via Online Reinforcement Learning Algorithm , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Andrew G. Barto,et al.  Adaptive linear quadratic control using policy iteration , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[13]  Kyriakos G. Vamvoudakis,et al.  Q-learning for continuous-time linear systems: A model-free infinite horizon optimal control approach , 2017, Syst. Control. Lett..

[14]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[15]  Ping Zhang,et al.  Data-Driven Design of Fault-Tolerant Control Systems , 2012 .

[16]  Jin Jiang,et al.  Fault-tolerant control systems: A comparative study between active and passive approaches , 2012, Annu. Rev. Control..

[17]  Shalabh Bhatnagar,et al.  New algorithms of the Q-learning type , 2008, Autom..

[18]  Donghua Zhou,et al.  A Review on Recent Development of Spacecraft Attitude Fault Tolerant Control System , 2016, IEEE Transactions on Industrial Electronics.