Fault detection and isolation for a small CMG-based satellite: A fuzzy Q-learning approach

Abstract The model-based fault detection and isolation (FDI) methods are used to detect faults in small satellites when actuator redundancy may not be feasible due to weight, cost, and space limitations. In this paper, fuzzy logic and Q-learning are combined for FDI for small control momentum gyroscope (CMG)-based satellites. The fuzzy logic is good in handling the nonlinear structures of CMG, while the Q-learning provides online learning capabilities. Fuzzy logic, which is based on residual analysis, will be used to find faults in CMGs. Using residuals, fuzzy inference systems develop rules based on membership functions. However, optimization problems arise in fuzzy logic. To overcome this drawback, the Q-learning will be used to compensate for it; that is, by using Q-learning, we can obtain optimal rules in fuzzy inference systems. To achieve these goals, hierarchical dynamics and motor faults will be considered for the generation of residuals, which involves the processing of a large amount of information. The validity of the proposed fuzzy Q-learning-based FDI is demonstrated through simulations.

[1]  R.V. Patel,et al.  An intelligent Fault Detection and Recovery scheme for reaction wheel actuator of satellite attitude control systems , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[2]  Raman K. Mehra,et al.  Autonomous failure detection, identification and fault-tolerant estimation with aerospace applications , 1998, 1998 IEEE Aerospace Conference Proceedings (Cat. No.98TH8339).

[3]  Rolf Isermann,et al.  Application of model-based fault detection to a brushless DC motor , 2000, IEEE Trans. Ind. Electron..

[4]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part II: Qualitative models and search strategies , 2003, Comput. Chem. Eng..

[5]  K. Khorasani,et al.  Detection of actuator faults using a dynamic neural network for the attitude control subsystem of a satellite , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[6]  Rolf Isermann.  Model-based fault-detection and diagnosis - status and applications § , 2004 .

[7]  Szilveszter Kovács,et al.  Fuzzy Rule Interpolation-based Q-learning , 2009, 2009 5th International Symposium on Applied Computational Intelligence and Informatics.

[8]  K. Khorasani,et al.  A Diagnostic Tree Approach for Fault Cause Identification in the Attitude Control Subsystem of Satellites , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[9]  M. Saif,et al.  Robust fault diagnosis for a satellite large angle attitude system using an iterative neuron PID (INPID) observer , 2006, 2006 American Control Conference.

[10]  Sai-Ming Li,et al.  Intelligent control of spacecraft in the presence of actuator failures , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[11]  Bong Wie,et al.  Space Vehicle Dynamics and Control , 1998 .

[12]  João Miguel da Costa Sousa,et al.  An architecture for fault detection and isolation based on fuzzy methods , 2009, Expert Syst. Appl..

[13]  Meng Joo Er,et al.  Online tuning of fuzzy inference systems using dynamic fuzzy Q-learning , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[14]  E.S. Tehrani,et al.  Dynamic neural network-based estimator for fault diagnosis in reaction wheel actuator of satellite attitude control system , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[15]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part I: Quantitative model-based methods , 2003, Comput. Chem. Eng..

[16]  K. Khorasani,et al.  Satellite fault diagnosis using a bank of interacting Kalman filters , 2007, IEEE Transactions on Aerospace and Electronic Systems.

[17]  Chingiz Hajiyev,et al.  Sensor/actuator fault diagnosis based on statistical analysis of innovation sequence and Robust Kalman Filtering , 2000 .

[18]  Peter Vas,et al.  Parameter Estimation, Condition Monitoring, and Diagnosis of Electrical Machines , 1993 .

[19]  Vincent Wertz,et al.  FUZZY INFERENCE SYSTEMS OPTIMIZATION BY REINFORCEMENT LEARNING , 2001 .

[20]  Bo-Suk Yang,et al.  Fault diagnosis of induction motor based on decision trees and adaptive neuro-fuzzy inference , 2009, Expert Syst. Appl..

[21]  Mo-Yuen Chow,et al.  Using a neural/fuzzy system to extract heuristic knowledge of incipient faults in induction motors. Part I-Methodology , 1995, IEEE Trans. Ind. Electron..

[22]  T.G. Habetler,et al.  Detection of Rotor Faults in Brushless DC Motors Operating Under Nonstationary Conditions , 2006, IEEE Transactions on Industry Applications.

[23]  Seungkeun Kim,et al.  Fault detection and diagnosis of aircraft actuators using fuzzy-tuning IMM filter , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[24]  Lionel Jouffe,et al.  Fuzzy inference system learning by reinforcement methods , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[25]  Satish Rajagopalan,et al.  Detection of Rotor and Load Faults in BLDC Motors Operating Under Stationary and Non-Stationary Conditions , 2006 .

[26]  Khashayar Khorasani,et al.  Neural Network-based Actuator Fault Diagnosis for Attitude Control Subsystem of an Unmanned Space Vehicle , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[27]  Massimiliano Mattei,et al.  A direct/functional redundancy scheme for fault detection and isolation on an aircraft , 2006 .

[28]  H.A. Toliyat,et al.  Condition Monitoring and Fault Diagnosis of Electrical Motors—A Review , 2005, IEEE Transactions on Energy Conversion.

[29]  Khashayar Khorasani,et al.  A Dynamic Neural Network-based Reaction Wheel Fault Diagnosis for Satellites , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[30]  H. Joel Trussell,et al.  Fuzzy inference systems implemented on neural architectures for motor fault detection and diagnosis , 1999, IEEE Trans. Ind. Electron..

[31]  Robert Babuska,et al.  Adaptive fuzzy control of satellite attitude by reinforcement learning , 1998, IEEE Trans. Fuzzy Syst..

[32]  Bingrong Hong,et al.  Software implemented transient fault detection in space computer , 2007 .

[33]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part III: Process history based methods , 2003, Comput. Chem. Eng..

[34]  P. Glorennec,et al.  Fuzzy Q-learning , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[35]  Zhongsheng Wang,et al.  Robust incipient fault identification of aircraft engine rotor based on wavelet and fraction , 2010 .

[36]  Tao Jiang,et al.  A fault detection, isolation and reconstruction strategy for a satellite’s attitude control subsystem with redundant reaction wheels , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[37]  Inseok Hwang,et al.  A Survey of Fault Detection, Isolation, and Reconfiguration Methods , 2010, IEEE Transactions on Control Systems Technology.