Application of incremental support vector regression based on optimal training subset and improved particle swarm optimization algorithm in real-time sensor fault diagnosis

Attracted by the advantages of support vector regression and incremental learning approach, it is proposed in this work that an incremental support vector regression (ISVR) model optimized by particle swarm optimization (PSO) algorithm, and some improvements are made to be more suitable for sensor faults on-line diagnosis. To reducethe training time of ISVR model, an optimal training subset (OTS) method is adopted to reduce the size of training data set of the model. Then, in order to solve the problem of slow convergence of standard PSO algorithm, an incremental PSO (IPSO) algorithm is proposed to accelerate the model convergence through adjusting the inertial weight of each particle, which is gained by comparing the current position of each particle and the optimal position of the last incremental training. Based on the above improvements, a hybrid model, IPSO-OTS-ISVR model is presented finally. Experimental results based on actual operational data of a gas turbine shows that, under the premise of ensuring accuracy, the proposed IPSO-OTS-ISVR has much better performance in model response time and convergence performance over the comparison models. The experimental results based on an UCI data set indicate that the proposed hybrid model can also be extended to solve other prediction problems.

[1]  Reza Safabakhsh,et al.  A novel stability-based adaptive inertia weight for particle swarm optimization , 2016, Appl. Soft Comput..

[2]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[3]  Khashayar Khorasani,et al.  Dynamic neural network-based fault diagnosis of gas turbine engines , 2014, Neurocomputing.

[4]  Khashayar Khorasani,et al.  Fault detection and isolation of a dual spool gas turbine engine using dynamic neural networks and multiple model approach , 2014, Inf. Sci..

[5]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[6]  Steven X. Ding,et al.  On observer-based fault detection for nonlinear systems , 2015, Syst. Control. Lett..

[7]  Kuan-Yu Chen,et al.  Forecasting systems reliability based on support vector regression with genetic algorithms , 2007, Reliab. Eng. Syst. Saf..

[8]  Shujing Duan,et al.  Fault diagnosis for sensors of aero-engine based on improved least squares support vector regression , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[9]  Hao,et al.  Model-Based Fault Tolerant Control for Hybrid Dynamic Systems with Sensor Faults , 2006 .

[10]  Donald L. Simon,et al.  A Unified Nonlinear Adaptive Approach for Detection and Isolation of Engine Faults , 2010 .

[11]  Enrico Zio,et al.  System reliability prediction by support vector regression with analytic selection and genetic algorithm parameters selection , 2015, Appl. Soft Comput..

[12]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[13]  Davide Anguita,et al.  Machine learning approaches for improving condition-based maintenance of naval propulsion plants , 2016 .

[14]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[15]  Reza Langari,et al.  Sensor fault diagnosis with a probabilistic decision process , 2013 .

[16]  Nan Liu,et al.  An integrated nonlinear model-based approach to gas turbine engine sensor fault diagnostics , 2014 .

[17]  Inseok Hwang,et al.  A Survey of Fault Detection, Isolation, and Reconfiguration Methods , 2010, IEEE Transactions on Control Systems Technology.

[18]  Enrico Zio,et al.  A particle swarm‐optimized support vector machine for reliability prediction , 2012, Qual. Reliab. Eng. Int..

[19]  S Gerow Matthew,et al.  自動車用小型過給エンジンにおける多モード燃焼に適したバルブ操作手法の比較-第二部:SACI燃焼領域における中負荷運転 | 文献情報 | J-GLOBAL 科学技術総合リンクセンター , 2014 .

[20]  Enrico Zio,et al.  A Novel Hybrid Method of Parameters Tuning in Support Vector Regression for Reliability Prediction: Particle Swarm Optimization Combined With Analytical Selection , 2016, IEEE Transactions on Reliability.

[21]  Sen Zhang,et al.  Adaptive fault diagnosis for continuous time-delay repetitive system subject to sensor fault , 2015, 2015 International Conference on Advanced Mechatronic Systems (ICAMechS).

[22]  JinXing Che Support vector regression based on optimal training subset and adaptive particle swarm optimization algorithm , 2013, Appl. Soft Comput..

[23]  Fang Deng,et al.  Sensor Multifault Diagnosis With Improved Support Vector Machines , 2017, IEEE Transactions on Automation Science and Engineering.

[24]  Khashayar Khorasani,et al.  Multiple-model based sensor fault diagnosis using hybrid kalman filter approach for nonlinear gas turbine engines , 2013, 2013 American Control Conference.

[25]  Nader Meskin,et al.  Multiple-Model Sensor and Components Fault Diagnosis in Gas Turbine Engines Using Autoassociative Neural Networks , 2014 .

[26]  Su-Yun Huang,et al.  Model selection for support vector machines via uniform design , 2007, Comput. Stat. Data Anal..

[27]  Qi Zhang,et al.  Diagnosis of process faults and sensor faults in a class of nonlinear uncertain systems , 2011 .

[28]  Yunpeng Cao,et al.  Multiple model-based detection and estimation scheme for gas turbine sensor and gas path fault simultaneous diagnosis , 2019 .

[29]  Vladimir Naumovich Vapni The Nature of Statistical Learning Theory , 1995 .

[30]  Donald L. Simon,et al.  Evaluation of an Enhanced Bank of Kalman Filters for In-Flight Aircraft Engine Sensor Fault Diagnostics , 2005 .

[31]  Nader Meskin,et al.  Adaptive sliding mode observer for sensor fault diagnosis of an industrial gas turbine , 2015 .

[32]  Jingchao Li,et al.  A Method to Improve the Robustness of Gas Turbine Gas-Path Fault Diagnosis Against Sensor Faults , 2018, IEEE Transactions on Reliability.

[33]  Kusum Deep,et al.  Novel inertia weight strategies for particle swarm optimization , 2013, Memetic Comput..

[34]  Feng Lu,et al.  Fault Diagnostics for Turbo-Shaft Engine Sensors Based on a Simplified On-Board Model , 2012, Sensors.

[35]  Sébastien Borguet,et al.  Coupling principal component analysis and Kalman filtering algorithms for on-line aircraft engine diagnostics , 2009 .

[36]  Shengfu Lu,et al.  A multi-information fusion "triple variables with iteration" inertia weight PSO algorithm and its application , 2019, Appl. Soft Comput..

[37]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[38]  S. Qin,et al.  Detection and identification of faulty sensors in dynamic processes , 2001 .

[39]  JinXing Che,et al.  Optimal training subset in a support vector regression electric load forecasting model , 2012, Appl. Soft Comput..