Parsimonious Kernel Recursive Least Squares Algorithm for Aero-Engine Health Diagnosis

Kernel adaptive filtering (KAF) has gained widespread popularity among the machine learning community for online applications due to its convexity, simplicity, and universal approximation ability. However, the network generated by KAF keeps growing with the accumulation of the training samples, which leads to the increasing memory requirement and computational burden. To address this issue, a pruning approach that attempts to restrict the network size to a fixed value is incorporated into a kernel recursive least squares (KRLS) algorithm, yielding a novel KAF algorithm called parsimonious KRLS (PKRLS). The basic idea of the pruning technique is to remove the center with the least importance from the existing dictionary. The importance of a center is quantified by its contribution to minimizing the cost function. The calculation of the importance measure is formulated in an efficient manner, which facilitates its implementation in online settings. Experimental results on the benchmark tasks show that PKRLS obtains a parsimonious network structure with the satisfactory prediction accuracy. Finally, a multi-sensor health diagnosis approach based on PKRLS is developed for identifying the health state of a degraded aero-engine in real time. A case study in a turbofan engine degradation data set demonstrates that PKRLS provides an effective and efficient candidate for modeling the performance deterioration of real complex systems.

[1]  C. K. Michael Tse,et al.  A modified quantized kernel least mean square algorithm for prediction of chaotic time series , 2016, Digit. Signal Process..

[2]  Badong Chen,et al.  Quantized Kernel Recursive Least Squares Algorithm , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[4]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[5]  Weifeng Liu,et al.  The Kernel Least-Mean-Square Algorithm , 2008, IEEE Transactions on Signal Processing.

[6]  Feng Lu,et al.  Gas Path Health Monitoring for a Turbofan Engine Based on a Nonlinear Filtering Approach , 2013 .

[7]  Joseph Mathew,et al.  Rotating machinery prognostics. State of the art, challenges and opportunities , 2009 .

[8]  Nanning Zheng,et al.  Density-dependent quantized kernel least mean square , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[9]  Badong Chen,et al.  Online efficient learning with quantized KLMS and L1 regularization , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[10]  Weifeng Liu,et al.  Kernel Affine Projection Algorithms , 2008, EURASIP J. Adv. Signal Process..

[11]  Michael Pecht,et al.  Application of a state space modeling technique to system prognostics based on a health index for condition-based maintenance , 2012 .

[12]  Yoshikazu Washizawa Adaptive Subset Kernel Principal Component Analysis for Time-Varying Patterns , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Jianbo Yu,et al.  A similarity-based prognostics approach for Remaining Useful Life estimation of engineered systems , 2008, 2008 International Conference on Prognostics and Health Management.

[14]  Bo-Suk Yang,et al.  Support vector machine in machine condition monitoring and fault diagnosis , 2007 .

[15]  Toshihisa Tanaka,et al.  Adaptive kernel principal components tracking , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Jinquan Huang,et al.  Aero Engine Gas Path Performance Tracking Based on Multi-Sensor Asynchronous Integration Filtering Approach , 2018, IEEE Access.

[17]  Meng Joo Er,et al.  Parsimonious Extreme Learning Machine Using Recursive Orthogonal Least Squares , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Ying Chen,et al.  Sequential state estimation of nonlinear/non-Gaussian systems with stochastic input for turbine degradation estimation , 2016 .

[19]  Badong Chen,et al.  Self-organizing kernel adaptive filtering , 2016, EURASIP J. Adv. Signal Process..

[20]  Weifeng Liu,et al.  An Information Theoretic Approach of Designing Sparse Kernel Adaptive Filters , 2009, IEEE Transactions on Neural Networks.

[21]  Nanning Zheng,et al.  Sparse kernel recursive least squares using L1 regularization and a fixed-point sub-iteration , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Paulo S. R. Diniz,et al.  A Fixed-Point Online Kernel Principal Component Extraction Algorithm , 2017, IEEE Transactions on Signal Processing.

[23]  Badong Chen,et al.  A FIXED-BUDGET QUANTIZED KERNEL LEAST MEAN SQUARE ALGORITHM , 2012 .

[24]  Yi-Guang Li,et al.  Gas turbine performance prognostic for condition-based maintenance , 2009 .

[25]  Pingfeng Wang,et al.  Failure diagnosis using deep belief learning based health state classification , 2013, Reliab. Eng. Syst. Saf..

[26]  Xiaodong Gu,et al.  Fault diagnosis of power electronic system based on fault gradation and neural network group , 2009, Neurocomputing.

[27]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[28]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[29]  Ignacio Santamaría,et al.  A Sliding-Window Kernel RLS Algorithm and Its Application to Nonlinear Channel Identification , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[30]  Badong Chen,et al.  Quantized Kernel Least Mean Square Algorithm , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[32]  Paul Honeine,et al.  Online Prediction of Time Series Data With Kernels , 2009, IEEE Transactions on Signal Processing.

[33]  Weifeng Liu,et al.  Extended Kernel Recursive Least Squares Algorithm , 2009, IEEE Transactions on Signal Processing.

[34]  Weifeng Liu,et al.  Fixed-budget kernel recursive least-squares , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[35]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).