A recurrent neural network approach for remaining useful life prediction utilizing a novel trend features construction method

Abstract Data-driven methods for remaining useful life (RUL) prediction normally learn features from a fixed window size of a priori of degradation, which may lead to less accurate prediction results on different datasets because of the variance of local features. This paper proposes a method for RUL prediction which depends on a trend feature representing the overall time sequence of degradation. Complete ensemble empirical mode decomposition, followed by a reconstruction procedure, is created to build the trend features. The probability distribution of sensors’ measurement learned by conditional neural processes is used to evaluate the trend features. With the best trend feature, a data-driven model using long short-term memory is developed to predict the RUL. To prove the effectiveness of the proposed method, experiments on a benchmark C-MAPSS dataset are carried out and compared with other state-of-the-art methods. Comparison results show that the proposed method achieves the smallest root mean square values in prediction of all RUL.

[1]  Yajie Miao,et al.  EESEN: End-to-end speech recognition using deep RNN models and WFST-based decoding , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[2]  Han Ding,et al.  Bayesian Learning-Based Model-Predictive Vibration Control for Thin-Walled Workpiece Machining Processes , 2017, IEEE/ASME Transactions on Mechatronics.

[3]  Robert X. Gao,et al.  Adaptive resampling-based particle filtering for tool life prediction , 2015 .

[4]  Donghua Zhou,et al.  A Wiener-process-based degradation model with a recursive filter algorithm for remaining useful life estimation , 2013 .

[5]  Byeng D. Youn,et al.  Resilience-Driven System Design of Complex Engineered Systems , 2011 .

[6]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[7]  Takashi Hiyama,et al.  Predicting remaining useful life of rotating machinery based artificial neural network , 2010, Comput. Math. Appl..

[8]  George J. Vachtsevanos,et al.  A particle-filtering approach for on-line fault diagnosis and failure prognosis , 2009 .

[9]  Hong Jiang,et al.  A novel Switching Unscented Kalman Filter method for remaining useful life prediction of rolling bearing , 2019, Measurement.

[10]  Kay Chen Tan,et al.  Multimodal Degradation Prognostics Based on Switching Kalman Filter Ensemble , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Datong Liu,et al.  Lithium-ion battery remaining useful life estimation with an optimized Relevance Vector Machine algorithm with incremental learning , 2015 .

[12]  Yiming Yang,et al.  A study of retrospective and on-line event detection , 1998, SIGIR '98.

[13]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[14]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[15]  Fuad E. Alsaadi,et al.  Detection of intermittent faults for nonuniformly sampled multi-rate systems with dynamic quantisation and missing measurements , 2018, Int. J. Control.

[16]  Linxia Liao,et al.  Discovering Prognostic Features Using Genetic Programming in Remaining Useful Life Prediction , 2014, IEEE Transactions on Industrial Electronics.

[17]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[18]  Huaqing Wang,et al.  Intelligent diagnosis method for rolling element bearing faults using possibility theory and neural network , 2011, Comput. Ind. Eng..

[19]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[20]  Patrick Flandrin,et al.  A complete ensemble empirical mode decomposition with adaptive noise , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[22]  Donghua Zhou,et al.  Remaining useful life estimation - A review on the statistical data driven approaches , 2011, Eur. J. Oper. Res..

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Yufang Wang,et al.  A novel hybrid decomposition-and-ensemble model based on CEEMD and GWO for short-term PM2.5 concentration forecasting , 2016 .

[25]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[26]  Zhigang Tian,et al.  An artificial neural network method for remaining useful life prediction of equipment subject to condition monitoring , 2012, J. Intell. Manuf..

[27]  Brigitte Chebel-Morello,et al.  Direct Remaining Useful Life Estimation Based on Support Vector Regression , 2017, IEEE Transactions on Industrial Electronics.

[28]  Kai Goebel,et al.  Comparison of prognostic algorithms for estimating remaining useful life of batteries , 2009 .

[29]  Farbod Akhavan Niaki,et al.  State of health monitoring in machining: Extended Kalman filter for tool wear assessment in turning of IN718 hard-to-machine alloy , 2016 .

[30]  Noureddine Zerhouni,et al.  Remaining useful life estimation based on nonlinear feature reduction and support vector regression , 2013, Eng. Appl. Artif. Intell..

[31]  Francisco Javier de Cos Juez,et al.  A hybrid ARIMA-SVM model for the study of the remaining useful life of aircraft engines , 2019, J. Comput. Appl. Math..