A Novel Cap-LSTM Model for Remaining Useful Life Prediction

In recent years, the Remaining Useful Life (RUL) prediction has become a hot spot in Prognostics and Health Management (PHM) research. High-accuracy RUL prediction can reduce the probability of accident occurrence and improve the reliability of the mechanical system. This paper proposes a novel two-channel hybrid model for RUL prediction based on a Capsule Neural Network and a Long Short-Term Memory Network (Cap-LSTM). Conventional Convolutional Neural Networks (CNN) are widely used in RUL prediction. However, the pooling layer of the conventional CNN only extracts the most active part of the multivariate time-series sensor data. Moreover, conventional CNN is not sensitive to the direction and spatial position of features and thus the feature information may not be fully used. To overcome these shortcomings, this paper uses the capsule neural network to directly extract the highly correlated spatial feature information, from the multivariate time-series sensor data, thus avoiding the loss of the spatial position relationship between local features and reducing the complexity of the model. In order to obtain the training and test samples, this paper uses the sliding time window method to preprocess the data. Meanwhile, the piece-wise linear function is used to represent the actual performance degradation of the engine. The NASA C-MAPSS dataset is used to verify the prediction effectiveness of the Cap-LSTM model. The state-of-the-art RUL prediction models are also introduced and compared to the proposed approach, providing results that show the superiority of the presented method.

[1]  Xinyu Shao,et al.  Remaining Useful Life Prognosis Based on Ensemble Long Short-Term Memory Neural Network , 2021, IEEE Transactions on Instrumentation and Measurement.

[2]  Min Xie,et al.  A Joint Long Short-Term Memory and AdaBoost regression approach with application to remaining useful life estimation , 2020 .

[3]  Chao Hu,et al.  Physics-Based Convolutional Neural Network for Fault Diagnosis of Rolling Element Bearings , 2019, IEEE Sensors Journal.

[4]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[5]  Bin Chen,et al.  A Light Gradient Boosting Machine for Remainning Useful Life Estimation of Aircraft Engines , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[6]  Guilin Wen,et al.  Remaining Useful Life Estimation in Prognostics Using Deep Bidirectional LSTM Neural Network , 2018, 2018 Prognostics and System Health Management Conference (PHM-Chongqing).

[7]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[8]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[9]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[10]  K. P. Soman,et al.  Long short-term memory based operation log anomaly detection , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[11]  Chetan Gupta,et al.  Long Short-Term Memory Network for Remaining Useful Life estimation , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[12]  Hagen Soltau,et al.  Neural Speech Recognizer: Acoustic-to-Word LSTM Model for Large Vocabulary Speech Recognition , 2016, INTERSPEECH.

[13]  Yaguo Lei,et al.  A Model-Based Method for Remaining Useful Life Prediction of Machinery , 2016, IEEE Transactions on Reliability.

[14]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[15]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[16]  Marcus Liwicki,et al.  Scene analysis by mid-level attribute learning using 2D LSTM networks and an application to web-image tagging , 2015, Pattern Recognit. Lett..

[17]  P. J. García Nieto,et al.  Hybrid PSO-SVM-based method for forecasting of the remaining useful life for aircraft engines and evaluation of its reliability , 2015, Reliab. Eng. Syst. Saf..

[18]  Brigitte Chebel-Morello,et al.  Accurate bearing remaining useful life prediction based on Weibull distribution and artificial neural network , 2015 .

[19]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[20]  Mohamed El Aroussi,et al.  Bearings prognostic using Mixture of Gaussians Hidden Markov Model and Support Vector Machine , 2013, 2013 ACS International Conference on Computer Systems and Applications (AICCSA).

[21]  Jorge F. Silva,et al.  Particle-Filtering-Based Prognosis Framework for Energy Storage Devices With a Statistical Characterization of State-of-Health Regeneration Phenomena , 2013, IEEE Transactions on Instrumentation and Measurement.

[22]  Zhigang Tian,et al.  An artificial neural network method for remaining useful life prediction of equipment subject to condition monitoring , 2012, J. Intell. Manuf..

[23]  Ming Jian Zuo,et al.  Crack propagation assessment for spur gears using model-based analysis and simulation , 2012, J. Intell. Manuf..

[24]  Tshilidzi Marwala,et al.  Artificial neural network and rough set for HV bushings condition monitoring , 2011, 2011 15th IEEE International Conference on Intelligent Engineering Systems.

[25]  Xing Wang,et al.  A Data-Driven Neural Network Approach for Remaining Useful Life Prediction , 2010 .

[26]  George J. Vachtsevanos,et al.  A particle-filtering approach for on-line fault diagnosis and failure prognosis , 2009 .

[27]  F.O. Heimes,et al.  Recurrent neural networks for remaining useful life estimation , 2008, 2008 International Conference on Prognostics and Health Management.

[28]  Abhinav Saxena,et al.  Damage propagation modeling for aircraft engine run-to-failure simulation , 2008, 2008 International Conference on Prognostics and Health Management.

[29]  Wu Ji,et al.  Status and Perspectives of Prognostics and Health Management Technologies , 2005 .

[30]  Steven Y. Liang,et al.  Adaptive Prognostics for Rolling Element Bearing Condition , 1999 .

[31]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[32]  R. Ganesan,et al.  Multivariable Trend Analysis Using Neural Networks for Intelligent Diagnostics of Rotating Machinery , 1997 .

[33]  David Dornfeld,et al.  Sensor Integration Using Neural Networks for Intelligent Tool Condition Monitoring , 1990 .