LSTM-Based Multi-Task Method for Remaining Useful Life Prediction under Corrupted Sensor Data

Data-driven remaining useful life (RUL) prediction plays a vital role in modern industries. However, unpredictable corruption may occur in the collected sensor data due to various disturbances in the real industrial conditions. To achieve better RUL prediction performance under this situation, we propose a novel multi-task method for RUL prediction, which is named multi-task deep long short-term memory (MTD-LSTM). In MTD-LSTM, convolutional neural network (CNN) and long short-term memory (LSTM) are first employed for feature extraction and fusion. Then, the extracted features are fed into the multi-task learning module, which contains missing value imputation and RUL prediction module. The missing values imputation task and RUL prediction task are performed simultaneously. The purpose of the missing value imputation is to obtain integral degradation information by recovering the complete data; thus, the RUL prediction task performs better under corrupted sensor data. In addition, a novel loss term is proposed to smooth the RUL prediction results without any manual post-processing. The effectiveness of the proposed method is verified on the simulated dataset based on the C-MAPSS dataset.

[1]  Yi Qin,et al.  Spatiotemporally Multidifferential Processing Deep Neural Network and its Application to Equipment Remaining Useful Life Prediction , 2021, IEEE Transactions on Industrial Informatics.

[2]  Yi Qin,et al.  Gated Dual Attention Unit Neural Networks for Remaining Useful Life Prediction of Rolling Bearings , 2021, IEEE Transactions on Industrial Informatics.

[3]  Steven X. Ding,et al.  A Sequence-to-Sequence Approach for Remaining Useful Lifetime Estimation Using Attention-augmented Bidirectional LSTM , 2021, Intell. Syst. Appl..

[4]  Li Zhao,et al.  A Data-Driven Auto-CNN-LSTM Prediction Model for Lithium-Ion Battery Remaining Useful Life , 2021, IEEE Transactions on Industrial Informatics.

[5]  Yaguo Lei,et al.  Remaining useful life prediction based on a multi-sensor data fusion model , 2021, Reliab. Eng. Syst. Saf..

[6]  Tongshun Liu,et al.  A Switching Hidden Semi-Markov Model for Degradation Process and Its Application to Time-Varying Tool Wear Monitoring , 2021, IEEE Transactions on Industrial Informatics.

[7]  Yu Liu,et al.  Remaining Useful Life Prediction by Fusing Expert Knowledge and Condition Monitoring Information , 2021, IEEE Transactions on Industrial Informatics.

[8]  Hong Pei,et al.  A Bayesian Inference for Remaining Useful Life Estimation by Fusing Accelerated Degradation Data and Condition Monitoring Data , 2021, Reliab. Eng. Syst. Saf..

[9]  Zhenghua Chen,et al.  Machine Remaining Useful Life Prediction via an Attention-Based Deep Learning Approach , 2021, IEEE Transactions on Industrial Electronics.

[10]  Meng Ma,et al.  Deep-Convolution-Based LSTM Network for Remaining Useful Life Prediction , 2021, IEEE Transactions on Industrial Informatics.

[11]  Xianke Lin,et al.  Remaining Useful Life Prediction Using a Novel Feature-Attention-Based End-to-End Approach , 2021, IEEE Transactions on Industrial Informatics.

[12]  Yaguo Lei,et al.  Multiscale Convolutional Attention Network for Predicting Remaining Useful Life of Machinery , 2020, IEEE Transactions on Industrial Electronics.

[13]  Xinyu Shao,et al.  Data-driven remaining useful life prediction via multiple sensor signals and deep long short-term memory neural network. , 2020, ISA transactions.

[14]  R. Arslan,et al.  Development of Output Correction Methodology for Long Short Term Memory-Based Speech Recognition , 2019, Sustainability.

[15]  Xiuyu Zhang,et al.  Remaining Useful Life Prediction of Lithium-Ion Batteries Using Support Vector Regression Optimized by Artificial Bee Colony , 2019, IEEE Transactions on Vehicular Technology.

[16]  Houxiang Zhang,et al.  Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture , 2019, Reliab. Eng. Syst. Saf..

[17]  Huihui Miao,et al.  Joint Learning of Degradation Assessment and RUL Prediction for Aeroengines via Dual-Task Deep LSTM Networks , 2019, IEEE Transactions on Industrial Informatics.

[18]  Hong-Zhong Huang,et al.  A Bidirectional LSTM Prognostics Method Under Multiple Operational Conditions , 2019, IEEE Transactions on Industrial Electronics.

[19]  Guangzhong Dong,et al.  Remaining Useful Life Prediction and State of Health Diagnosis for Lithium-Ion Batteries Using Particle Filter and Support Vector Regression , 2018, IEEE Transactions on Industrial Electronics.

[20]  Marcelo A. Montemurro,et al.  Natural Language Statistical Features of LSTM-Generated Texts , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[22]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Bin Liang,et al.  Remaining useful life prediction of aircraft engine based on degradation pattern learning , 2017, Reliab. Eng. Syst. Saf..

[24]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[25]  Manuel Esperon-Miguez,et al.  A review of physics-based models in prognostics: Application to gears and bearings of rotating machinery , 2016 .

[26]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[27]  Enrico Zio,et al.  Particle filtering prognostic estimation of the remaining useful life of nonlinear components , 2011, Reliab. Eng. Syst. Saf..

[28]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[29]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[30]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[31]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.