Joint model for residual life estimation based on Long-Short Term Memory network

Abstract With the rapid development of industrial internet of things, multi-sensor technology has been widely used in system condition monitoring and residual useful life (RUL) estimation, which plays a crucial role in preventing catastrophic failures and reducing maintenance losses. However, current prognosis using multi-sensor data faces the following challenges: (i) Manual feature selection and extraction and exploration of degradation failure mechanism for a complex domain require a substantial amount of human labor and expertise from the practitioner, which is seldom available. (ii) Data fusion and prognosis are usually divided into two separate steps, resulting in the lack of intrinsic relationship between the two tasks. (iii) The end-to-end prediction methods directly based on deep learning behave like the black-box and provide no information for degradation progression. To overcome these drawbacks, a prediction framework comprising two deep learning models is proposed in this paper. Through the proposed supervised joint training scheme, the framework not only provides a continuous visualization progression of system degradation but also ensures that the generated fusion signal effectively performs in RUL prediction. As a framework application, a joint model of RUL estimation based on an ordinary long short-term memory network is designed. In the experiment section, a simulation study is firstly performed to show its RUL prediction performance. Then, a case study is conducted using two public experimental data sets (the aircraft turbofan engine data and the milling). Furthermore, the advantage of the proposed joint model is validated by carrying out a comparison with other methods based on the same experimental data sets.

[1]  Chunhui Zhao,et al.  Fault Diagnosis With Dual Cointegration Analysis of Common and Specific Nonstationary Fault Variations , 2020, IEEE Transactions on Automation Science and Engineering.

[2]  Chunhui Zhao,et al.  Broad Convolutional Neural Network Based Industrial Process Fault Diagnosis With Incremental Learning Capability , 2020, IEEE Transactions on Industrial Electronics.

[3]  Lin Ma,et al.  Prognostic modelling options for remaining useful life estimation by industry , 2011 .

[4]  Frank L. Lewis,et al.  Tracking Control for Linear Discrete-Time Networked Control Systems With Unknown Dynamics and Dropout , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Kil To Chong,et al.  Induction Machine Condition Monitoring Using Neural Network Modeling , 2007, IEEE Transactions on Industrial Electronics.

[6]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[7]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Chetan Gupta,et al.  Long Short-Term Memory Network for Remaining Useful Life estimation , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[9]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[10]  Yu Wang,et al.  Real-Time Identification of Power Fluctuations Based on LSTM Recurrent Neural Network: A Case Study on Singapore Power System , 2019, IEEE Transactions on Industrial Informatics.

[11]  Tie Qiu,et al.  Recurrent Broad Learning Systems for Time Series Prediction , 2020, IEEE Transactions on Cybernetics.

[12]  Noureddine Zerhouni,et al.  Data-driven prognostic method based on Bayesian approaches for direct remaining useful life prediction , 2016, J. Intell. Manuf..

[13]  W. Meeker Accelerated Testing: Statistical Models, Test Plans, and Data Analyses , 1991 .

[14]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[15]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[16]  Kaibo Liu,et al.  Statistical degradation modeling and prognostics of multiple sensor signals via data fusion: A composite health index approach , 2018 .

[17]  Frank L. Lewis,et al.  Data-Driven Flotation Industrial Process Operational Optimal Control Based on Reinforcement Learning , 2018, IEEE Transactions on Industrial Informatics.

[18]  Danwei Wang,et al.  Model-Based Prognosis for Hybrid Systems With Mode-Dependent Degradation Behaviors , 2014, IEEE Transactions on Industrial Electronics.

[19]  Lei Ren,et al.  Prediction of Bearing Remaining Useful Life With Deep Convolution Neural Network , 2018, IEEE Access.

[20]  Abdallah Chehade,et al.  Optimize the Signal Quality of the Composite Health  Index via Data Fusion for Degradation Modeling  and Prognostic Analysis , 2017, IEEE Transactions on Automation Science and Engineering.

[21]  Chunhui Zhao,et al.  Critical-to-Fault-Degradation Variable Analysis and Direction Extraction for Online Fault Prognostic , 2017, IEEE Transactions on Control Systems Technology.

[22]  Laibin Zhang,et al.  A New Probabilistic Kernel Factor Analysis for Multisensory Data Fusion: Application to Tool Condition Monitoring , 2016, IEEE Transactions on Instrumentation and Measurement.

[23]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[24]  Furong Gao,et al.  Online fault prognosis with relative deviation analysis and vector autoregressive modeling , 2015 .

[25]  Jinde Cao,et al.  Remaining useful life estimation using an inverse Gaussian degradation model , 2016, Neurocomputing.

[26]  Chunhui Zhao,et al.  Enhanced Random Forest With Concurrent Analysis of Static and Dynamic Nodes for Industrial Fault Classification , 2020, IEEE Transactions on Industrial Informatics.

[27]  Shengli Xie,et al.  Fair Energy Scheduling for Vehicle-to-Grid Networks Using Adaptive Dynamic Programming , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Enrico Zio,et al.  Online Performance Assessment Method for a Model-Based Prognostic Approach , 2016, IEEE Transactions on Reliability.

[29]  Hong-Zhong Huang,et al.  A Bidirectional LSTM Prognostics Method Under Multiple Operational Conditions , 2019, IEEE Transactions on Industrial Electronics.

[30]  Qiang Zhou,et al.  Remaining useful life prediction of individual units subject to hard failure , 2014 .

[31]  Shuang Feng,et al.  Fuzzy Broad Learning System: A Novel Neuro-Fuzzy Model for Regression and Classification , 2020, IEEE Transactions on Cybernetics.

[32]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[33]  Selin Aviyente,et al.  The Use of Bearing Currents and Vibrations in Lifetime Estimation of Bearings , 2017, IEEE Transactions on Industrial Informatics.

[34]  Laurence T. Yang,et al.  LSTM and Edge Computing for Big Data Feature Recognition of Industrial Electrical Equipment , 2019, IEEE Transactions on Industrial Informatics.

[35]  Chunhui Zhao,et al.  Sparse Exponential Discriminant Analysis and Its Application to Fault Diagnosis , 2018, IEEE Transactions on Industrial Electronics.

[36]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[37]  Karim Salahshoor,et al.  Centralized and decentralized process and sensor fault monitoring using data fusion based on adaptive extended Kalman filter algorithm , 2008 .

[38]  Frank L. Lewis,et al.  Adaptive Asymptotic Neural Network Control of Nonlinear Systems With Unknown Actuator Quantization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Youxian Sun,et al.  Remaining Useful Life Prediction for a Nonlinear Heterogeneous Wiener Process Model With an Adaptive Drift , 2015, IEEE Transactions on Reliability.

[40]  Lijun Zhang,et al.  Remaining Useful Life Prediction for Lithium-Ion Batteries Based on Exponential Model and Particle Filter , 2018, IEEE Access.

[41]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[42]  Soumaya Yacout,et al.  Bidirectional handshaking LSTM for remaining useful life prediction , 2019, Neurocomputing.