Deep-Convolution-Based LSTM Network for Remaining Useful Life Prediction

Accurate prediction of remaining useful life (RUL) has been a critical and challenging problem in the field of prognostics and health management (PHM), which aims to make decisions on which component needs to be replaced when. In this article, a novel deep neural network named convolution-based long short-term memory (CLSTM) network is proposed to predict the RUL of rotating machineries mining the in situ vibration data. Different from previous research that simply connects a convolutional neural network (CNN) to a long short-term memory (LSTM) network serially, the proposed network conducts convolutional operation on both the input-to-state and state-to-state transitions of the LSTM, which contains both time–frequency and temporal information of signals, not only preserving the advantages of LSTM, but also incorporating time–frequency features. The convolutional structure in the LSTM has the ability to capture long-term dependencies and extract features from the time–frequency domain at the same time. By stacking the multiple CLSTM layer-by-layer and forming an encoding-forecasting architecture, the deep learning model is established for RUL prediction in this article. Run-to-failure tests on bearings are conducted, and vibration responses are collected. Using the proposed algorithm, RUL is predicted, and as a comparison, the performance from other methods, including deep CNNs and deep LSTM, is evaluated using the same dataset. The comparative study indicates that the proposed CLSTM network outperforms the current deep learning algorithms in URL prediction and system prognosis with respect to better accuracy and computation efficiency.

[1]  Haidong Shao,et al.  Electric Locomotive Bearing Fault Diagnosis Using a Novel Convolutional Deep Belief Network , 2018, IEEE Transactions on Industrial Electronics.

[2]  Zhengjia He,et al.  Remaining life prognostics of rolling bearing based on relative features and multivariable support vector machine , 2013 .

[3]  Ali Emadi,et al.  Long Short-Term Memory Networks for Accurate State-of-Charge Estimation of Li-ion Batteries , 2018, IEEE Transactions on Industrial Electronics.

[4]  Matthew Daigle,et al.  Model-based prognostics under limited sensing , 2010, 2010 IEEE Aerospace Conference.

[5]  Enrico Zio,et al.  Online Performance Assessment Method for a Model-Based Prognostic Approach , 2016, IEEE Transactions on Reliability.

[6]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[7]  Meng Ma,et al.  A Deep Coupled Network for Health State Assessment of Cutting Tools Based on Fusion of Multisensory Signals , 2019, IEEE Transactions on Industrial Informatics.

[8]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[9]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[10]  Zhibin Zhao,et al.  Deep Transfer Learning Based on Sparse Autoencoder for Remaining Useful Life Prediction of Tool in Manufacturing , 2019, IEEE Transactions on Industrial Informatics.

[11]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[12]  Shibin Wang,et al.  Matching synchrosqueezing transform: A useful tool for characterizing signals with fast varying instantaneous frequency and application to machine fault diagnosis , 2018 .

[13]  Ruyi Huang,et al.  Deep Decoupling Convolutional Neural Network for Intelligent Compound Fault Diagnosis , 2019, IEEE Access.

[14]  Ruqiang Yan,et al.  Learning to Monitor Machine Health with Convolutional Bi-Directional LSTM Networks , 2017, Sensors.

[15]  Mohamed Elforjani,et al.  Prognosis of Bearing Acoustic Emission Signals Using Supervised Machine Learning , 2018, IEEE Transactions on Industrial Electronics.

[16]  Chuang Sun,et al.  Discriminative Deep Belief Networks with Ant Colony Optimization for Health Status Assessment of Machine , 2017, IEEE Transactions on Instrumentation and Measurement.

[17]  Huibin Sun,et al.  A Hybrid Approach to Cutting Tool Remaining Useful Life Prediction Based on the Wiener Process , 2018, IEEE Transactions on Reliability.

[18]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[19]  Shibin Wang,et al.  Locally Linear Embedding on Grassmann Manifold for Performance Degradation Assessment of Bearings , 2017, IEEE Transactions on Reliability.

[20]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[22]  Chi Zhang,et al.  Subspace-based MVE for performance degradation assessment of aero-engine bearings with multimodal features , 2019, Mechanical Systems and Signal Processing.

[23]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[24]  Huihui Miao,et al.  Joint Learning of Degradation Assessment and RUL Prediction for Aeroengines via Dual-Task Deep LSTM Networks , 2019, IEEE Transactions on Industrial Informatics.

[25]  Konstantinos Gryllias,et al.  Mechanical fault diagnosis using Convolutional Neural Networks and Extreme Learning Machine , 2019, Mechanical Systems and Signal Processing.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Gaigai Cai,et al.  Nonconvex Sparse Regularization and Convex Optimization for Bearing Fault Diagnosis , 2018, IEEE Transactions on Industrial Electronics.

[28]  Chuang Sun,et al.  Deep Coupling Autoencoder for Fault Diagnosis With Multimodal Sensory Data , 2018, IEEE Transactions on Industrial Informatics.

[29]  Zhibin Zhao,et al.  Sparse Deep Stacking Network for Fault Diagnosis of Motor , 2018, IEEE Transactions on Industrial Informatics.

[30]  Hicham Chaoui,et al.  Remaining Useful Life Prognosis of Supercapacitors Under Temperature and Voltage Aging Conditions , 2018, IEEE Transactions on Industrial Electronics.

[31]  Ruqiang Yan,et al.  Convolutional Discriminative Feature Learning for Induction Motor Fault Diagnosis , 2017, IEEE Transactions on Industrial Informatics.

[32]  Tara N. Sainath,et al.  Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).