A Regularized LSTM Method for Predicting Remaining Useful Life of Rolling Bearings

Rotating machinery is important to industrial production. Any failure of rotating machinery, especially the failure of rolling bearings, can lead to equipment shutdown and even more serious incidents. Therefore, accurate residual life prediction plays a crucial role in guaranteeing machine operation safety and reliability and reducing maintenance cost. In order to increase the forecasting precision of the remaining useful life (RUL) of the rolling bearing, an advanced approach combining elastic net with long short-time memory network (LSTM) is proposed, and the new approach is referred to as E-LSTM. The E-LSTM algorithm consists of an elastic mesh and LSTM, taking temporal-spatial correlation into consideration to forecast the RUL through the LSTM. To solve the over-fitting problem of the LSTM neural network during the training process, the elastic net based regularization term is introduced to the LSTM structure. In this way, the change of the output can be well characterized to express the bearing degradation mode. Experimental results from the real-world data demonstrate that the proposed E-LSTM method can obtain higher stability and relevant values that are useful for the RUL forecasting of bearing. Furthermore, these results also indicate that E-LSTM can achieve better performance.

[1]  Steven L. Brunton,et al.  Data-Driven Sparse Sensor Placement for Reconstruction: Demonstrating the Benefits of Exploiting Known Patterns , 2017, IEEE Control Systems.

[2]  Ali Emadi,et al.  Long Short-Term Memory Networks for Accurate State-of-Charge Estimation of Li-ion Batteries , 2018, IEEE Transactions on Industrial Electronics.

[3]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[4]  Jong-Myon Kim,et al.  A Hybrid Prognostics Technique for Rolling Element Bearings Using Adaptive Predictive Models , 2018, IEEE Transactions on Industrial Electronics.

[5]  C. JennyL.Diaz,et al.  Phenomenological Based Soft Sensor for Online Estimation of Slurry Rheological Properties , 2019, Int. J. Autom. Comput..

[6]  Lin Zhao,et al.  A Deep Feature Optimization Fusion Method for Extracting Bearing Degradation Features , 2018, IEEE Access.

[7]  Andrew Ball,et al.  An Approach to Reducing Input Parameter Volume for Fault Classifiers , 2019, International Journal of Automation and Computing.

[8]  Hao Zhang,et al.  Attention-Based LSTM Network for Rotatory Machine Remaining Useful Life Prediction , 2020, IEEE Access.

[9]  Enrico Zio,et al.  An adaptive method for health trend prediction of rotating bearings , 2014, Digit. Signal Process..

[10]  Hong-Tao Ye,et al.  PID Neural Network Decoupling Control Based on Hybrid Particle Swarm Optimization and Differential Evolution , 2015, International Journal of Automation and Computing.

[11]  Yanyang Zi,et al.  A Two-Stage Data-Driven-Based Prognostic Approach for Bearing Degradation Problem , 2016, IEEE Transactions on Industrial Informatics.

[12]  Ina Ruck,et al.  USA , 1969, The Lancet.

[13]  Jianhua Tao,et al.  Semi-supervised Ladder Networks for Speech Emotion Recognition , 2019, International Journal of Automation and Computing.

[14]  Bin Zhang,et al.  Machine Condition Prediction Based on Adaptive Neuro–Fuzzy and High-Order Particle Filtering , 2011, IEEE Transactions on Industrial Electronics.

[15]  Noureddine Zerhouni,et al.  Bearing Health Monitoring Based on Hilbert–Huang Transform, Support Vector Machine, and Regression , 2015, IEEE Transactions on Instrumentation and Measurement.

[16]  Lulu Zhang,et al.  Joint Label-Density-Margin Space and Extreme Elastic Net for Label-Specific Features , 2019, IEEE Access.

[17]  Selin Aviyente,et al.  Extended Kalman Filtering for Remaining-Useful-Life Estimation of Bearings , 2015, IEEE Transactions on Industrial Electronics.

[18]  Junsheng Cheng,et al.  Generalized composite multiscale permutation entropy and Laplacian score based rolling bearing fault diagnosis , 2018 .

[19]  Donghua Zhou,et al.  Remaining Useful Life Estimation Based on a Nonlinear Diffusion Degradation Process , 2012, IEEE Transactions on Reliability.

[20]  Lifeng Xi,et al.  Residual life predictions for ball bearings based on self-organizing map and back propagation neural network methods , 2007 .

[21]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[22]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[23]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[24]  Brigitte Chebel-Morello,et al.  PRONOSTIA : An experimental platform for bearings accelerated degradation tests. , 2012 .

[25]  Wei Qiao,et al.  Enhanced Particle Filtering for Bearing Remaining Useful Life Prediction of Wind Turbine Drivetrain Gearboxes , 2019, IEEE Transactions on Industrial Electronics.

[26]  Noureddine Zerhouni,et al.  A Data-Driven Failure Prognostics Method Based on Mixture of Gaussians Hidden Markov Models , 2012, IEEE Transactions on Reliability.

[27]  Bidyut B. Chaudhuri,et al.  A Modified LSTM Model for Continuous Sign Language Recognition Using Leap Motion , 2019, IEEE Sensors Journal.

[28]  Joseph Mathew,et al.  USING THE CORRELATION DIMENSION FOR VIBRATION FAULT DIAGNOSIS OF ROLLING ELEMENT BEARINGS—II. SELECTION OF EXPERIMENTAL PARAMETERS , 1996 .

[29]  Jianbo Yu,et al.  A nonlinear probabilistic method and contribution analysis for machine condition monitoring , 2013 .

[30]  Junyou Shi,et al.  Quantum Assimilation-Based State-of-Health Assessment and Remaining Useful Life Estimation for Electronic Systems , 2016, IEEE Transactions on Industrial Electronics.

[31]  CHEN Yuhang,et al.  Prediction of Bearing Degradation Trend based on LSTM , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[32]  Junyu Dong,et al.  A CFCC-LSTM Model for Sea Surface Temperature Prediction , 2018, IEEE Geoscience and Remote Sensing Letters.

[33]  David He,et al.  Using Deep Learning-Based Approach to Predict Remaining Useful Life of Rotating Components , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[34]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[35]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[36]  Ying Chen,et al.  A Physics-Based Modeling Approach for Performance Monitoring in Gas Turbine Engines , 2015, IEEE Transactions on Reliability.

[37]  Robert X. Gao,et al.  Prognosis of Defect Propagation Based on Recurrent Neural Networks , 2011, IEEE Transactions on Instrumentation and Measurement.

[38]  Jürgen Schmidhuber,et al.  LSTM can Solve Hard Long Time Lag Problems , 1996, NIPS.

[39]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[40]  Ming Jian Zuo,et al.  Semi-Markov Process-Based Integrated Importance Measure for Multi-State Systems , 2015, IEEE Transactions on Reliability.

[41]  Hicham Medromi,et al.  Bearings Prognostic Using Mixture of Gaussians Hidden Markov Model and Support Vector Machine , 2013 .

[42]  Bo Li,et al.  Sequential Fault Diagnosis Using an Inertial Velocity Differential Evolution Algorithm , 2019, Int. J. Autom. Comput..

[43]  Yu Yang,et al.  Enhanced deep gated recurrent unit and complex wavelet packet energy moment entropy for early fault prognosis of bearing , 2020, Knowl. Based Syst..

[44]  Q. H. Wu,et al.  A Data-Driven Residual-Based Method for Fault Diagnosis and Isolation in Wind Turbines , 2019, IEEE Transactions on Sustainable Energy.

[45]  Nadège Bouchonneau,et al.  A review of wind turbine bearing condition monitoring: State of the art and challenges , 2016 .

[46]  Zohir Dibi,et al.  Modeling of a Smart Nano Force Sensor Using Finite Elements and Neural Networks , 2020, Int. J. Autom. Comput..

[47]  Xiaobing Pei,et al.  Super-Resolution of Face Images Using Weighted Elastic Net Constrained Sparse Representation , 2019, IEEE Access.