Macroscopic–Microscopic Attention in LSTM Networks Based on Fusion Features for Gear Remaining Life Prediction

In the mechanical transmission system, the gear is one of the most widely used transmission components. The failure of the gear will cause serious accidents and huge economic loss. Therefore, the remaining life prediction of the gear is of great importance. In order to accurately predict the remaining life of the gear, a new type of long-short-term memory neural network with macroscopic–microscopic attention (MMA) is proposed in this article. First, some typical time-domain and frequency-domain characteristics of vibration signals are calculated, respectively, such as the maximum value, the absolute mean value, the standard deviation, the kurtosis, and so on. Then, the principal component of these characteristics is extracted by the isometric mapping method. The importance of fusional characteristic information is filtered via a proposed MMA mechanism so that the input weight of neural network data and recursive data can reach multilevel real-time amplification. With the new long short-term memory neural network, the health characteristics of gear vibration signals can be predicted based on the known fusion features. The experimental results show that this method can predict the remaining life of gears and bearings well, and it has higher prediction accuracy than the conventional prediction methods.

[1]  Ming J. Zuo,et al.  Induction Motor Stator Current AM-FM Model and Demodulation Analysis for Planetary Gearbox Fault Diagnosis , 2019, IEEE Transactions on Industrial Informatics.

[2]  Yoshua Bengio,et al.  Fine-grained attention mechanism for neural machine translation , 2018, Neurocomputing.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Sridha Sridharan,et al.  Soft + Hardwired Attention: An LSTM Framework for Human Trajectory Prediction and Abnormal Event Detection , 2017, Neural Networks.

[5]  Wanming Zhai,et al.  Vibration feature evolution of locomotive with tooth root crack propagation of gear transmission system , 2019, Mechanical Systems and Signal Processing.

[6]  Siliang Lu,et al.  A review of stochastic resonance in rotating machine fault detection , 2019, Mechanical Systems and Signal Processing.

[7]  Jun Wang,et al.  An automatic and robust features learning method for rotating machinery fault diagnosis based on contractive autoencoder , 2018, Eng. Appl. Artif. Intell..

[8]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[9]  Lei Zhang,et al.  Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Yi Qin,et al.  The Optimized Deep Belief Networks With Improved Logistic Sigmoid Units and Their Application in Fault Diagnosis for Planetary Gearboxes of Wind Turbines , 2019, IEEE Transactions on Industrial Electronics.

[11]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Li Lin,et al.  Fault diagnosis and remaining useful life estimation of aero engine using LSTM neural network , 2016, 2016 IEEE International Conference on Aircraft Utility Systems (AUS).

[13]  Dong Wang,et al.  An Intelligent Prognostic System for Gear Performance Degradation Assessment and Remaining Useful Life Estimation , 2015 .

[14]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[15]  Brigitte Chebel-Morello,et al.  PRONOSTIA : An experimental platform for bearings accelerated degradation tests. , 2012 .

[16]  Yi Qin,et al.  Transient Feature Extraction by the Improved Orthogonal Matching Pursuit and K-SVD Algorithm With Adaptive Transient Dictionary , 2020, IEEE Transactions on Industrial Informatics.

[17]  Peng Wang,et al.  Long short-term memory for machine remaining life prediction , 2018, Journal of Manufacturing Systems.

[18]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[19]  Qinkai Han,et al.  Vibration based condition monitoring and fault diagnosis of wind turbine planetary gearbox: A review , 2019, Mechanical Systems and Signal Processing.

[20]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[21]  Yanxue Wang,et al.  Research on variational mode decomposition and its application in detecting rub-impact fault of the rotor system , 2015 .

[22]  Chuang Lin,et al.  An LSTM-Based Method with Attention Mechanism for Travel Time Prediction , 2019, Sensors.

[23]  Osamu Shouno,et al.  Neural Trajectory Analysis of Recurrent Neural Network In Handwriting Synthesis , 2018, ArXiv.

[24]  Yuxin Cui,et al.  Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation , 2018, Applied Sciences.

[25]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[26]  Siliang Lu,et al.  Tacholess Speed Estimation in Order Tracking: A Review With Application to Rotating Machine Fault Diagnosis , 2019, IEEE Transactions on Instrumentation and Measurement.

[27]  Junyou Shi,et al.  Quantum Assimilation-Based State-of-Health Assessment and Remaining Useful Life Estimation for Electronic Systems , 2016, IEEE Transactions on Industrial Electronics.

[28]  Amir Najafi,et al.  Nonlinear Dimensionality Reduction via Path-Based Isometric Mapping , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Xuejie Zhang,et al.  Using a stacked residual LSTM model for sentiment intensity prediction , 2018, Neurocomputing.

[30]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[31]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[32]  Xue Li,et al.  Deep Attention-Based Spatially Recursive Networks for Fine-Grained Visual Recognition , 2019, IEEE Transactions on Cybernetics.

[33]  Jin Cui,et al.  Multi-bearing remaining useful life collaborative prediction: A deep learning approach , 2017 .

[34]  Cai-chao Zhu,et al.  Investigation on the influence of work holding equipment errors on contact characteristics of face-hobbed hypoid gear , 2019, Mechanism and Machine Theory.

[35]  K. I. Ramachandran,et al.  A comparative study on classification of features by SVM and PSVM extracted using Morlet wavelet for fault diagnosis of spur bevel gear box , 2008, Expert Syst. Appl..