Mechanical state prediction based on LSTM neural netwok

Effective mechanical state prediction systems are critical to modern manufacturing systems and industries. As a method of deep learning algorithm, Recurrent neural network, (RNN) has been playing an increasingly important role in the field of time series prediction. In order to solve the problem of hard training and gradient extinction of RNN model, a long short-term memory network (LSTM) algorithm is proposed and applied to the prediction of mechanical state (PMS). On the basis of the motor bearing data, the simulation is carried out. Aiming at the non-stationary of bearing data, the empirical mode decomposition (EMD) is used to decompose the bearing data into stationary singles, and the intrinsic mode function (IMF) energy entropy is calculated as the feature of mechanical state. In comparison with support vector regression machine (SVRM), LSTM achieves a better result in the single-step prediction of mechanical state. It shows that LSTM is superior in machine state prediction and monitoring.

[1]  Rolf Isermann,et al.  Supervision, fault-detection and fault-diagnosis methods — An introduction , 1997 .

[2]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Hermann Ney,et al.  LSTM Neural Networks for Language Modeling , 2012, INTERSPEECH.

[4]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[5]  Mohd Azlishah Othman,et al.  Advances in Machine Learning and Signal Processing , 2016 .

[6]  Peng Wang,et al.  Fault prognostics using dynamic wavelet neural networks , 2001, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[7]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[8]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[9]  Hai Qiu,et al.  Wavelet filter-based weak signature detection method and its application on rolling element bearing prognostics , 2006 .

[10]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Geoffrey E. Hinton,et al.  Application of Deep Belief Networks for Natural Language Understanding , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[13]  Yang Yu,et al.  A roller bearing fault diagnosis method based on EMD energy entropy and ANN , 2006 .

[14]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[15]  Alex Graves,et al.  Supervised Sequence Labelling with Recurrent Neural Networks , 2012, Studies in Computational Intelligence.

[16]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[17]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Richard C.M. Yam,et al.  Intelligent Predictive Decision Support System for Condition-Based Maintenance , 2001 .

[19]  Maher A. Sid-Ahmed,et al.  Machine recognition of optically captured machine printed arabic text , 1990, Pattern Recognit..