This paper proposes a hybrid prediction technique based on Recurrent Neural Network Long-Short-Term Memory (RNN-LSTM) with the integration of Particle Swarm Optimization (PSO) algorithm to estimate the Remaining Useful Life (RUL) of machines. LSTM is an improvement of RNN as RNN faces issues with predicting long-term dependencies. Issues such as vanishing and exploding gradients are the results of backpropagating errors, taking place when the network is learning to store and relate information over extended time intervals. RNN-LSTM is a feasible technique for this research due to its effectiveness in resolving sequential long-term dependencies problems. However, the accuracy can still be enhanced to a satisfactory value considering the optimal network topology has not been discovered yet. Accuracy improvement can be achieved by resorting to hyperparameter tuning. A result of proof of concept validates that by increasing the number of epochs, the accuracy of prediction has improved but increases the execution time. To optimize between the accuracy and execution time, a population-inspired Particle Swarm Optimization (PSO) algorithm is employed. PSO will be utilized to select the optimal RNN-LSTM topology specifically the learning rate instead of using manual search. This optimized hybrid prediction technique is useful to be implemented in predictive maintenance to predict machine failure.
[1]
S. P. Rajagopalan,et al.
A Comparative Analysis of Optimization Techniques for Artificial Neural Network in Bio Medical Applications
,
2014,
J. Comput. Sci..
[2]
Arthur H. A. Melani,et al.
Equipment failure prediction based on neural network analysis incorporating maintainers inspection findings
,
2017,
2017 Annual Reliability and Maintainability Symposium (RAMS).
[3]
Andrew Kusiak,et al.
Prediction of Status Patterns of Wind Turbines: A Data-Mining Approach
,
2011
.
[4]
Jeffrey S. Saltz,et al.
An Introduction to Data Science
,
2017
.
[5]
Voratas Kachitvichyanukul,et al.
Comparison of Three Evolutionary Algorithms: GA, PSO, and DE
,
2012
.
[6]
Pranav Gokhale,et al.
Applications of Convolutional Neural Networks
,
2016
.
[7]
Riccardo Poli,et al.
Particle swarm optimization
,
1995,
Swarm Intelligence.
[8]
Jürgen Schmidhuber,et al.
Long Short-Term Memory
,
1997,
Neural Computation.
[9]
Lakhmi C. Jain,et al.
Recurrent Neural Networks: Design and Applications
,
1999
.
[10]
Christian Blum,et al.
Ant colony optimization: Introduction and recent trends
,
2005
.