Predicting Air Compressor Failures Using Long Short Term Memory Networks

We introduce an LSTM-based method for predicting compressor failures using aggregated sensory data, and evaluate it using historical information from over 1000 heavy duty vehicles during 2015 and 2016. The goal is to proactively identify trucks that will require maintenance in the near future, so that component replacement can be scheduled before the failure happens, translating into improved uptime. The problem is formulated as a classification task of whether a compressor failure will happen within the specified prediction horizon. A recurrent neural network using Long Short-Term Memory (LSTM) architecture is employed as the prediction model, and compared against Random Forest (RF), the solution used in industrial deployment at the moment. Experimental results show that while Random Forest slightly outperforms LSTM in terms of AUC score, the predictions of LSTM stay significantly more stable over time, showing a consistent trend from healthy to faulty class. Additionally, LSTM is also better at detecting the switch from faulty class to the healthy one after a repair. We demonstrate that this stability is important for making repair decisions, especially in questionable cases, and therefore LSTM model is likely to lead to better results in practice.

[1]  Abhinav Saxena,et al.  Damage propagation modeling for aircraft engine run-to-failure simulation , 2008, 2008 International Conference on Prognostics and Health Management.

[2]  Enrico Zio,et al.  Echo State Network for the Remaining Useful Life Prediction of a Turbofan Engine , 2016, PHM Society European Conference.

[3]  F.O. Heimes,et al.  Recurrent neural networks for remaining useful life estimation , 2008, 2008 International Conference on Prognostics and Health Management.

[4]  Stefan Byttner,et al.  Wisdom of Crowds for Intelligent Monitoring of Vehicle Fleets , 2015 .

[5]  Slawomir Nowaczyk,et al.  Predicting the need for vehicle compressor repairs using maintenance records and logged vehicle data , 2015, Eng. Appl. Artif. Intell..

[6]  Jie Liu Shannon wavelet spectrum analysis on truncated vibration signals for machine incipient fault detection , 2012 .

[7]  Guang-Hong Yang,et al.  Fault Detection for Discrete-Time Switched Systems in Finite-Frequency Domain , 2015, Circuits Syst. Signal Process..

[8]  Mohammed Chadli,et al.  Fuzzy Fault Detection Filter Design for T–S Fuzzy Systems in the Finite-Frequency Domain , 2017, IEEE Transactions on Fuzzy Systems.

[9]  V. Rai,et al.  Bearing fault diagnosis using FFT of intrinsic mode functions in Hilbert-Huang transform , 2007 .

[10]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[11]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[12]  Lovekesh Vig,et al.  Predicting Remaining Useful Life using Time Series Embeddings based on Recurrent Neural Networks , 2017, International Journal of Prognostics and Health Management.

[13]  Robert X. Gao,et al.  Prognosis of Defect Propagation Based on Recurrent Neural Networks , 2011, IEEE Transactions on Instrumentation and Measurement.

[14]  Stefan Byttner,et al.  Towards relation discovery for diagnostics , 2011, KDD4Service '11.

[15]  Bhaskar Saha,et al.  An Adaptive Recurrent Neural Network for Remaining Useful Life Prediction of Lithium-ion Batteries , 2010 .

[16]  Rune Prytz,et al.  Machine learning methods for vehicle predictive maintenance using off-board and on-board data , 2014 .

[17]  Jürgen Schmidhuber,et al.  Offline Handwriting Recognition with Multidimensional Recurrent Neural Networks , 2008, NIPS.

[18]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[19]  Kai Goebel,et al.  A Survey of Artificial Intelligence for Prognostics , 2007, AAAI Fall Symposium: Artificial Intelligence for Prognostics.

[20]  Chetan Gupta,et al.  Long Short-Term Memory Network for Remaining Useful Life estimation , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[21]  Bin Zhang,et al.  Lithium-ion battery remaining useful life prediction with Deep Belief Network and Relevance Vector Machine , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[22]  A. Ahmadimanesh,et al.  Transient-Based Fault-Location Method for Multiterminal Lines Employing S-Transform , 2013, IEEE Transactions on Power Delivery.

[23]  Slawomir Nowaczyk,et al.  Analysis of Truck Compressor Failures Based on Logged Vehicle Data , 2013, ICDM 2013.

[24]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.