A Bidirectional LSTM Prognostics Method Under Multiple Operational Conditions

Modern engineered systems generally work under complex operational conditions. However, most of the existing artificial intelligence (AI)-based prognostic methods still lack an effective model that can utilize operational conditions data for remaining useful life (RUL) prediction. This paper develops a novel prognostic method based on bidirectional long short-term memory (BLSTM) networks. The method can integrate multiple sensors data with operational conditions data for RUL prediction of engineered systems. The proposed architecture based on BLSTM networks includes three main parts: first, one BLSTM network is used to directly extract features hidden in the multiple raw sensors signals; second, another BLSTM network is employed to learn higher features from operational conditions signals and the learned features from the sensors signals; and, third, fully connected layers and a linear regression layer are stacked to generate the target output of the RUL prediction. Unlike other AI-based prognostic methods, the developed method can simultaneously model both sensors data and operational conditions data in a consolidated framework. The proposed approach is demonstrated through a case study on aircraft turbofan engines, and comparisons with other popular state-of-the-art methods are also presented.

[1]  H.A. Toliyat,et al.  Condition Monitoring and Fault Diagnosis of Electrical Motors—A Review , 2005, IEEE Transactions on Energy Conversion.

[2]  Xi Zhang,et al.  Multiple Sensor Data Fusion for Degradation Modeling and Prognostics Under Multiple Operational Conditions , 2016, IEEE Transactions on Reliability.

[3]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Nagi Gebraeel,et al.  Residual life predictions from vibration-based degradation signals: a neural network approach , 2004, IEEE Transactions on Industrial Electronics.

[5]  Abhinav Saxena,et al.  Damage propagation modeling for aircraft engine run-to-failure simulation , 2008, 2008 International Conference on Prognostics and Health Management.

[6]  Hong-Zhong Huang,et al.  Physics of failure-based reliability prediction of turbine blades using multi-source information fusion , 2018, Appl. Soft Comput..

[7]  F.O. Heimes,et al.  Recurrent neural networks for remaining useful life estimation , 2008, 2008 International Conference on Prognostics and Health Management.

[8]  L. Peel,et al.  Data driven prognostics using a Kalman filter ensemble of neural network models , 2008, 2008 International Conference on Prognostics and Health Management.

[9]  Wojciech Zaremba,et al.  An Empirical Exploration of Recurrent Network Architectures , 2015, ICML.

[10]  Chetan Gupta,et al.  Long Short-Term Memory Network for Remaining Useful Life estimation , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[11]  Weiwen Peng,et al.  Joint Online RUL Prediction for Multivariate Deteriorating Systems , 2019, IEEE Transactions on Industrial Informatics.

[12]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .

[13]  Hong-Zhong Huang,et al.  Support vector machine based estimation of remaining useful life: current research status and future trends , 2015, Journal of Mechanical Science and Technology.

[14]  W. Marsden.  I and J , 2012 .

[15]  Surya Ganguli,et al.  Exact solutions to the nonlinear dynamics of learning in deep linear neural networks , 2013, ICLR.

[16]  David He,et al.  Using Deep Learning-Based Approach to Predict Remaining Useful Life of Rotating Components , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Mayorkinos Papaelias,et al.  Condition monitoring of wind turbines: Techniques and methods , 2012 .

[18]  Zhigang Tian,et al.  An artificial neural network method for remaining useful life prediction of equipment subject to condition monitoring , 2012, J. Intell. Manuf..

[19]  Jay Lee,et al.  Service Innovation and Smart Analytics for Industry 4.0 and Big Data Environment , 2014 .

[20]  Mohamed Elforjani,et al.  Prognosis of Bearing Acoustic Emission Signals Using Supervised Machine Learning , 2018, IEEE Transactions on Industrial Electronics.

[21]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[23]  Ruqiang Yan,et al.  Learning to Monitor Machine Health with Convolutional Bi-Directional LSTM Networks , 2017, Sensors.

[24]  M. Farid Golnaraghi,et al.  Prognosis of machine health condition using neuro-fuzzy systems , 2004 .

[25]  Jie Liu,et al.  A multi-step predictor with a variable input pattern for system state forecasting , 2009 .

[26]  Hong-Zhong Huang,et al.  Remaining useful life estimation under degradation and shock damage , 2015 .

[27]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[28]  Yaguo Lei,et al.  A Wiener-Process-Model-Based Method for Remaining Useful Life Prediction Considering Unit-to-Unit Variability , 2019, IEEE Transactions on Industrial Electronics.

[29]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[32]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[33]  Nan Chen,et al.  The Inverse Gaussian Process as a Degradation Model , 2014, Technometrics.

[34]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[35]  Weiwen Peng,et al.  Reliability assessment of complex electromechanical systems under epistemic uncertainty , 2016, Reliab. Eng. Syst. Saf..

[36]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[37]  Fei Shen,et al.  Machine Health Monitoring Using Local Feature-Based Gated Recurrent Unit Networks , 2018, IEEE Transactions on Industrial Electronics.

[38]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[39]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[40]  Mohamed Benbouzid,et al.  A Brief Status on Condition Monitoring and Fault Diagnosis in Wind Energy Conversion Systems , 2009 .

[41]  Jong-Myon Kim,et al.  A Hybrid Prognostics Technique for Rolling Element Bearings Using Adaptive Predictive Models , 2018, IEEE Transactions on Industrial Electronics.