An Enhanced Deep Learning-Based Fusion Prognostic Method for RUL Prediction

This article proposes a novel deep learning based fusion prognostic method for remaining useful life (RUL) prediction of engineering systems. The proposed framework strategically combines the advantages of bidirectional long short-term memory (BLSTM) networks and particle filter (PF) method and meanwhile mitigates their limitations. In the proposed framework, BLSTM networks are applied for further extracting, selecting, and fusing discriminative features to form predicted measurements of the identified degradation indicator. Simultaneously, PF is utilized to estimate system state and identify unknown parameters of the degradation model for RUL prediction. Hence, the proposed fusion prognostic framework has two innovative features: first, the preprocessed features from raw multisensor data can be intelligently extracted, selected, and fused by the BLSTM networks without specific domain knowledge of feature engineering; second, the predicted measurements with uncertainties obtained from the BLSTM networks will be properly represented by the PF in a transparent manner. Moreover, the developed approach is experimentally validated with machining tool wear tests on a computer numerical control (CNC) milling machine. In addition, the popular techniques employed in this field are also investigated to compare with the proposed method.

[1]  Dawn An,et al.  Prognostics 101: A tutorial for particle filter-based prognostics algorithm using Matlab , 2013, Reliab. Eng. Syst. Saf..

[2]  J. Archard Contact and Rubbing of Flat Surfaces , 1953 .

[3]  Hong-Zhong Huang,et al.  Physics of failure-based reliability prediction of turbine blades using multi-source information fusion , 2018, Appl. Soft Comput..

[4]  Robert X. Gao,et al.  A virtual sensing based augmented particle filter for tool condition prognosis , 2017 .

[5]  Yuan Liao,et al.  Uncertainty Prediction of Remaining Useful Life Using Long Short-Term Memory Network Based on Bootstrap Method , 2018, 2018 IEEE International Conference on Prognostics and Health Management (ICPHM).

[6]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[7]  Weiwen Peng,et al.  Reliability analysis of multi-state systems with common cause failures based on Bayesian network and fuzzy probability , 2019, Ann. Oper. Res..

[8]  Weiwen Peng,et al.  Reliability analysis of complex multi-state system with common cause failure based on evidential networks , 2018, Reliab. Eng. Syst. Saf..

[9]  Weiwen Peng,et al.  Reliability assessment of complex electromechanical systems under epistemic uncertainty , 2016, Reliab. Eng. Syst. Saf..

[10]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[11]  Fei Shen,et al.  Machine Health Monitoring Using Local Feature-Based Gated Recurrent Unit Networks , 2018, IEEE Transactions on Industrial Electronics.

[12]  George J. Vachtsevanos,et al.  A particle-filtering approach for on-line fault diagnosis and failure prognosis , 2009 .

[13]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[14]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[15]  Enrico Zio,et al.  Particle filtering prognostic estimation of the remaining useful life of nonlinear components , 2011, Reliab. Eng. Syst. Saf..

[16]  Hong-Zhong Huang,et al.  Reliability assessment of multi-state phased mission system with non-repairable multi-state components , 2018, Applied Mathematical Modelling.

[17]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[18]  Takehisa Yairi,et al.  A review on the application of deep learning in system health management , 2018, Mechanical Systems and Signal Processing.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[21]  Krzysztof Jemielniak,et al.  Advanced monitoring of machining operations , 2010 .

[22]  Hong-Zhong Huang,et al.  Intelligent fault recognition strategy based on adaptive optimized multiple centers , 2018, Mechanical Systems and Signal Processing.

[23]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[24]  S. K. Choudhury,et al.  Tool wear prediction in turning , 2004 .

[25]  Jun Wu,et al.  Multi-sensor information fusion for remaining useful life prediction of machining tools by adaptive network based fuzzy inference system , 2018, Appl. Soft Comput..

[26]  Jie Liu,et al.  A multi-step predictor with a variable input pattern for system state forecasting , 2009 .

[27]  Noureddine Zerhouni,et al.  A feature extraction procedure based on trigonometric functions and cumulative descriptors to enhance prognostics modeling , 2013, 2013 IEEE Conference on Prognostics and Health Management (PHM).

[28]  Jay Lee,et al.  Industrial Big Data Analytics and Cyber-physical Systems for Future Maintenance & Service Innovation , 2015 .

[29]  Rong Li,et al.  Residual-life distributions from component degradation signals: A Bayesian approach , 2005 .

[30]  Enrico Zio,et al.  Investigation of uncertainty treatment capability of model-based and data-driven prognostic methods using simulated data , 2013, Reliab. Eng. Syst. Saf..

[31]  Hong-Zhong Huang,et al.  A Bidirectional LSTM Prognostics Method Under Multiple Operational Conditions , 2019, IEEE Transactions on Industrial Electronics.

[32]  Dirk P. Kroese,et al.  Kernel density estimation via diffusion , 2010, 1011.2602.

[33]  Enrico Zio,et al.  Reliability assessment of phased-mission systems under random shocks , 2018, Reliab. Eng. Syst. Saf..

[34]  Weiwen Peng,et al.  Scheduling Preventive Maintenance Considering the Saturation Effect , 2019, IEEE Transactions on Reliability.

[35]  Yaguo Lei,et al.  A review on empirical mode decomposition in fault diagnosis of rotating machinery , 2013 .

[36]  Enrico Zio,et al.  Model-based and data-driven prognostics under different available information , 2013 .

[37]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[38]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[39]  M. J. Er,et al.  Fuzzy Neural Network Modelling for Tool Wear Estimation in Dry Milling Operation , 2009 .

[40]  Rui Peng,et al.  A preventive maintenance policy based on dependent two-stage deterioration and external shocks , 2017, Reliab. Eng. Syst. Saf..

[41]  Jamie B. Coble,et al.  Applying the General Path Model to Estimation of Remaining Useful Life , 2011, International Journal of Prognostics and Health Management.

[42]  W. Wang,et al.  A data-model-fusion prognostic framework for dynamic system state forecasting , 2012, Eng. Appl. Artif. Intell..

[43]  Enrico Zio,et al.  Ensemble neural network-based particle filtering for prognostics , 2013 .

[44]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .

[45]  David He,et al.  Using Deep Learning-Based Approach to Predict Remaining Useful Life of Rotating Components , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[46]  Noureddine Zerhouni,et al.  Particle filter-based prognostics: Review, discussion and perspectives , 2016 .

[47]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Manuel Esperon-Miguez,et al.  A review of physics-based models in prognostics: Application to gears and bearings of rotating machinery , 2016 .