A novel deep convolutional neural network-bootstrap integrated method for RUL prediction of rolling bearing

Abstract In this study, a novel deep convolutional neural network-bootstrap-based integrated prognostic approach for the remaining useful life (RUL) prediction of rolling bearing is developed. The proposed architecture includes two main parts: 1) a deep convolutional neural network–multilayer perceptron (i.e., DCNN–MLP) dual network is utilized to simultaneously extract informative representations hidden in both time series-based and image-based features and to predict the RUL of bearings, and 2) the proposed dual network is embedded into the bootstrap-based implementation framework to quantify the RUL prediction interval. Unlike other deep-learning-based prognostic approaches, the proposed DCNN-bootstrap integrated method has two innovative features: 1) both 1D time series-based and 2D image-based features of bearings, which can multi-dimensionally characterize the degradation of bearings, are comprehensively leveraged by the proposed dual network, and 2) the RUL prediction interval can be effectively quantified without relying on the bearing’s physical or statistical prior information based on bootstrap implementation paradigm. The proposed approach is experimentally validated with two case studies on rolling element bearings, and comparisons with other state-of-the-art techniques are also presented. Subsequently, our code will be open sourced.

[1]  Min Xie,et al.  A Dynamic-Bayesian-Network-Based Fault Diagnosis Methodology Considering Transient and Intermittent Faults , 2017, IEEE Transactions on Automation Science and Engineering.

[2]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[3]  Andrew Kusiak,et al.  Data-driven smart manufacturing , 2018, Journal of Manufacturing Systems.

[4]  Noureddine Zerhouni,et al.  Industrial data management strategy towards an SME-oriented PHM , 2020, Journal of Manufacturing Systems.

[5]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[6]  Brigitte Chebel-Morello,et al.  PRONOSTIA : An experimental platform for bearings accelerated degradation tests. , 2012 .

[7]  Zhao Chen,et al.  Prognostic study of ball screws by ensemble data-driven particle filters , 2020 .

[8]  Haifeng Wang,et al.  Remaining Useful Life Estimation of Structure Systems Under the Influence of Multiple Causes: Subsea Pipelines as a Case Study , 2020, IEEE Transactions on Industrial Electronics.

[9]  Saeid Nahavandi,et al.  A prediction interval-based approach to determine optimal structures of neural network metamodels , 2010, Expert Syst. Appl..

[10]  Xu Li,et al.  Deep learning-based adversarial multi-classifier optimization for cross-domain machinery fault diagnostics , 2020 .

[11]  Okyay Kaynak,et al.  Big Data for Modern Industry: Challenges and Trends [Point of View] , 2015, Proc. IEEE.

[12]  Fei Teng,et al.  A Deep Learning-Based Remaining Useful Life Prediction Approach for Bearings , 2020, IEEE/ASME Transactions on Mechatronics.

[13]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .

[14]  Jing Lin,et al.  Transfer fault diagnosis of bearing installed in different machines using enhanced deep auto-encoder , 2020 .

[15]  Yonghong Liu,et al.  Fault detection and diagnostic method of diesel engine by combining rule-based algorithm and BNs/BPNNs , 2020 .

[16]  Fei Shen,et al.  Machine Health Monitoring Using Local Feature-Based Gated Recurrent Unit Networks , 2018, IEEE Transactions on Industrial Electronics.

[17]  Jun Zhu,et al.  A new data-driven transferable remaining useful life prediction approach for bearing under different working conditions , 2020 .

[18]  Robert X. Gao,et al.  An integrated fault diagnosis and prognosis approach for predictive maintenance of wind turbine bearing with limited samples , 2020 .

[19]  Tao Zhang,et al.  Interval prediction of solar power using an Improved Bootstrap method , 2018 .

[20]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[21]  Weiwen Peng,et al.  Bayesian Deep-Learning-Based Health Prognostics Toward Prognostics Uncertainty , 2020, IEEE Transactions on Industrial Electronics.

[22]  Bernard Grabot,et al.  Towards multi-model approaches to predictive maintenance: A systematic literature survey on diagnostics and prognostics , 2020, Journal of Manufacturing Systems.

[23]  Yaguo Lei,et al.  A Hybrid Prognostics Approach for Estimating Remaining Useful Life of Rolling Element Bearings , 2020, IEEE Transactions on Reliability.

[24]  M. Zaeh,et al.  Utilizing uncertainty information in remaining useful life estimation via Bayesian neural networks and Hamiltonian Monte Carlo , 2020 .

[25]  Wenyi Liu,et al.  Wind turbine fault diagnosis based on Morlet wavelet transformation and Wigner-Ville distribution , 2010 .

[26]  Yan-Feng Li,et al.  An Enhanced Deep Learning-Based Fusion Prognostic Method for RUL Prediction , 2020, IEEE Transactions on Reliability.

[27]  Xiaohui Yan,et al.  A Review on Deep Learning Applications in Prognostics and Health Management , 2019, IEEE Access.

[28]  Yaguo Lei,et al.  An Improved Exponential Model for Predicting Remaining Useful Life of Rolling Element Bearings , 2015, IEEE Transactions on Industrial Electronics.

[29]  S. Scholtes,et al.  Empirical prediction intervals revisited , 2014 .

[30]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[32]  Jiyan Wu,et al.  A joint classification-regression method for multi-stage remaining useful life prediction , 2021 .

[33]  Wei Zhang,et al.  Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction , 2019, Reliab. Eng. Syst. Saf..

[34]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[35]  Hong-Zhong Huang,et al.  A Bidirectional LSTM Prognostics Method Under Multiple Operational Conditions , 2019, IEEE Transactions on Industrial Electronics.

[36]  Yubin Pan,et al.  A hybrid DBN-SOM-PF-based prognostic approach of remaining useful life for wind turbine gearbox , 2020 .

[37]  Lei Huang,et al.  Bayesian Networks in Fault Diagnosis , 2017, IEEE Transactions on Industrial Informatics.