Recurrent convolutional neural network: A new framework for remaining useful life prediction of machinery

Abstract Deep learning is becoming more appealing in remaining useful life (RUL) prediction of machines, because it is able to automatically build the mapping relationship between the raw data and the corresponding RUL by representation learning. Among deep learning models, convolutional neural networks (CNNs) are gaining special attention because of its powerful ability in dealing with time-series signals, and have achieved promising results in current studies. These studies, however, suffer from the two limitations: (1) The temporal dependencies of different degradation states are not considered during network construction; and (2) The uncertainty of RUL prediction results cannot be obtained. To overcome the above-mentioned limitations, a new framework named recurrent convolutional neural network (RCNN) is proposed in this paper for RUL prediction of machinery. In RCNN, recurrent convolutional layers are first constructed to model the temporal dependencies of different degradation states. Then, variational inference is used to quantify the uncertainty of RCNN in RUL prediction. The proposed RCNN is evaluated using vibration data from accelerated degradation tests of rolling element bearings and sensor data from life testing of milling cutters, and compared with some state-of-the-art prognostics approaches. Experimental results demonstrate the effectiveness and superiority of RCNN in improving the accuracy and convergence of RUL prediction. More importantly, RCNN is able to provide a probabilistic RUL prediction result, which breaks the inherent limitation of CNNs and facilitates maintenance decision making.

[1]  Geoffrey E. Hinton,et al.  Keeping the neural networks simple by minimizing the description length of the weights , 1993, COLT '93.

[2]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[3]  Liang Guo,et al.  Machinery health indicator construction based on convolutional neural networks considering trend burr , 2018, Neurocomputing.

[4]  Kay Chen Tan,et al.  A Novel Time Series-Histogram of Features (TS-HoF) Method for Prognostic Applications , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[5]  Fuad E. Alsaadi,et al.  A new approach to non-fragile state estimation for continuous neural networks with time-delays , 2016, Neurocomputing.

[6]  P. S. Heyns,et al.  An integrated Gaussian process regression for prediction of remaining useful life of slow speed bearings based on acoustic emission , 2017 .

[7]  Fuad E. Alsaadi,et al.  On passivity and robust passivity for discrete-time stochastic neural networks with randomly occurring mixed time delays , 2017, Neural Computing and Applications.

[8]  Brigitte Chebel-Morello,et al.  PRONOSTIA : An experimental platform for bearings accelerated degradation tests. , 2012 .

[9]  Connor Jennings,et al.  A Comparative Study on Machine Learning Algorithms for Smart Manufacturing: Tool Wear Prediction Using Random Forests , 2017 .

[10]  Selin Aviyente,et al.  Extended Kalman Filtering for Remaining-Useful-Life Estimation of Bearings , 2015, IEEE Transactions on Industrial Electronics.

[11]  Yaguo Lei,et al.  A Hybrid Prognostics Approach for Estimating Remaining Useful Life of Rolling Element Bearings , 2020, IEEE Transactions on Reliability.

[12]  Ruqiang Yan,et al.  Learning to Monitor Machine Health with Convolutional Bi-Directional LSTM Networks , 2017, Sensors.

[13]  Yue Wang,et al.  Detection for Cutting Tool Wear Based on Convolution Neural Networks , 2018, 2018 12th International Conference on Reliability, Maintainability, and Safety (ICRMS).

[14]  Sankalita Saha,et al.  Metrics for Offline Evaluation of Prognostic Performance , 2021, International Journal of Prognostics and Health Management.

[15]  Yuxuan Chen,et al.  Predicting tool wear with multi-sensor data using deep belief networks , 2018, The International Journal of Advanced Manufacturing Technology.

[16]  Lei Ren,et al.  Prediction of Bearing Remaining Useful Life With Deep Convolution Neural Network , 2018, IEEE Access.

[17]  Xifan Yao,et al.  Tool Condition Monitoring and Remaining Useful Life Prognostic Based on a Wireless Sensor in Dry Milling Operations , 2016, Sensors.

[18]  Brigitte Chebel-Morello,et al.  Accurate bearing remaining useful life prediction based on Weibull distribution and artificial neural network , 2015 .

[19]  Zidong Wang,et al.  Set-Membership Filtering for State-Saturated Systems With Mixed Time-Delays Under Weighted Try-Once-Discard Protocol , 2019, IEEE Transactions on Circuits and Systems II: Express Briefs.

[20]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .

[21]  Enrico Zio,et al.  Investigation of uncertainty treatment capability of model-based and data-driven prognostic methods using simulated data , 2013, Reliab. Eng. Syst. Saf..

[22]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[23]  Enrico Zio,et al.  Ensemble of optimized echo state networks for remaining useful life prediction , 2017, Neurocomputing.

[24]  Noureddine Zerhouni,et al.  Bearing Health Monitoring Based on Hilbert–Huang Transform, Support Vector Machine, and Regression , 2015, IEEE Transactions on Instrumentation and Measurement.

[25]  Yan Dong,et al.  A new ensemble residual convolutional neural network for remaining useful life estimation. , 2019, Mathematical biosciences and engineering : MBE.

[26]  Yaguo Lei,et al.  Deep separable convolutional network for remaining useful life prediction of machinery , 2019 .

[27]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[28]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[29]  Noureddine Zerhouni,et al.  Health assessment and life prediction of cutting tools based on support vector regression , 2015, J. Intell. Manuf..

[30]  Wei Zhang,et al.  Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction , 2019, Reliab. Eng. Syst. Saf..

[31]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[32]  Zidong Wang,et al.  Finite‐horizon fault estimation under imperfect measurements and stochastic communication protocol: Dealing with finite‐time boundedness , 2018, International Journal of Robust and Nonlinear Control.

[33]  Fuad E. Alsaadi,et al.  Non-fragile state estimation for discrete Markovian jumping neural networks , 2016, Neurocomputing.

[34]  Mohamed Tkiouat,et al.  Rolling element bearing remaining useful life estimation based on a convolutional long-short-term memory network , 2018 .

[35]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.