Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction

Abstract Accurate evaluation of machine degradation during long-time operation is of great importance. With the rapid development of modern industries, physical model is becoming less capable of describing sophisticated systems, and data-driven approaches have been widely developed. This paper proposes a novel intelligent remaining useful life (RUL) prediction method based on deep learning. The time-frequency domain information is explored for prognostics, and multi-scale feature extraction is implemented using convolutional neural networks. Experiments on a popular rolling bearing dataset prepared from the PRONOSTIA platform are carried out to show the effectiveness of the proposed method, and its superiority is demonstrated by the comparisons with other approaches. In general, high accuracy on the RUL prediction is achieved, and the proposed method is promising for industrial applications.

[1]  Joseph Mathew,et al.  Rotating machinery prognostics. State of the art, challenges and opportunities , 2009 .

[2]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[3]  Qiao Hu,et al.  Fault diagnosis of rotating machinery based on multiple ANFIS combination with GAs , 2007 .

[4]  Noureddine Zerhouni,et al.  Degradations analysis and aging modeling for health assessment and prognostics of PEMFC , 2016, Reliab. Eng. Syst. Saf..

[5]  Jianbo Yu,et al.  Machine health prognostics using the Bayesian-inference-based probabilistic indication and high-order particle filtering framework , 2015 .

[6]  Yi Wang,et al.  Fault diagnosis and prognosis using wavelet packet decomposition, Fourier transform and artificial neural network , 2013, J. Intell. Manuf..

[7]  Bingyuan Liu,et al.  Regularized Hierarchical Feature Learning with Non-negative Sparsity and Selectivity for Image Classification , 2014, 2014 22nd International Conference on Pattern Recognition.

[8]  B. Tang,et al.  Bearing remaining useful life estimation based on time–frequency representation and supervised dimensionality reduction , 2016 .

[9]  Bin Liang,et al.  Remaining useful life prediction of aircraft engine based on degradation pattern learning , 2017, Reliab. Eng. Syst. Saf..

[10]  Zhu Huijie,et al.  Fault diagnosis of hydraulic pump based on stacked autoencoders , 2015, 2015 12th IEEE International Conference on Electronic Measurement & Instruments (ICEMI).

[11]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[12]  Yaguo Lei,et al.  A New Method Based on Stochastic Process Models for Machine Remaining Useful Life Prediction , 2016, IEEE Transactions on Instrumentation and Measurement.

[13]  Ruben Puche-Panadero,et al.  Short-Frequency Fourier Transform for Fault Diagnosis of Induction Machines Working in Transient Regime , 2017, IEEE Transactions on Instrumentation and Measurement.

[14]  Michael Pecht,et al.  Physics-of-failure-based prognostics for electronic products , 2009 .

[15]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[16]  Lin Ma,et al.  Prognostic modelling options for remaining useful life estimation by industry , 2011 .

[17]  Bo-Suk Yang,et al.  Machine performance degradation assessment and remaining useful life prediction using proportional hazard model and support vector machine , 2012, WCE 2010.

[18]  K. Loparo,et al.  Online tracking of bearing wear using wavelet packet decomposition and probabilistic modeling : A method for bearing prognostics , 2007 .

[19]  Noureddine Zerhouni,et al.  Particle filter-based prognostics: Review, discussion and perspectives , 2016 .

[20]  Jong-Myon Kim,et al.  A reliable technique for remaining useful life estimation of rolling element bearings using dynamic regression models , 2018, Reliab. Eng. Syst. Saf..

[21]  Abhisek Ukil,et al.  Fault detection in HVDC system using Short Time Fourier Transform , 2016, 2016 IEEE Power and Energy Society General Meeting (PESGM).

[22]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[23]  David He,et al.  A segmental hidden semi-Markov model (HSMM)-based diagnostics and prognostics framework and methodology , 2007 .

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[26]  Li Lin,et al.  Fault diagnosis and remaining useful life estimation of aero engine using LSTM neural network , 2016, 2016 IEEE International Conference on Aircraft Utility Systems (AUS).

[27]  Yaguo Lei,et al.  An Improved Exponential Model for Predicting Remaining Useful Life of Rolling Element Bearings , 2015, IEEE Transactions on Industrial Electronics.

[28]  Chaochao Chen,et al.  Machine remaining useful life prediction: An integrated adaptive neuro-fuzzy and high-order particle filtering approach , 2012 .

[29]  Yanyang Zi,et al.  A Two-Stage Data-Driven-Based Prognostic Approach for Bearing Degradation Problem , 2016, IEEE Transactions on Industrial Informatics.

[30]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[31]  Soumaya Yacout,et al.  Remaining useful life prediction using prognostic methodology based on logical analysis of data and Kaplan–Meier estimation , 2016, J. Intell. Manuf..

[32]  Sankalita Saha,et al.  Metrics for Offline Evaluation of Prognostic Performance , 2021, International Journal of Prognostics and Health Management.

[33]  Robert X. Gao,et al.  A multi-time scale approach to remaining useful life prediction in rolling bearing , 2017 .

[34]  Xiang Li,et al.  Machine health condition prediction via online dynamic fuzzy neural networks , 2014, Eng. Appl. Artif. Intell..

[35]  Soumaya Yacout,et al.  Pattern‐based prognostic methodology for condition‐based maintenance using selected and weighted survival curves , 2017, Qual. Reliab. Eng. Int..

[36]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[37]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[38]  Balbir S. Dhillon,et al.  Early fault diagnosis of rotating machinery based on wavelet packets—Empirical mode decomposition feature extraction and neural network , 2012 .

[39]  Brigitte Chebel-Morello,et al.  Accurate bearing remaining useful life prediction based on Weibull distribution and artificial neural network , 2015 .

[40]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[41]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[42]  Noureddine Zerhouni,et al.  Remaining useful life estimation based on nonlinear feature reduction and support vector regression , 2013, Eng. Appl. Artif. Intell..

[43]  Wei Zhang,et al.  A robust intelligent fault diagnosis method for rolling element bearings based on deep distance metric learning , 2018, Neurocomputing.

[44]  Yaguo Lei,et al.  A new approach to intelligent fault diagnosis of rotating machinery , 2008, Expert Syst. Appl..

[45]  Noureddine Zerhouni,et al.  Bearing Health Monitoring Based on Hilbert–Huang Transform, Support Vector Machine, and Regression , 2015, IEEE Transactions on Instrumentation and Measurement.

[46]  Robert X. Gao,et al.  Prognosis of Defect Propagation Based on Recurrent Neural Networks , 2011, IEEE Transactions on Instrumentation and Measurement.

[47]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[49]  Guanghua Xu,et al.  Detection of weak transient signals based on wavelet packet transform and manifold learning for rolling element bearing fault diagnosis , 2015 .

[50]  Liang Guo,et al.  Machinery health indicator construction based on convolutional neural networks considering trend burr , 2018, Neurocomputing.

[51]  Jin Cui,et al.  Multi-bearing remaining useful life collaborative prediction: A deep learning approach , 2017 .

[52]  Ivo Paixao de Medeiros,et al.  Remaining useful life estimation in aeronautics: Combining data-driven and Kalman filtering , 2018, Reliab. Eng. Syst. Saf..

[53]  Nagi Gebraeel,et al.  Residual life predictions from vibration-based degradation signals: a neural network approach , 2004, IEEE Transactions on Industrial Electronics.

[54]  Xiang Li,et al.  Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[55]  Selin Aviyente,et al.  Extended Kalman Filtering for Remaining-Useful-Life Estimation of Bearings , 2015, IEEE Transactions on Industrial Electronics.

[56]  Kuldip K. Paliwal,et al.  On the usefulness of STFT phase spectrum in human listening tests , 2005, Speech Commun..

[57]  Hubert Razik,et al.  Prognosis of Bearing Failures Using Hidden Markov Models and the Adaptive Neuro-Fuzzy Inference System , 2014, IEEE Transactions on Industrial Electronics.