A Novel Deep Learning Model for the Detection and Identification of Rolling Element-Bearing Faults

Real-time acquisition of large amounts of machine operating data is now increasingly common due to recent advances in Industry 4.0 technologies. A key benefit to factory operators of this large scale data acquisition is in the ability to perform real-time condition monitoring and early-stage fault detection and diagnosis on industrial machinery—with the potential to reduce machine down-time and thus operating costs. The main contribution of this work is the development of an intelligent fault diagnosis method capable of operating on these real-time data streams to provide early detection of developing problems under variable operating conditions. We propose a novel dual-path recurrent neural network with a wide first kernel and deep convolutional neural network pathway (RNN-WDCNN) capable of operating on raw temporal signals such as vibration data to diagnose rolling element bearing faults in data acquired from electromechanical drive systems. RNN-WDCNN combines elements of recurrent neural networks (RNNs) and convolutional neural networks (CNNs) to capture distant dependencies in time series data and suppress high-frequency noise in the input signals. Experimental results on the benchmark Case Western Reserve University (CWRU) bearing fault dataset show RNN-WDCNN outperforms current state-of-the-art methods in both domain adaptation and noise rejection tasks.

[1]  Report of Large Motor Reliability Survey of Industrial and Commercial Installations, Part I , 1985, IEEE Transactions on Industry Applications.

[2]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Robert B. Randall,et al.  Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study , 2015 .

[5]  Tong Zhang,et al.  Deep Pyramid Convolutional Neural Networks for Text Categorization , 2017, ACL.

[6]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[9]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[10]  Yuxin Cui,et al.  Limited Data Rolling Bearing Fault Diagnosis With Few-Shot Learning , 2019, IEEE Access.

[11]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[12]  A.H. Bonnett,et al.  Increased Efficiency Versus Increased Reliability , 2008, IEEE Industry Applications Magazine.

[13]  Chen Lu,et al.  Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification , 2017, Adv. Eng. Informatics.

[14]  P. Geethanjali,et al.  Analysis of Statistical Time-Domain Features Effectiveness in Identification of Bearing Faults From Vibration Signal , 2017, IEEE Sensors Journal.

[15]  M. Dalva,et al.  A survey of faults on induction motors in offshore oil industry, petrochemical industry, gas terminals and oil refineries , 1994, Proceedings of IEEE Petroleum and Chemical Industry Technical Conference (PCIC '94).

[16]  K. Loparo,et al.  Bearing fault diagnosis based on wavelet transform and fuzzy inference , 2004 .

[17]  Amparo Alonso-Betanzos,et al.  Automatic bearing fault diagnosis based on one-class ν-SVM , 2013, Comput. Ind. Eng..

[18]  Jie Xu,et al.  A Deep Learning Method for Bearing Fault Diagnosis through Stacked Residual Dilated Convolutions , 2019, Applied Sciences.

[19]  Jorge Nocedal,et al.  On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima , 2016, ICLR.

[20]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[21]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[22]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[23]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[24]  Kjell G. Robbersmyr,et al.  Early detection and classification of bearing faults using support vector machine algorithm , 2017, 2017 IEEE Workshop on Electrical Machines Design, Control and Diagnosis (WEMDCD).

[25]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[26]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[27]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[28]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[29]  Wojciech Zaremba,et al.  An Empirical Exploration of Recurrent Network Architectures , 2015, ICML.

[30]  Jing Tian,et al.  Motor Bearing Fault Detection Using Spectral Kurtosis-Based Feature Extraction Coupled With K-Nearest Neighbor Distance Analysis , 2016, IEEE Transactions on Industrial Electronics.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Farhat Fnaiech,et al.  Application of higher order spectral features and support vector machines for bearing faults classification. , 2015, ISA transactions.

[33]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[34]  K. R. Al-Balushi,et al.  Artificial neural networks and support vector machines with genetic algorithm for bearing fault detection , 2003 .

[35]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[36]  E. Bechhoefer,et al.  Envelope bearing analysis: theory and practice , 2005, 2005 IEEE Aerospace Conference.

[37]  Houshang Darabi,et al.  Insights Into LSTM Fully Convolutional Networks for Time Series Classification , 2019, IEEE Access.

[38]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[39]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[40]  P. D. McFadden,et al.  Model for the vibration produced by a single point defect in a rolling element bearing , 1984 .

[41]  Min Xia,et al.  Fault Diagnosis for Rotating Machinery Using Multiple Sensors and Convolutional Neural Networks , 2018, IEEE/ASME Transactions on Mechatronics.

[42]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[43]  Yann LeCun,et al.  Very Deep Convolutional Networks for Text Classification , 2016, EACL.

[44]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[45]  Yann Dauphin,et al.  Convolutional Sequence to Sequence Learning , 2017, ICML.

[46]  Yann Dauphin,et al.  A Convolutional Encoder Model for Neural Machine Translation , 2016, ACL.

[47]  Richard Socher,et al.  Regularizing and Optimizing LSTM Language Models , 2017, ICLR.

[48]  Jing Zhou,et al.  Automatic bearing fault diagnosis using particle swarm clustering and Hidden Markov Model , 2016, Eng. Appl. Artif. Intell..