Rolling Bearing Fault Diagnosis Using Time-Frequency Analysis and Deep Transfer Convolutional Neural Network

Due to the advantage of automatically extracting features from raw data, deep learning (DL) has been increasingly favored in the field of machine fault diagnosis. However, DL exposes the problems of large sample size and long training time, and in actual working conditions, the amount of labeled fault data available is relatively small, so a DL model of good generalization and high accuracy is difficult to be trained. In order to solve these problems, a deep transfer convolutional neural network (DTCNN) is proposed in this research. ResNet-50 is selected as the pre-trained model of deep convolutional neural network, and is transferred to solve the problem of bearing fault classification based on the idea of transfer learning. Firstly, raw fault signals are converted into time-frequency images by using continuous wavelet transform (CWT). Then, the images are further converted into RGB formats, which are used as the input of DTCNN. Finally, an end-to-end fault diagnosis model based on DTCNN is designed. The proposed method is validated on two datasets collected from motor bearing and self-priming centrifugal pump, respectively. Most sub-datasets from motor bearing show the prediction accuracies near 100%, and in the self-priming centrifugal pump dataset, we achieve improvement in accuracy from 99.48%±0.1966 to 99.98%±0.0332. The experimental results demonstrate that the proposed method outperforms other DL methods and traditional machine-learning methods.

[1]  Chen Lu,et al.  Fault Diagnosis for Rotating Machinery: A Method based on Image Processing , 2016, PloS one.

[2]  Miao He,et al.  Deep Learning Based Approach for Bearing Fault Diagnosis , 2017, IEEE Transactions on Industry Applications.

[3]  Haidong Shao,et al.  Rolling bearing fault diagnosis using adaptive deep belief network with dual-tree complex wavelet packet. , 2017, ISA transactions.

[4]  Wenliao Du,et al.  Wavelet leaders multifractal features based fault diagnosis of rotating mechanism , 2014 .

[5]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[6]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Xiwen Qin,et al.  The Fault Diagnosis of Rolling Bearing Based on Ensemble Empirical Mode Decomposition and Random Forest , 2017 .

[9]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[10]  Weiming Shen,et al.  Bearing Fault Diagnosis Method Based on Deep Convolutional Neural Network and Random Forest Ensemble Learning , 2019, Sensors.

[11]  Yitao Liang,et al.  A novel bearing fault diagnosis model integrated permutation entropy, ensemble empirical mode decomposition and optimized SVM , 2015 .

[12]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Haidong Shao,et al.  Intelligent fault diagnosis of rolling bearing using deep wavelet auto-encoder with extreme learning machine , 2018, Knowl. Based Syst..

[14]  Xiaodong Wang,et al.  Fault diagnosis of rolling bearing based on permutation entropy and Extreme Learning Machine , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[15]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part II: Fault Diagnosis With Knowledge-Based and Hybrid/Active Approaches , 2015, IEEE Transactions on Industrial Electronics.

[16]  Ran Zhang,et al.  Transfer Learning With Neural Networks for Bearing Fault Diagnosis in Changing Working Conditions , 2017, IEEE Access.

[17]  Cong Wang,et al.  Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings , 2016 .

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Weiwei Liu,et al.  Generating Realistic Videos From Keyframes With Concatenated GANs , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Florian Metze,et al.  Extracting deep bottleneck features using stacked auto-encoders , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Fulei Chu,et al.  Ensemble Empirical Mode Decomposition-Based Teager Energy Spectrum for Bearing Fault Diagnosis , 2013 .

[24]  Md. Zakirul Alam Bhuiyan,et al.  A Survey on Deep Learning in Big Data , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[25]  Mohammad Modarres,et al.  Deep Learning Enabled Fault Diagnosis Using Time-Frequency Image Analysis of Rolling Element Bearings , 2017 .

[26]  Bo-Suk Yang,et al.  Support vector machine in machine condition monitoring and fault diagnosis , 2007 .

[27]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[28]  L. Jiang,et al.  Fault Diagnosis of Rotating Machinery Based on Multisensor Information Fusion Using SVM and Time-Domain Features , 2014 .

[29]  Zhiwei Gao,et al.  From Model, Signal to Knowledge: A Data-Driven Perspective of Fault Detection and Diagnosis , 2013, IEEE Transactions on Industrial Informatics.

[30]  Khubaib Amjad Alam,et al.  Application of Data Mining Using Artificial Neural Network: Survey , 2015 .

[31]  Yin Yang,et al.  End-to-End Detection-Segmentation System for Face Labeling , 2019 .

[32]  Fulei Chu,et al.  Recent advances in time–frequency analysis methods for machinery fault diagnosis: A review with application examples , 2013 .

[33]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[34]  Jong-Myon Kim,et al.  A Hybrid Feature Model and Deep-Learning-Based Bearing Fault Diagnosis , 2017, Sensors.

[35]  Mo-Yuen Chow,et al.  Neural-network-based motor rolling bearing fault diagnosis , 2000, IEEE Trans. Ind. Electron..

[36]  Changqing Shen,et al.  Stacked Sparse Autoencoder-Based Deep Network for Fault Diagnosis of Rotating Machinery , 2017, IEEE Access.

[37]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[38]  Haidong Shao,et al.  Rolling bearing fault diagnosis using an optimization deep belief network , 2015 .

[39]  Enrico Zio,et al.  Artificial intelligence for fault diagnosis of rotating machinery: A review , 2018, Mechanical Systems and Signal Processing.

[40]  Shiping Wen,et al.  Multilabel Image Classification via Feature/Label Co-Projection , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[41]  Zhigang Zeng,et al.  A modified Elman neural network with a new learning rate scheme , 2018, Neurocomputing.

[42]  Chuntian Cheng,et al.  Annual Streamflow Time Series Prediction Using Extreme Learning Machine Based on Gravitational Search Algorithm and Variational Mode Decomposition , 2020 .

[43]  Kyle Forinash,et al.  Time-frequency analysis with the continuous wavelet transform , 1998 .