Intelligent fault diagnosis of rolling bearings using a semi-supervised convolutional neural network

The success of convolutional neural networks (CNNs) in intelligent fault diagnosis is largely dependent on massive amounts of labelled data. In a real-world case, however, massive amounts of labelled data are difficult or costly to collect, whereas abundant unlabelled data are often available. To utilize such unlabelled data, a novel method using a semi-supervised convolutional neural network (SSCNN) for intelligent fault diagnosis of bearings is proposed. First, a 1-d CNN is applied to learn class space features and generate class probabilities of unlabelled samples, based on which a class probability maximum margin criterion (CPMMC) method is used to construct the loss function of unlabelled samples. Then, the constructed loss function, which aims to maximise the inter-class distance of class space features and minimise the intra-class distance of class space features, is integrated into the cross-entropy loss function of the CNN, and the SSCNN is established. Finally, the SSCNN model is applied to analyse the vibration signals collected from rolling bearings, and a novel intelligent fault diagnosis method using the SSCNN is proposed. Two datasets are employed to validate the effectiveness of the proposed methodology. The results show that the established SSCNN can effectively utilise unlabelled samples to train the model and enhance its fault diagnosis performance. Through a comparison with commonly used semi-supervised deep learning methods, the superiority of the proposed method is validated.

[1]  Enrico Zio,et al.  Artificial intelligence for fault diagnosis of rotating machinery: A review , 2018, Mechanical Systems and Signal Processing.

[2]  Ming Zhao,et al.  A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox , 2017 .

[3]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[4]  Erfu Yang,et al.  A Novel Semi-Supervised Convolutional Neural Network Method for Synthetic Aperture Radar Image Recognition , 2019, Cognitive Computation.

[5]  Chenglin Wen,et al.  Deep learning fault diagnosis method based on global optimization GAN for unbalanced data , 2020, Knowl. Based Syst..

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  Ke Zhao,et al.  An adaptive deep transfer learning method for bearing fault diagnosis , 2020 .

[8]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[9]  Hongkai Jiang,et al.  An adaptive deep convolutional neural network for rolling bearing fault diagnosis , 2017 .

[10]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[11]  Myeongsu Kang,et al.  Deep Residual Networks With Dynamically Weighted Wavelet Coefficients for Fault Diagnosis of Planetary Gearboxes , 2018, IEEE Transactions on Industrial Electronics.

[12]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[13]  Tapani Raiko,et al.  Semi-supervised Learning with Ladder Networks , 2015, NIPS.

[14]  Le Zhang,et al.  A survey of randomized algorithms for training neural networks , 2016, Inf. Sci..

[15]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[17]  John G. Taylor,et al.  Saliency, Attention, Active Visual Search, and Picture Scanning , 2011, Cognitive Computation.

[18]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[19]  Holger H. Hoos,et al.  A survey on semi-supervised learning , 2019, Machine Learning.

[20]  Haidong Shao,et al.  A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders , 2018 .

[21]  Iqbal Gondal,et al.  A data mining approach for machine fault diagnosis based on associated frequency patterns , 2016, Applied Intelligence.

[22]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[23]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[24]  Yan Cui,et al.  Feature extraction using fuzzy maximum margin criterion , 2012, Neurocomputing.

[25]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[26]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[27]  Zhi-Hua Zhou,et al.  Semi-supervised learning by disagreement , 2010, Knowledge and Information Systems.

[28]  Zhong Jin,et al.  Face recognition using discriminant locality preserving projections based on maximum margin criterion , 2010, Pattern Recognit..

[29]  Minping Jia,et al.  A novel unsupervised deep learning network for intelligent fault diagnosis of rotating machinery , 2020, Structural Health Monitoring.

[30]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .