Representation Learning With Class Level Autoencoder for Intelligent Fault Diagnosis

Although representation learning has been proved to be a promising and effective solution for intelligent fault diagnosis, existing methods still encounter classification performance degradation due to large intra-class variations of real-world applications. In this work, we present a novel representation learning method, namely class level autoencoder (CLAE) for fault diagnosis which aims to learn representative and discriminative features from vibration signals. Specifically, we formulate a novel loss function for representation learning by jointly minimizing the basic and class level reconstruction errors to restrain intra-class variations in the feature space. In addition, we propose a new and simple feature pooling strategy to effectively fuse various meaningful local features to capture efficient and inherent fault pattern information about the input. Extensive experimental results on rolling bearing dataset demonstrate that our proposed method achieves very competitive results compared to state-of-the-art methods. The code of the proposed method is available at https://github.com/KWflyer/CLAE.

[1]  Wei Qiao,et al.  Rotor current-based fault diagnosis for DFIG wind turbine drivetrain gearboxes using frequency analysis and a deep classifier , 2018, 2017 IEEE Industry Applications Society Annual Meeting.

[2]  Wenliao Du,et al.  Wavelet leaders multifractal features based fault diagnosis of rotating mechanism , 2014 .

[3]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[4]  Deyong You,et al.  WPD-PCA-Based Laser Welding Process Monitoring and Defects Diagnosis by Using FNN and SVM , 2015, IEEE Transactions on Industrial Electronics.

[5]  Robert B. Randall,et al.  Applications of Spectral Kurtosis in Machine Diagnostics and Prognostics , 2005 .

[6]  Andrew Y. Ng,et al.  Transfer learning for text classification , 2005, NIPS.

[7]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[8]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[9]  Klaus-Robert Müller,et al.  Deep Boltzmann Machines and the Centering Trick , 2012, Neural Networks: Tricks of the Trade.

[10]  Pl . Teatralny Rolling bearing diagnosing method based on Empirical Mode Decomposition of machine vibration signal , 2014 .

[11]  Qiao Hu,et al.  Fault diagnosis of rotating machinery based on multiple ANFIS combination with GAs , 2007 .

[12]  Haidong Shao,et al.  An enhancement deep feature fusion method for rotating machinery fault diagnosis , 2017, Knowl. Based Syst..

[13]  Pascal Vincent,et al.  Contractive Auto-Encoders: Explicit Invariance During Feature Extraction , 2011, ICML.

[14]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[15]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[16]  Changqing Shen,et al.  Stacked Sparse Autoencoder-Based Deep Network for Fault Diagnosis of Rotating Machinery , 2017, IEEE Access.

[17]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Robert Babuska,et al.  Railway Track Circuit Fault Diagnosis Using Recurrent Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[20]  P. D. McFadden,et al.  APPLICATION OF SYNCHRONOUS AVERAGING TO VIBRATION MONITORING OF ROLLING ELEMENT BEARINGS , 2000 .

[21]  Yue Li,et al.  Learning Representations With Local and Global Geometries Preserved for Machine Fault Diagnosis , 2020, IEEE Transactions on Industrial Electronics.

[22]  Jun Yan,et al.  Multiscale Convolutional Neural Networks for Fault Diagnosis of Wind Turbine Gearbox , 2019, IEEE Transactions on Industrial Electronics.

[23]  Chris K. Mechefske,et al.  Fault detection and diagnosis in low speed rolling element bearings Part I: The use of parametric spectra , 1992 .

[24]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[25]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[26]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[27]  Cong Wang,et al.  Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings , 2016 .

[28]  Robert X. Gao,et al.  Wavelets for fault diagnosis of rotary machines: A review with applications , 2014, Signal Process..

[29]  Paolo Pennacchi,et al.  Diagnostics of gear faults based on EMD and automatic selection of intrinsic mode functions , 2011 .

[30]  Guolin He,et al.  Semisupervised Distance-Preserving Self-Organizing Map for Machine-Defect Detection and Classification , 2013, IEEE Transactions on Instrumentation and Measurement.

[31]  Yitao Liang,et al.  A novel bearing fault diagnosis model integrated permutation entropy, ensemble empirical mode decomposition and optimized SVM , 2015 .

[32]  Huaqing Wang,et al.  Intelligent Condition Diagnosis Method for Rotating Machinery Based on Probability Density and Discriminant Analyses , 2016, IEEE Signal Processing Letters.

[33]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[34]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[35]  Haibo He,et al.  Stacked Multilevel-Denoising Autoencoders: A New Representation Learning Approach for Wind Turbine Gearbox Fault Diagnosis , 2017, IEEE Transactions on Instrumentation and Measurement.

[36]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .