Domain Adversarial Transfer Network for Cross-Domain Fault Diagnosis of Rotary Machinery

Recently, deep learning-based intelligent fault diagnosis techniques have obtained good classification performance with amount of supervised training data. However, domain shift problem between the training and testing data usually occurs due to variation in operating conditions and interferences of environment noise. Transfer learning provides a promising tool for handling the cross-domain diagnosis problems by leveraging knowledge from the source domain to help learning in the target domain. Most existing studies attempt to learn both domain features in a common feature space to reduce the domain shift, which are not optimal on specific discriminative tasks and can be limited to small shifts. This article proposes a novel domain adversarial transfer network (DATN), exploiting task-specific feature learning networks and domain adversarial training techniques for handling large distribution discrepancy across domains. First, two asymmetric encoder networks integrating deep convolutional neural networks are designed for learning hierarchical representations from the source domain and target domain. Then, the network weights learned in source tasks are transferred to improve training on target tasks. Finally, domain adversarial training with inverted label loss is introduced to minimize the difference between source and target distributions. To validate the effectiveness and superiority of the proposed method in the presence of large domain shifts, two fault data sets from different test rigs are investigated, and different fault severities, compound faults, and data contaminated by noise are considered. The experimental results demonstrate that the proposed method achieves the average accuracy of 96.45% on the bearing data set and 98.92% on the gearbox data set, which outperforms other algorithms.

[1]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .

[2]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[3]  Zuozhou Pan,et al.  A two-stage method based on extreme learning machine for predicting the remaining useful life of rolling-element bearings , 2020 .

[4]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[5]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[6]  Konstantinos C. Gryllias,et al.  A Support Vector Machine approach based on physical model training for rolling element bearing fault detection in industrial environments , 2012, Eng. Appl. Artif. Intell..

[7]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[8]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[9]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[10]  Robert X. Gao,et al.  DCNN-Based Multi-Signal Induction Motor Fault Diagnosis , 2020, IEEE Transactions on Instrumentation and Measurement.

[11]  Jipu Li,et al.  A Deep Adversarial Transfer Learning Network for Machinery Emerging Fault Detection , 2020, IEEE Sensors Journal.

[12]  Zhibin Zhao,et al.  Sparse Deep Stacking Network for Fault Diagnosis of Motor , 2018, IEEE Transactions on Industrial Informatics.

[13]  Kunpeng Zhu,et al.  Online Tool Wear Monitoring Via Hidden Semi-Markov Model With Dependent Durations , 2018, IEEE Transactions on Industrial Informatics.

[14]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[15]  Diego Cabrera,et al.  Deep Hybrid State Network With Feature Reinforcement for Intelligent Fault Diagnosis of Delta 3-D Printers , 2020, IEEE Transactions on Industrial Informatics.

[16]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[17]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[18]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[19]  Enrico Zio,et al.  Artificial intelligence for fault diagnosis of rotating machinery: A review , 2018, Mechanical Systems and Signal Processing.

[20]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[21]  Lingli Cui,et al.  Quantitative and Localization Diagnosis of a Defective Ball Bearing Based on Vertical–Horizontal Synchronization Signal Analysis , 2017, IEEE Transactions on Industrial Electronics.

[22]  Fei Shen,et al.  Knowledge Transfer for Rotary Machine Fault Diagnosis , 2020, IEEE Sensors Journal.

[23]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[24]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[25]  Haidong Shao,et al.  Electric Locomotive Bearing Fault Diagnosis Using a Novel Convolutional Deep Belief Network , 2018, IEEE Transactions on Industrial Electronics.

[26]  Guolin He,et al.  Non-stationary vibration feature extraction method based on sparse decomposition and order tracking for gearbox fault diagnosis , 2018 .

[27]  Jianyu Long,et al.  Dynamic condition monitoring for 3D printers by using error fusion of multiple sparse auto-encoders , 2019, Comput. Ind..

[28]  Ruyi Huang,et al.  Deep Decoupling Convolutional Neural Network for Intelligent Compound Fault Diagnosis , 2019, IEEE Access.

[29]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[30]  Xiang Li,et al.  Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[31]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Weihua Li,et al.  Feature Denoising and Nearest–Farthest Distance Preserving Projection for Machine Fault Diagnosis , 2016, IEEE Transactions on Industrial Informatics.

[33]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[34]  Jiangtao Wen,et al.  Intelligent Bearing Fault Diagnosis Method Combining Compressed Data Acquisition and Deep Learning , 2018, IEEE Transactions on Instrumentation and Measurement.

[35]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[36]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[37]  Peng Chen,et al.  Vibration-Based Intelligent Fault Diagnosis for Roller Bearings in Low-Speed Rotating Machinery , 2018, IEEE Transactions on Instrumentation and Measurement.

[38]  Chao Liu,et al.  A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults , 2019, Knowl. Based Syst..

[39]  Chuang Sun,et al.  Deep Coupling Autoencoder for Fault Diagnosis With Multimodal Sensory Data , 2018, IEEE Transactions on Industrial Informatics.

[40]  Huibin Lin,et al.  Fault feature extraction of rolling element bearings using sparse representation , 2016 .

[41]  Zhiheng Li,et al.  A Deep Transfer Model With Wasserstein Distance Guided Multi-Adversarial Networks for Bearing Fault Diagnosis Under Different Working Conditions , 2019, IEEE Access.

[42]  Konstantinos Gryllias,et al.  Intelligent Fault Diagnosis for Rotary Machinery Using Transferable Convolutional Neural Network , 2020, IEEE Transactions on Industrial Informatics.

[43]  Bin Zhang,et al.  Bearing performance degradation assessment using long short-term memory recurrent network , 2019, Comput. Ind..

[44]  Peng Chen,et al.  Step-by-Step Fuzzy Diagnosis Method for Equipment Based on Symptom Extraction and Trivalent Logic Fuzzy Diagnosis Theory , 2018, IEEE Transactions on Fuzzy Systems.

[45]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[46]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.