Partial transfer learning in machinery cross-domain fault diagnostics using class-weighted adversarial networks

Recently, transfer learning has been receiving growing interests in machinery fault diagnosis due to its strong generalization across different industrial scenarios. The existing methods generally assume identical label spaces, and propose minimizing marginal distribution discrepancy between source and target domains. However, this assumption usually does not hold in real industries, where testing data mostly contain a subspace of the source label space. Therefore, transferring diagnosis knowledge from a comprehensive source domain to a target domain with limited machine conditions is motivated. This challenging partial transfer learning problem is addressed in this study using deep learning-based domain adaptation method. A class weighted adversarial neural network is proposed to encourage positive transfer of the shared classes and ignore the source outliers. Experimental results on two rotating machinery datasets suggest the proposed method is promising for partial transfer learning.

[1]  Ke-Jia Chen,et al.  Transfer learning with partial related "instance-feature" knowledge , 2018, Neurocomputing.

[2]  Xiang Li,et al.  Deep residual learning-based fault diagnosis method for rotating machinery. , 2019, ISA transactions.

[3]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[4]  Haidong Shao,et al.  A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders , 2018 .

[5]  Yan Wang,et al.  An integrated multi-sensor fusion-based deep feature learning approach for rotating machinery diagnosis , 2018 .

[6]  Xiang Li,et al.  Diagnosing Rotating Machines With Weakly Supervised Data Using Deep Transfer Learning , 2020, IEEE Transactions on Industrial Informatics.

[7]  Haidong Shao,et al.  Improved Deep Transfer Auto-Encoder for Fault Diagnosis of Gearbox Under Variable Working Conditions With Small Training Samples , 2019, IEEE Access.

[8]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[9]  Bo Zhang,et al.  Intelligent Fault Diagnosis Under Varying Working Conditions Based on Domain Adaptive Convolutional Neural Networks , 2018, IEEE Access.

[10]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[11]  Wei Zhang,et al.  Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction , 2019, Reliab. Eng. Syst. Saf..

[12]  Gabriela Csurka,et al.  Domain Adaptation for Visual Applications: A Comprehensive Survey , 2017, ArXiv.

[13]  Robert B. Randall,et al.  Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study , 2015 .

[14]  Zhongkui Zhu,et al.  Enhanced generative adversarial networks for fault diagnosis of rotating machinery with imbalanced data , 2019, Measurement Science and Technology.

[15]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[16]  Xu Li,et al.  Machinery fault diagnosis with imbalanced data using deep generative adversarial networks , 2020 .

[17]  Zhong Luo,et al.  Research on vibration performance of the nonlinear combined support-flexible rotor system , 2019, Nonlinear Dynamics.

[18]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[19]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[20]  Wei Jiang,et al.  Unsupervised fault diagnosis of rolling bearings using a deep neural network based on generative adversarial networks , 2018, Neurocomputing.

[21]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[22]  Yang Fu,et al.  A High Generalizable Feature Extraction Method Using Ensemble Learning and Deep Auto-Encoders for Operational Reliability Assessment of Bearings , 2019, Neural Processing Letters.

[23]  Bin Yang,et al.  An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings , 2019, Mechanical Systems and Signal Processing.

[24]  Xiang Li,et al.  Deep Learning-Based Partial Domain Adaptation Method on Intelligent Machinery Fault Diagnostics , 2021, IEEE Transactions on Industrial Electronics.

[25]  Wei Zhang,et al.  Multi-Layer domain adaptation method for rolling bearing fault diagnosis , 2019, Signal Process..

[26]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[27]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[28]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[29]  Jing Zhang,et al.  Importance Weighted Adversarial Nets for Partial Domain Adaptation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[31]  Xiang Li,et al.  Deep Learning-Based Machinery Fault Diagnostics With Domain Adaptation Across Sensors at Different Places , 2020, IEEE Transactions on Industrial Electronics.

[32]  Xiang Li,et al.  Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[33]  Changqing Shen,et al.  Stacked Sparse Autoencoder-Based Deep Network for Fault Diagnosis of Rotating Machinery , 2017, IEEE Access.

[34]  Zhihui Lai,et al.  Neighborhood preserving neural network for fault detection , 2019, Neural Networks.

[35]  Wei Zhang,et al.  A robust intelligent fault diagnosis method for rolling element bearings based on deep distance metric learning , 2018, Neurocomputing.

[36]  Yongmin Liu,et al.  Application of weighted contribution rate of nonlinear output frequency response functions to rotor rub-impact , 2020 .

[37]  Zhihui Lai,et al.  Global-and-local-structure-based neural network for fault detection , 2019, Neural Networks.

[38]  Kun Yu,et al.  A Combined Polynomial Chirplet Transform and Synchroextracting Technique for Analyzing Nonstationary Signals of Rotating Machinery , 2020, IEEE Transactions on Instrumentation and Measurement.

[39]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[40]  Yue Li,et al.  Simultaneously learning affinity matrix and data representations for machine fault diagnosis , 2020, Neural Networks.

[41]  Jun Wang,et al.  An automatic and robust features learning method for rotating machinery fault diagnosis based on contractive autoencoder , 2018, Eng. Appl. Artif. Intell..