Rolling bearing fault diagnosis using optimal ensemble deep transfer network

Abstract Rolling bearing fault diagnosis with unlabeled data is a meaningful yet challenging task. Recently, deep transfer learning methods with maximum mean discrepancy (MMD) have achieved great attention. To further enhance the performance of individual models, this paper proposes an optimal ensemble deep transfer network (OEDTN). The proposed method takes advantage of parameter transfer learning, domain adaptation and ensemble learning. Firstly, different kernel MMDs are used to construct multiple diverse deep transfer networks (DTNs) for feature adaptation. Secondly, parameter transfer learning is applied to initialize these DTNs with a good start point. Finally, ensemble learning is used to combine these DTNs to acquire the final results. Considering no labeled information available for ensemble, a novel comprehensive metric is designed to guide the particle swarm optimization to assign suitable voting weights for each DTN. By this way, the ensemble strategy of OEDTN can be adaptively constructed. Experiments on three bearing test rigs are carried out, and the results show that the proposed method is more effective than the existing methods.

[1]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[2]  Jie Lu,et al.  Fuzzy Multiple-Source Transfer Learning , 2020, IEEE Transactions on Fuzzy Systems.

[3]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[4]  Yongqing Yang,et al.  The optimal control synchronization of complex dynamical networks with time-varying delay using PSO , 2019, Neurocomputing.

[5]  Ruixin Wang,et al.  An enhanced selective ensemble deep learning method for rolling bearing fault diagnosis with beetle antennae search algorithm , 2020 .

[6]  Haidong Shao,et al.  Rolling bearing health prognosis using a modified health index based hierarchical gated recurrent unit network , 2019, Mechanism and Machine Theory.

[7]  Trevor Darrell,et al.  Deep Domain Confusion: Maximizing for Domain Invariance , 2014, CVPR 2014.

[8]  Ke Zhao,et al.  A deep transfer maximum classifier discrepancy method for rolling bearing fault diagnosis under few labeled data , 2020, Knowl. Based Syst..

[9]  Wei Zhang,et al.  Multi-Layer domain adaptation method for rolling bearing fault diagnosis , 2019, Signal Process..

[10]  Kate Saenko,et al.  Deep CORAL: Correlation Alignment for Deep Domain Adaptation , 2016, ECCV Workshops.

[11]  Yaguo Lei,et al.  Intelligent Fault Diagnosis and Remaining Useful Life Prediction of Rotating Machinery , 2016 .

[12]  Yu Yang,et al.  Enhanced deep gated recurrent unit and complex wavelet packet energy moment entropy for early fault prognosis of bearing , 2020, Knowl. Based Syst..

[13]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[14]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[15]  Bin Yang,et al.  An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings , 2019, Mechanical Systems and Signal Processing.

[16]  Ping Wang,et al.  Deep transfer multi-wavelet auto-encoder for intelligent fault diagnosis of gearbox with few target training samples , 2020, Knowl. Based Syst..

[17]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[18]  Chuang Sun,et al.  Deep Coupling Autoencoder for Fault Diagnosis With Multimodal Sensory Data , 2018, IEEE Transactions on Industrial Informatics.

[19]  Ruixin Wang,et al.  A Deep Transfer Nonnegativity-Constraint Sparse Autoencoder for Rolling Bearing Fault Diagnosis With Few Labeled Data , 2019, IEEE Access.

[20]  Wei Zhang,et al.  Intelligent cross-machine fault diagnosis approach with deep auto-encoder and domain adaptation , 2020, Neurocomputing.

[21]  Chao Liu,et al.  Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application , 2018, ISA transactions.

[22]  Xianmin Zhang,et al.  Deep multi-scale convolutional transfer learning network: A novel method for intelligent fault diagnosis of rolling bearings under variable working conditions and domains , 2020, Neurocomputing.

[23]  Jing Lin,et al.  Transfer fault diagnosis of bearing installed in different machines using enhanced deep auto-encoder , 2020 .

[24]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[25]  Jiang Hongkai,et al.  Intelligent fault diagnosis among different rotating machines using novel stacked transfer auto-encoder optimized by PSO. , 2020, ISA transactions.

[26]  Haiyang Pan,et al.  Rolling bearing fault detection and diagnosis based on composite multiscale fuzzy entropy and ensemble support vector machines , 2017 .

[27]  Shunming Li,et al.  A novel transfer learning method for robust fault diagnosis of rotating machines under variable working conditions , 2019, Measurement.

[28]  Jipu Li,et al.  Domain Adversarial Transfer Network for Cross-Domain Fault Diagnosis of Rotary Machinery , 2020, IEEE Transactions on Instrumentation and Measurement.

[29]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[30]  Jiong Tang,et al.  Preprocessing-Free Gear Fault Diagnosis Using Small Datasets With Deep Convolutional Neural Network-Based Transfer Learning , 2017, IEEE Access.

[31]  Ke Zhao,et al.  An adaptive deep transfer learning method for bearing fault diagnosis , 2020 .

[32]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[33]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[34]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[35]  Fei Shen,et al.  Knowledge Transfer for Rotary Machine Fault Diagnosis , 2020, IEEE Sensors Journal.

[36]  Qing He,et al.  Multi-representation adaptation network for cross-domain image classification , 2019, Neural Networks.

[37]  Yue Cao,et al.  Transferable Representation Learning with Deep Adaptation Networks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Myeongsu Kang,et al.  Deep Residual Networks With Dynamically Weighted Wavelet Coefficients for Fault Diagnosis of Planetary Gearboxes , 2018, IEEE Transactions on Industrial Electronics.

[39]  Haidong Shao,et al.  Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing , 2018 .

[40]  Jiafu Wan,et al.  Intelligent Fault Diagnosis of Rotor-Bearing System Under Varying Working Conditions With Modified Transfer Convolutional Neural Network and Thermal Images , 2020, IEEE Transactions on Industrial Informatics.

[41]  Ming Zhao,et al.  Residual joint adaptation adversarial network for intelligent transfer fault diagnosis , 2020 .