A New Deep Transfer Learning Method for Bearing Fault Diagnosis Under Different Working Conditions

Fault diagnosis is very important for condition based maintenance. Recently, deep learning models are introduced to learn hierarchical representations from raw data instead of using hand-crafted features, which exhibit excellent performance. The success of current deep learning lies in: 1) the training (source domain) and testing (target domain) datasets are from the same feature distribution; 2) Enough labeled data with fault information exist. However, because the machine operates under a non-stationary working condition, the trained model built on the source domain can not be directly applied on the target domain. Moreover, since no sufficient labeled or even unlabeled data are available in target domain, collecting the labeled data and building the model from scratch is time-consuming and expensive. Motivated by transfer learning (TL), we present a new fault diagnosis method, which generalizes convolutional neural network (CNN) to TL scenario. Two layers with regard to task-specific features are adapted in a layer-wise way to regularize the parameters of CNN. What’s more, the domain loss is calculated by a linear combination of multiple Gaussian kernels so that the ability of adaptation is enhanced compared to single kernel. Through these two means, the distribution discrepancy is reduced and the transferable features are learned. The proposed method is validated by transfer fault diagnosis experiments. Compared to CNN without domain adaptation and shallow transfer learning methods, the proposed method gets the best performance for fault classification.

[1]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[2]  Diego Cabrera,et al.  Gearbox fault diagnosis based on deep random forest fusion of acoustic and vibratory signals , 2016 .

[3]  Dong Wang,et al.  K-nearest neighbors based methods for identification of different gear crack levels under different motor speeds and loads: Revisited , 2016 .

[4]  Konstantinos Gryllias,et al.  Intelligent Fault Diagnosis for Rotary Machinery Using Transferable Convolutional Neural Network , 2020, IEEE Transactions on Industrial Informatics.

[5]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[6]  David Zhang,et al.  Correcting Instrumental Variation and Time-Varying Drift: A Transfer Learning Approach With Autoencoders , 2016, IEEE Transactions on Instrumentation and Measurement.

[7]  Yongxin Yang,et al.  Learning to Generalize: Meta-Learning for Domain Generalization , 2017, AAAI.

[8]  Giorgio Sulligoi,et al.  A novel fault diagnosis technique for photovoltaic systems based on artificial neural networks , 2016 .

[9]  Minqiang Xu,et al.  Intelligent Fault Identification Based on Multisource Domain Generalization Towards Actual Diagnosis Scenario , 2020, IEEE Transactions on Industrial Electronics.

[10]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[11]  José M. F. Moura,et al.  Adversarial Multiple Source Domain Adaptation , 2018, NeurIPS.

[12]  Shi Li,et al.  A novel convolutional neural network based fault recognition method via image fusion of multi-vibration-signals , 2019, Comput. Ind..

[13]  Yi Yao,et al.  Boosting for transfer learning with multiple sources , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Robert B. Randall,et al.  Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study , 2015 .

[15]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[16]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[17]  Hongkai Jiang,et al.  Intelligent fault diagnosis of rolling bearings using an improved deep recurrent neural network , 2018 .

[18]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[19]  Bin Yang,et al.  An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings , 2019, Mechanical Systems and Signal Processing.

[20]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[21]  Kristen Grauman,et al.  Connecting the Dots with Landmarks: Discriminatively Learning Domain-Invariant Features for Unsupervised Domain Adaptation , 2013, ICML.

[22]  Shibin Wang,et al.  Time-frequency atoms-driven support vector machine method for bearings incipient fault diagnosis , 2016 .

[23]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[24]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[25]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[26]  Kate Saenko,et al.  Return of Frustratingly Easy Domain Adaptation , 2015, AAAI.

[27]  Haidong Shao,et al.  Rolling bearing fault detection using continuous deep belief network with locally linear embedding , 2018, Comput. Ind..

[28]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[29]  Trevor Darrell,et al.  Simultaneous Deep Transfer Across Domains and Tasks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[30]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[31]  Siliang Lu,et al.  In Situ Motor Fault Diagnosis Using Enhanced Convolutional Neural Network in an Embedded System , 2020, IEEE Sensors Journal.

[32]  Huaqing Wang,et al.  A Novel Feature Enhancement Method Based on Improved Constraint Model of Online Dictionary Learning , 2019, IEEE Access.

[33]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[34]  Robert X. Gao,et al.  Virtualization and deep recognition for system fault classification , 2017 .