A Transfer Learning Strategy for Rotation Machinery Fault Diagnosis based on Cycle-Consistent Generative Adversarial Networks

Transfer learning has been an important aspect in recent years for labeled data are pretty rare in real application under different conditions. In modern industry systems, collected sample signals are usually not equally distributed, meaning the quantity of data from different working conditions are barely the same. Researchers have proposed a number of methods tackling the issue, most of which try to extract the features of the original data to unify them. Basic and valid algorithm is distribution adaption which include transfer component analysis (TCA), joint distribution adaptation (JDA), correlation alignment (CORAL) and other varieties. These methods have shown great effectiveness in practice. Generative adversarial networks (GANs) are newly developed generative models which can generate new sample data similar to original data through a special designed competitive training procedure. While distribution adaption unify the signal under all the conditions, GAN models are able to achieve approximate distribution functions and generate fake samples for different working conditions. In this paper, a new fault diagnosis transfer learning approach is proposed with a cycle-consistent GAN model. The designed GAN tries to generate new sample for unknown conditions based on known conditions and makes it possible to pre-train a classifier for fault diagnosis. Different experiments were carried out to demonstrate the performance of our proposed model, and other distribution adaption methods are compared. Experiments show that our strategy is superior to existing methods for fault diagnosis transfer learning.

[1]  Luís A. Alexandre 3D Object Recognition Using Convolutional Neural Networks with Transfer Learning Between Input Channels , 2014, IAS.

[2]  Asifullah Khan,et al.  Wind power prediction using deep neural network based meta regression and transfer learning , 2017, Appl. Soft Comput..

[3]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[4]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[5]  Khashayar Khorasani,et al.  Dynamic neural network-based fault diagnosis of gas turbine engines , 2014, Neurocomputing.

[6]  Robert X. Gao,et al.  Wavelets for fault diagnosis of rotary machines: A review with applications , 2014, Signal Process..

[7]  Trevor Darrell,et al.  Deep Domain Confusion: Maximizing for Domain Invariance , 2014, CVPR 2014.

[8]  David Berthelot,et al.  BEGAN: Boundary Equilibrium Generative Adversarial Networks , 2017, ArXiv.

[9]  Bo Zhang,et al.  Bearing Fault Diagnosis Under Variable Working Conditions Based on Domain Adaptation Using Feature Transfer Learning , 2018, IEEE Access.

[10]  Giorgio Sulligoi,et al.  A novel fault diagnosis technique for photovoltaic systems based on artificial neural networks , 2016 .

[11]  Michael I. Jordan,et al.  Unsupervised Domain Adaptation with Residual Transfer Networks , 2016, NIPS.

[12]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[13]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[14]  Lixiang Duan,et al.  On cross-domain feature fusion in gearbox fault diagnosis under various operating conditions based on Transfer Component Analysis , 2016, 2016 IEEE International Conference on Prognostics and Health Management (ICPHM).

[15]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  Gary G. Yen,et al.  Transfer Learning-Based Dynamic Multiobjective Optimization Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[17]  Jieping Ye,et al.  Deep Model Based Transfer and Multi-Task Learning for Biological Image Analysis , 2015, IEEE Transactions on Big Data.

[18]  Ming Zhao,et al.  A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox , 2017 .

[19]  Leonidas J. Guibas,et al.  Taskonomy: Disentangling Task Transfer Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.