Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application

In recent years, an increasing popularity of deep learning model for intelligent condition monitoring and diagnosis as well as prognostics used for mechanical systems and structures has been observed. In the previous studies, however, a major assumption accepted by default, is that the training and testing data are taking from same feature distribution. Unfortunately, this assumption is mostly invalid in real application, resulting in a certain lack of applicability for the traditional diagnosis approaches. Inspired by the idea of transfer learning that leverages the knowledge learnt from rich labeled data in source domain to facilitate diagnosing a new but similar target task, a new intelligent fault diagnosis framework, i.e., deep transfer network (DTN), which generalizes deep learning model to domain adaptation scenario, is proposed in this paper. By extending the marginal distribution adaptation (MDA) to joint distribution adaptation (JDA), the proposed framework can exploit the discrimination structures associated with the labeled data in source domain to adapt the conditional distribution of unlabeled target data, and thus guarantee a more accurate distribution matching. Extensive empirical evaluations on three fault datasets validate the applicability and practicability of DTN, while achieving many state-of-the-art transfer results in terms of diverse operating conditions, fault severities and fault types.

[1]  Liang Guo,et al.  A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines , 2018, Neurocomputing.

[2]  Haidong Shao,et al.  Rolling bearing fault diagnosis using an optimization deep belief network , 2015 .

[3]  Zhengjia He,et al.  A novel intelligent gear fault diagnosis model based on EMD and multi-class TSVM , 2012 .

[4]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  Taghi M. Khoshgoftaar,et al.  A survey of transfer learning , 2016, Journal of Big Data.

[6]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[7]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[8]  Asifullah Khan,et al.  Wind power prediction using deep neural network based meta regression and transfer learning , 2017, Appl. Soft Comput..

[9]  Wangsheng Yu,et al.  Online Fast Deep Learning Tracker Based on Deep Sparse Neural Networks , 2017, ICIG.

[10]  Fulei Chu,et al.  HVSRMS localization formula and localization law: Localization diagnosis of a ball bearing outer ring fault , 2019, Mechanical Systems and Signal Processing.

[11]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[12]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[13]  Haidong Shao,et al.  Electric Locomotive Bearing Fault Diagnosis Using a Novel Convolutional Deep Belief Network , 2018, IEEE Transactions on Industrial Electronics.

[14]  Haidong Shao,et al.  Rolling bearing fault diagnosis using adaptive deep belief network with dual-tree complex wavelet packet. , 2017, ISA transactions.

[15]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[16]  Yong Qin,et al.  Sparse classification based on dictionary learning for planet bearing fault identification , 2018, Expert Syst. Appl..

[17]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Te Han,et al.  Intelligent fault diagnosis method for rotating machinery via dictionary learning and sparse representation-based classification , 2018 .

[19]  Saeid Nahavandi,et al.  A sequential search-space shrinking using CNN transfer learning and a Radon projection pool for medical image retrieval , 2018, Expert Syst. Appl..

[20]  Michael I. Jordan,et al.  Deep Transfer Learning with Joint Adaptation Networks , 2016, ICML.

[21]  Myeongsu Kang,et al.  Deep Residual Networks With Dynamically Weighted Wavelet Coefficients for Fault Diagnosis of Planetary Gearboxes , 2018, IEEE Transactions on Industrial Electronics.

[22]  Thomas W. Rauber,et al.  Heterogeneous Feature Models and Feature Selection Applied to Bearing Fault Diagnosis , 2015, IEEE Transactions on Industrial Electronics.

[23]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[24]  Harish Garg,et al.  A hybrid GSA-GA algorithm for constrained optimization problems , 2019, Inf. Sci..

[25]  Chao Liu,et al.  Machine Condition Classification Using Deterioration Feature Extraction and Anomaly Determination , 2011, IEEE Transactions on Reliability.

[26]  Iman Izadi,et al.  Performance Assessment and Design for Univariate Alarm Systems Based on FAR, MAR, and AAD , 2012, IEEE Transactions on Automation Science and Engineering.

[27]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part I: Fault Diagnosis With Model-Based and Signal-Based Approaches , 2015, IEEE Transactions on Industrial Electronics.

[28]  Ming Zhao,et al.  A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox , 2017 .

[29]  Patricia Scully,et al.  Deep Neural Networks for Learning Spatio-Temporal Features From Tomography Sensors , 2018, IEEE Transactions on Industrial Electronics.

[30]  Chao Liu,et al.  Global geometric similarity scheme for feature selection in fault diagnosis , 2014, Expert Syst. Appl..

[31]  Xiang Gong,et al.  Current-Based Mechanical Fault Detection for Direct-Drive Wind Turbines via Synchronous Sampling and Impulse Detection , 2015, IEEE Transactions on Industrial Electronics.

[32]  Xuefeng Chen,et al.  Dislocated Time Series Convolutional Neural Architecture: An Intelligent Fault Diagnosis Approach for Electric Machine , 2017, IEEE Transactions on Industrial Informatics.

[33]  Chao Liu,et al.  A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults , 2019, Knowl. Based Syst..

[34]  Lei Wang,et al.  Comparison of random forest, artificial neural networks and support vector machine for intelligent diagnosis of rotating machinery , 2018, Trans. Inst. Meas. Control.

[35]  Ruqiang Yan,et al.  Convolutional Discriminative Feature Learning for Induction Motor Fault Diagnosis , 2017, IEEE Transactions on Industrial Informatics.

[36]  Diego Cabrera,et al.  A review on data-driven fault severity assessment in rolling bearings , 2018 .

[37]  Mengjie Zhang,et al.  Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation , 2016, ECCV.

[38]  Philip S. Yu,et al.  Transfer Joint Matching for Unsupervised Domain Adaptation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[40]  Yu Zhang,et al.  Learning to Transfer , 2017, ArXiv.

[41]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[42]  Chao Liu,et al.  An adaptive spatiotemporal feature learning approach for fault diagnosis in complex systems , 2019, Mechanical Systems and Signal Processing.

[43]  Lingli Cui,et al.  Research on the meshing stiffness and vibration response of fault gears under an angle-changing crack based on the universal equation of gear profile , 2016 .

[44]  Jyoti K. Sinha,et al.  A novel fault diagnosis technique for enhancing maintenance and reliability of rotating machines , 2015 .

[45]  Harish Garg,et al.  A novel TVAC-PSO based mutation strategies algorithm for generation scheduling of pumped storage hydrothermal system incorporating solar units , 2018 .

[46]  Jing Lin,et al.  A multivariate encoder information based convolutional neural network for intelligent fault diagnosis of planetary gearboxes , 2018, Knowl. Based Syst..

[47]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part II: Fault Diagnosis With Knowledge-Based and Hybrid/Active Approaches , 2015, IEEE Transactions on Industrial Electronics.

[48]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[49]  Chao Liu,et al.  Learning transferable features in deep convolutional neural networks for diagnosing unseen machine conditions. , 2019, ISA transactions.

[50]  Shubin Si,et al.  The Entropy Algorithm and Its Variants in the Fault Diagnosis of Rotating Machinery: A Review , 2018, IEEE Access.

[51]  Xianzhi Wang,et al.  Entropy Based Fault Classification Using the Case Western Reserve University Data: A Benchmark Study , 2020, IEEE Transactions on Reliability.

[52]  Yaguo Lei,et al.  EEMD method and WNN for fault diagnosis of locomotive roller bearings , 2011, Expert Syst. Appl..

[53]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[54]  Enrico Zio,et al.  Artificial intelligence for fault diagnosis of rotating machinery: A review , 2018, Mechanical Systems and Signal Processing.

[55]  Mohammad Modarres,et al.  Deep Learning Enabled Fault Diagnosis Using Time-Frequency Image Analysis of Rolling Element Bearings , 2017 .

[56]  Hanseok Ko,et al.  DNN Transfer Learning Based Non-Linear Feature Extraction for Acoustic Event Classification , 2017, IEICE Trans. Inf. Syst..

[57]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[58]  Qingbo He,et al.  Energy-Fluctuated Multiscale Feature Learning With Deep ConvNet for Intelligent Spindle Bearing Fault Diagnosis , 2017, IEEE Transactions on Instrumentation and Measurement.