Cross-Domain Fault Diagnosis Using Knowledge Transfer Strategy: A Review

Data-driven fault diagnosis has been a hot topic in recent years with the development of machine learning techniques. However, the prerequisite that the training data and the test data should follow an identical distribution prevents the conventional data-driven diagnosis methods from being applied to the engineering diagnosis problems. To tackle this dilemma, cross-domain fault diagnosis using knowledge transfer strategy is becoming popular in the past five years. The diagnosis methods based on transfer learning aim to build models that can perform well on target tasks by leveraging knowledge from semantic related but distribution different source domains. This paper for the first time summarizes the state-of-art cross-domain fault diagnosis research works. The literatures are introduced from three different viewpoints: research motivations, cross-domain strategies, and application objects. In addition, the corresponding open-source fault datasets and several future directions are also presented. The survey provides readers a framework for better understanding and identifying the research status, challenges and future directions of cross-domain fault diagnosis.

[1]  Chao Liu,et al.  Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application , 2018, ISA transactions.

[2]  Haidong Shao,et al.  Rolling bearing fault diagnosis using adaptive deep belief network with dual-tree complex wavelet packet. , 2017, ISA transactions.

[3]  Bin Wu,et al.  Power Equipment Fault Diagnosis Model Based on Deep Transfer Learning with Balanced Distribution Adaptation , 2018, ADMA.

[4]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[5]  Dumitru Erhan,et al.  Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Olga Fink,et al.  Domain Adaptive Transfer Learning for Fault Diagnosis , 2019, 2019 Prognostics and System Health Management Conference (PHM-Paris).

[7]  Huijun Gao,et al.  Data-Based Techniques Focused on Modern Industry: An Overview , 2015, IEEE Transactions on Industrial Electronics.

[8]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[9]  Jiong Tang,et al.  Preprocessing-Free Gear Fault Diagnosis Using Small Datasets With Deep Convolutional Neural Network-Based Transfer Learning , 2017, IEEE Access.

[10]  Rong Yan,et al.  Cross-domain video concept detection using adaptive svms , 2007, ACM Multimedia.

[11]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[12]  Steven X. Ding,et al.  A Review on Basic Data-Driven Approaches for Industrial Process Monitoring , 2014, IEEE Transactions on Industrial Electronics.

[13]  Dong Xu,et al.  Recent Advances in Transfer Learning for Cross-Dataset Visual Recognition , 2017, ACM Comput. Surv..

[14]  Wei Zhang,et al.  ACDIN: Bridging the gap between artificial and real bearing damages for bearing fault diagnosis , 2018, Neurocomputing.

[15]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[16]  Fulei Chu,et al.  Recent advances in time–frequency analysis methods for machinery fault diagnosis: A review with application examples , 2013 .

[17]  Yaguo Lei,et al.  Deep Transfer Diagnosis Method for Machinery in Big Data Era , 2019, Journal of Mechanical Engineering.

[18]  Hyunseok Oh,et al.  Scalable and Unsupervised Feature Engineering Using Vibration-Imaging and Deep Learning for Rotor System Diagnosis , 2018, IEEE Transactions on Industrial Electronics.

[19]  Mehrtash Tafazzoli Harandi,et al.  Learning an Invariant Hilbert Space for Domain Adaptation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Brigitte Chebel-Morello,et al.  PRONOSTIA : An experimental platform for bearings accelerated degradation tests. , 2012 .

[21]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[22]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[23]  Tao Zhang,et al.  A Transfer Learning Strategy for Rotation Machinery Fault Diagnosis based on Cycle-Consistent Generative Adversarial Networks , 2018, 2018 Chinese Automation Congress (CAC).

[24]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[25]  Lixiang Duan,et al.  Auxiliary-model-based domain adaptation for reciprocating compressor diagnosis under variable conditions , 2018, J. Intell. Fuzzy Syst..

[26]  Lixiang Duan,et al.  On cross-domain feature fusion in gearbox fault diagnosis under various operating conditions based on Transfer Component Analysis , 2016, 2016 IEEE International Conference on Prognostics and Health Management (ICPHM).

[27]  Svetha Venkatesh,et al.  Information-Theoretic Transfer Learning Framework for Bayesian Optimisation , 2018, ECML/PKDD.

[28]  Jianwen Guo,et al.  Fault Diagnosis of Delta 3D Printers Using Transfer Support Vector Machine With Attitude Signals , 2019, IEEE Access.

[29]  Lorenzo Bruzzone,et al.  Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Chao Liu,et al.  A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults , 2019, Knowl. Based Syst..

[31]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[32]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[33]  Bernhard Schölkopf,et al.  Correcting Sample Selection Bias by Unlabeled Data , 2006, NIPS.

[34]  Bo Zhang,et al.  Bearing Fault Diagnosis Under Variable Working Conditions Based on Domain Adaptation Using Feature Transfer Learning , 2018, IEEE Access.

[35]  Enrico Zio,et al.  Artificial intelligence for fault diagnosis of rotating machinery: A review , 2018, Mechanical Systems and Signal Processing.

[36]  Alessandro Paolo Daga,et al.  The Politecnico di Torino rolling bearing test rig: Description and analysis of open access data , 2019, Mechanical Systems and Signal Processing.

[37]  Bin Yang,et al.  An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings , 2019, Mechanical Systems and Signal Processing.

[38]  Meng Zhang,et al.  Adversarial adaptive 1-D convolutional neural networks for bearing fault diagnosis under varying working condition , 2018, ArXiv.

[39]  Ran Zhang,et al.  Transfer Learning With Neural Networks for Bearing Fault Diagnosis in Changing Working Conditions , 2017, IEEE Access.

[40]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[41]  Liang Gao,et al.  A New Two-Level Hierarchical Diagnosis Network Based on Convolutional Neural Network , 2020, IEEE Transactions on Instrumentation and Measurement.

[42]  Yi Pan,et al.  An Approach for HVCB Mechanical Fault Diagnosis Based on a Deep Belief Network and a Transfer Learning Strategy , 2019, Journal of Electrical Engineering & Technology.

[43]  Shuai Yang,et al.  Transfer Learning Based Fault Diagnosis with Missing Data Due to Multi-Rate Sampling , 2019, Sensors.

[44]  Mike Nicolai,et al.  Simulation-driven machine learning: Bearing fault classification , 2018 .

[45]  Baoping Tang,et al.  Fault diagnosis method based on incremental enhanced supervised locally linear embedding and adaptive nearest neighbor classifier , 2014 .

[46]  Peng Peng,et al.  NOSCNN: A robust method for fault diagnosis of RV reducer , 2019, Measurement.

[47]  Weiming Shen,et al.  Online Fault Diagnosis Method Based on Transfer Convolutional Neural Networks , 2020, IEEE Transactions on Instrumentation and Measurement.

[48]  Shunming Li,et al.  Generalization of deep neural network for bearing fault diagnosis under different working conditions using multiple kernel method , 2019, Neurocomputing.

[49]  Zhiyu Liu,et al.  Transfer learning with convolutional neural networks for small sample size problem in machinery fault diagnosis , 2019, Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science.

[50]  Yue Cao,et al.  Transferable Representation Learning with Deep Adaptation Networks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Donald A. Adjeroh,et al.  Unified Deep Supervised Domain Adaptation and Generalization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[52]  Mei Wang,et al.  Deep Visual Domain Adaptation: A Survey , 2018, Neurocomputing.

[53]  Shuai Yang,et al.  Incipient Fault Diagnosis Based on DNN with Transfer Learning , 2018, 2018 International Conference on Control, Automation and Information Sciences (ICCAIS).

[54]  Zhiheng Li,et al.  A cross domain feature extraction method based on transfer component analysis for rolling bearing fault diagnosis , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[55]  Yan Xu,et al.  A Digital-Twin-Assisted Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Access.

[56]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[57]  Ming Shao,et al.  Generalized Transfer Subspace Learning Through Low-Rank Constraint , 2014, International Journal of Computer Vision.

[58]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[59]  Wei Zhang,et al.  Multi-Layer domain adaptation method for rolling bearing fault diagnosis , 2019, Signal Process..

[60]  Jiaying Liu,et al.  Adaptive Batch Normalization for practical domain adaptation , 2018, Pattern Recognit..

[61]  Wei Zhang,et al.  A robust intelligent fault diagnosis method for rolling element bearings based on deep distance metric learning , 2018, Neurocomputing.

[62]  Rama Chellappa,et al.  Compositional Dictionaries for Domain Adaptive Face Recognition , 2013, IEEE Transactions on Image Processing.

[63]  Lin Lin,et al.  A novel gas turbine fault diagnosis method based on transfer learning with CNN , 2019, Measurement.

[64]  Michael Jones,et al.  An improved deep learning architecture for person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[65]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[66]  Dongrui Wu,et al.  Wasserstein Distance based Deep Adversarial Transfer Learning for Intelligent Fault Diagnosis , 2019, Neurocomputing.

[67]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[68]  Wei Li,et al.  Bearing Fault Diagnosis Based on Domain Adaptation Using Transferable Features under Different Working Conditions , 2018, Shock and Vibration.

[69]  Zhibin Zhao,et al.  Deep Transfer Learning Based on Sparse Autoencoder for Remaining Useful Life Prediction of Tool in Manufacturing , 2019, IEEE Transactions on Industrial Informatics.

[70]  Lemao Liu,et al.  Instance Weighting for Neural Machine Translation Domain Adaptation , 2017, EMNLP.

[71]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[72]  Rama Chellappa,et al.  Domain adaptation for object recognition: An unsupervised approach , 2011, 2011 International Conference on Computer Vision.

[73]  Gabriela Csurka,et al.  Domain Adaptation for Visual Applications: A Comprehensive Survey , 2017, ArXiv.

[74]  Chao Liu,et al.  An adaptive spatiotemporal feature learning approach for fault diagnosis in complex systems , 2019, Mechanical Systems and Signal Processing.

[75]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[76]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[77]  Ao Zhang,et al.  Supervised dictionary-based transfer subspace learning and applications for fault diagnosis of sucker rod pumping systems , 2019, Neurocomputing.

[78]  Haibo He,et al.  A Hierarchical Deep Domain Adaptation Approach for Fault Diagnosis of Power Plant Thermal System , 2019, IEEE Transactions on Industrial Informatics.

[79]  Chao Liu,et al.  Learning transferable features in deep convolutional neural networks for diagnosing unseen machine conditions. , 2019, ISA transactions.

[80]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[81]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[82]  Shunming Li,et al.  A New Deep Transfer Learning Network for Fault Diagnosis of Rotating Machine Under Variable Working Conditions , 2018, 2018 Prognostics and System Health Management Conference (PHM-Chongqing).

[83]  Nan Chen,et al.  Prognostics and Health Management: A Review on Data Driven Approaches , 2015 .

[84]  Mehmet Gönen,et al.  Kernelized Bayesian Transfer Learning , 2014, AAAI.

[85]  Bin Yang,et al.  A Transfer Learning Method for Intelligent Fault Diagnosis from Laboratory Machines to Real-Case Machines , 2018, 2018 International Conference on Sensing,Diagnostics, Prognostics, and Control (SDPC).

[86]  Eliathamby Ambikairajah,et al.  DA-DCGAN: An Effective Methodology for DC Series Arc Fault Diagnosis in Photovoltaic Systems , 2019, IEEE Access.

[87]  Huijun Gao,et al.  A convolutional neural network based on a capsule network with strong generalization for bearing fault diagnosis , 2019, Neurocomputing.

[88]  Shunming Li,et al.  A novel transfer learning method for robust fault diagnosis of rotating machines under variable working conditions , 2019, Measurement.

[89]  Xinyu Li,et al.  A New Snapshot Ensemble Convolutional Neural Network for Fault Diagnosis , 2019, IEEE Access.

[90]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[91]  Fei Shen,et al.  Bearing fault diagnosis based on SVD feature extraction and transfer learning classification , 2015, 2015 Prognostics and System Health Management Conference (PHM).

[92]  Jong-Myon Kim,et al.  Bearing Fault Diagnosis under Variable Rotational Speeds Using Stockwell Transform-Based Vibration Imaging and Transfer Learning , 2018, Applied Sciences.

[93]  Kjell G. Robbersmyr,et al.  Fault Classification of Axial and Radial Roller Bearings Using Transfer Learning through a Pretrained Convolutional Neural Network , 2018, Designs.

[94]  Xiang Li,et al.  Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[95]  Jong-Myon Kim,et al.  1D CNN-Based Transfer Learning Model for Bearing Fault Diagnosis Under Variable Working Conditions , 2018, Advances in Intelligent Systems and Computing.

[96]  Ming Yang,et al.  Conditional Generative Adversarial Network for Structured Domain Adaptation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[97]  Rama Chellappa,et al.  Domain Adaptive Dictionary Learning , 2012, ECCV.

[98]  Byeng D. Youn,et al.  A New Parameter Repurposing Method for Parameter Transfer With Small Dataset and Its Application in Fault Diagnosis of Rolling Element Bearings , 2019, IEEE Access.

[99]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[100]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[101]  Ivor W. Tsang,et al.  Domain Transfer Multiple Kernel Learning , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[102]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .

[103]  Wei Chen,et al.  Intelligent fault diagnosis of rotating machinery using support vector machine with ant colony algorithm for synchronous feature selection and parameter optimization , 2015, Neurocomputing.

[104]  Meng Zhang,et al.  Bearing fault diagnosis under varying working condition based on domain adaptation , 2017, ArXiv.

[105]  Jong-Myon Kim,et al.  Acoustic spectral imaging and transfer learning for reliable bearing fault diagnosis under variable speed conditions , 2019, Measurement.

[106]  Philip S. Yu,et al.  Adaptation Regularization: A General Framework for Transfer Learning , 2014, IEEE Transactions on Knowledge and Data Engineering.

[107]  Kate Saenko,et al.  Subspace Distribution Alignment for Unsupervised Domain Adaptation , 2015, BMVC.

[108]  Zhiheng Li,et al.  A Deep Transfer Model With Wasserstein Distance Guided Multi-Adversarial Networks for Bearing Fault Diagnosis Under Different Working Conditions , 2019, IEEE Access.

[109]  Arash Golibagh Mahyari.  Domain Adaptation in Robot Fault Diagnostic Systems , 2018, ArXiv.

[110]  Fuzhen Zhuang,et al.  Supervised Representation Learning: Transfer Learning with Deep Autoencoders , 2015, IJCAI.

[111]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[112]  Ming J. Zuo,et al.  Convolutional Neural Networks for Fault Diagnosis Using Rotating Speed Normalized Vibration , 2018, Applied Condition Monitoring.

[113]  Qinghua Zhang,et al.  Fault Diagnosis of a Rolling Bearing Using Wavelet Packet Denoising and Random Forests , 2017, IEEE Sensors Journal.

[114]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[115]  Minqiang Xu,et al.  Intelligent Fault Identification Based on Multisource Domain Generalization Towards Actual Diagnosis Scenario , 2020, IEEE Transactions on Industrial Electronics.

[116]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[117]  Liang Gao,et al.  A transfer convolutional neural network for fault diagnosis based on ResNet-50 , 2019, Neural Computing and Applications.

[118]  Thomas G. Habetler,et al.  Machine Learning and Deep Learning Algorithms for Bearing Fault Diagnostics - A Comprehensive Review , 2019, ArXiv.

[119]  Walter Sextro,et al.  Condition Monitoring of Bearing Damage in Electromechanical Drive Systems by Using Motor Current Signals of Electric Motors: A Benchmark Data Set for Data-Driven Classification , 2016, PHM Society European Conference.

[120]  Dong Liu,et al.  Robust visual domain adaptation with low-rank reconstruction , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[121]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[122]  Jay Lee,et al.  Robust performance degradation assessment methods for enhanced rolling element bearing prognostics , 2003, Adv. Eng. Informatics.

[123]  Lior Wolf,et al.  Unsupervised Cross-Domain Image Generation , 2016, ICLR.

[124]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[125]  Lei Zhang,et al.  Transfer Adaptation Learning: A Decade Survey , 2019, IEEE transactions on neural networks and learning systems.

[126]  ChengXiang Zhai,et al.  Instance Weighting for Domain Adaptation in NLP , 2007, ACL.

[127]  Bo Zhang,et al.  Intelligent Fault Diagnosis Under Varying Working Conditions Based on Domain Adaptive Convolutional Neural Networks , 2018, IEEE Access.

[128]  Shunming Li,et al.  A New Transfer Learning Method and its Application on Rotating Machine Fault Diagnosis Under Variant Working Conditions , 2018, IEEE Access.

[129]  Wang Wei,et al.  Heterogeneous Transfer Learning Based on Stack Sparse Auto-Encoders for Fault Diagnosis , 2018, 2018 Chinese Automation Congress (CAC).

[130]  Deepak S. Turaga,et al.  Cross domain distribution adaptation via kernel mapping , 2009, KDD.