MiDAN: A framework for cross-domain intelligent fault diagnosis with imbalanced datasets

Abstract The success of deep learning techniques for intelligent fault diagnosis relies on two explicit assumptions: (1) the training and testing data are drawn from the same distribution; (2) the data are class-wise balanced. However, those assumptions often prove to be a significant obstacle for industrial applications. This paper presents a framework named deep mixup domain adaptation network (MiDAN) to tackle the distribution mismatches and data imbalance simultaneously. Specifically, the rebalanced mixup training (ReMix) is proposed associated with domain adversarial training, which guarantees a more reliable distribution matching based on a data-agnostic manner. Furthermore, a strong–weak learning framework is adopted to automatically learn representative features and directly explore the hidden information shared by the source and the target domains. Validation experiments are performed based on the cross-domain rolling bearing fault diagnosis tasks. As reported, the proposed method achieves superior diagnosis performance comparing to the state-of-the-art deep learning methods.

[1]  Yi Zhang,et al.  Cost sensitive active learning using bidirectional gated recurrent neural networks for imbalanced fault diagnosis , 2020, Neurocomputing.

[2]  Lihui Wang,et al.  Imbalanced data fault diagnosis of rotating machinery using synthetic oversampling and feature learning , 2018, Journal of Manufacturing Systems.

[3]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[4]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[5]  Jin Zhang,et al.  Application of cost-sensitive LSTM in water level prediction for nuclear reactor pressurizer , 2020, Nuclear Engineering and Technology.

[6]  Xiaqing Ding,et al.  High-Precision Multicamera-Assisted Camera-IMU Calibration: Theory and Method , 2021, IEEE Transactions on Instrumentation and Measurement.

[7]  Jipu Li,et al.  Domain Adversarial Transfer Network for Cross-Domain Fault Diagnosis of Rotary Machinery , 2020, IEEE Transactions on Instrumentation and Measurement.

[8]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[9]  Pourya Shamsolmoali,et al.  Oversampling Adversarial Network for Class-Imbalanced Fault Diagnosis , 2020, ArXiv.

[10]  Xin Yu,et al.  Weakly-Supervised Salient Object Detection via Scribble Annotations , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Hongli Gao,et al.  Deep Focus Parallel Convolutional Neural Network for Imbalanced Classification of Machinery Fault Diagnostics , 2020, IEEE Transactions on Instrumentation and Measurement.

[12]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[13]  Liang Guo,et al.  Machinery health indicator construction based on convolutional neural networks considering trend burr , 2018, Neurocomputing.

[14]  Jing Lin,et al.  Double-level adversarial domain adaptation network for intelligent fault diagnosis , 2020, Knowl. Based Syst..

[15]  Chao Liu,et al.  Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application , 2018, ISA transactions.

[16]  Liang Guo,et al.  A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines , 2018, Neurocomputing.

[17]  Cheng Wu,et al.  A Graph Embedding Framework for Maximum Mean Discrepancy-Based Domain Adaptation Algorithms , 2020, IEEE Transactions on Image Processing.

[18]  Matthias Rätsch,et al.  Deep Adversarial Domain Adaptation Model for Bearing Fault Diagnosis , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[19]  Gao Huang,et al.  Meta-Semi: A Meta-learning Approach for Semi-supervised Learning , 2020, CAAI Artificial Intelligence Research.

[20]  Yiqiang Chen,et al.  Balanced Distribution Adaptation for Transfer Learning , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[21]  Michael J. Dinneen,et al.  Improved Mixed-Example Data Augmentation , 2018, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[22]  Wei Zhang,et al.  Intelligent cross-machine fault diagnosis approach with deep auto-encoder and domain adaptation , 2020, Neurocomputing.

[23]  Walter Sextro,et al.  Condition Monitoring of Bearing Damage in Electromechanical Drive Systems by Using Motor Current Signals of Electric Motors: A Benchmark Data Set for Data-Driven Classification , 2016, PHM Society European Conference.

[24]  Xuefeng Yan,et al.  Imbalanced Classification Based on Minority Clustering Synthetic Minority Oversampling Technique With Wind Turbine Fault Detection Application , 2021, IEEE Transactions on Industrial Informatics.

[25]  Meng Ma,et al.  Deep-Convolution-Based LSTM Network for Remaining Useful Life Prediction , 2021, IEEE Transactions on Industrial Informatics.

[26]  Hongli Gao,et al.  Deep Coupled Joint Distribution Adaptation Network: A Method for Intelligent Fault Diagnosis Between Artificial and Real Damages , 2021, IEEE Transactions on Instrumentation and Measurement.

[27]  Hongyi Zhang,et al.  mixup: Beyond Empirical Risk Minimization , 2017, ICLR.

[28]  Suvrit Sra,et al.  Strength from Weakness: Fast Learning Using Weak Supervision , 2020, ICML.

[29]  Takuya Shimada,et al.  Data Interpolating Prediction: Alternative Interpretation of Mixup , 2019, ArXiv.

[30]  Yaguo Lei,et al.  A Hybrid Prognostics Approach for Estimating Remaining Useful Life of Rolling Element Bearings , 2020, IEEE Transactions on Reliability.

[31]  Hongli Gao,et al.  A Data-Flow Oriented Deep Ensemble Learning Method for Real-Time Surface Defect Inspection , 2020, IEEE Transactions on Instrumentation and Measurement.

[32]  Bingbing Ni,et al.  Adversarial Domain Adaptation with Domain Mixup , 2019, AAAI.

[33]  Xiang Li,et al.  Diagnosing Rotating Machines With Weakly Supervised Data Using Deep Transfer Learning , 2020, IEEE Transactions on Industrial Informatics.

[34]  K NgMichael,et al.  Domain-attention Conditional Wasserstein Distance for Multi-source Domain Adaptation , 2020 .