Domain generalization in rotating machinery fault diagnostics using deep neural networks

Abstract The past years have witnessed the successful development of intelligent machinery fault diagnostic methods. Besides the basic data-driven fault diagnosis tasks where the training and testing data are collected from the same distribution, the more practical cross-domain problems have also attracted much attention considering variations of machine operating conditions. In the literature, most existing studies generally assume the availability of testing data during model training, thus facilitating explicit domain adaptations. However, this assumption poses obstacles in the application on real-time cross-domain fault diagnosis, where the testing data can not be obtained in advance. This paper proposes a deep learning-based domain generalization method for machinery fault diagnosis. A domain augmentation method is adopted to expand the available dataset. Domain adversarial training is implemented, and generalized features can be learned from different domains, which hold in new working scenarios without assuming the availability of testing data. Distance metric learning is also used to further enhance model robustness in fault classifications. Through experiments on two rotating machinery datasets, the effectiveness of the proposed method is validated, which is promising in on-line cross-domain fault diagnosis tasks.

[1]  Wei Zhang,et al.  Understanding and improving deep learning-based rolling bearing fault diagnosis with attention mechanism , 2019, Signal Process..

[2]  Wei Zhang,et al.  A robust intelligent fault diagnosis method for rolling element bearings based on deep distance metric learning , 2018, Neurocomputing.

[3]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[4]  Xiang Li,et al.  Deep residual learning-based fault diagnosis method for rotating machinery. , 2019, ISA transactions.

[5]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Jeff G. Schneider,et al.  Flexible Transfer Learning under Support and Model Shift , 2014, NIPS.

[7]  Bin Yang,et al.  An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings , 2019, Mechanical Systems and Signal Processing.

[8]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[9]  Shunming Li,et al.  Generalization of deep neural network for bearing fault diagnosis under different working conditions using multiple kernel method , 2019, Neurocomputing.

[10]  Kun Yu,et al.  A Combined Polynomial Chirplet Transform and Synchroextracting Technique for Analyzing Nonstationary Signals of Rotating Machinery , 2020, IEEE Transactions on Instrumentation and Measurement.

[11]  Wei Zhang,et al.  Intelligent cross-machine fault diagnosis approach with deep auto-encoder and domain adaptation , 2020, Neurocomputing.

[12]  Xiang Li,et al.  Diagnosing Rotating Machines With Weakly Supervised Data Using Deep Transfer Learning , 2020, IEEE Transactions on Industrial Informatics.

[13]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[14]  Wei Zhang,et al.  Multi-Layer domain adaptation method for rolling bearing fault diagnosis , 2019, Signal Process..

[15]  Bo Zhang,et al.  Intelligent Fault Diagnosis Under Varying Working Conditions Based on Domain Adaptive Convolutional Neural Networks , 2018, IEEE Access.

[16]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[17]  Robert B. Randall,et al.  Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study , 2015 .

[18]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[19]  Claude Delpha,et al.  An optimal fault detection threshold for early detection using Kullback-Leibler Divergence for unknown distribution data , 2016, Signal Process..

[20]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[21]  Xiang Li,et al.  Deep Learning-Based Machinery Fault Diagnostics With Domain Adaptation Across Sensors at Different Places , 2020, IEEE Transactions on Industrial Electronics.

[22]  Xiang Li,et al.  Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[23]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[24]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .

[25]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[26]  Jun Wang,et al.  An intelligent diagnosis scheme based on generative adversarial learning deep neural networks and its application to planetary gearbox fault pattern recognition , 2018, Neurocomputing.

[27]  Ao Zhang,et al.  Supervised dictionary-based transfer subspace learning and applications for fault diagnosis of sucker rod pumping systems , 2019, Neurocomputing.

[28]  Xu Li,et al.  Machinery fault diagnosis with imbalanced data using deep generative adversarial networks , 2020 .

[29]  Zhong Luo,et al.  Research on vibration performance of the nonlinear combined support-flexible rotor system , 2019, Nonlinear Dynamics.

[30]  Yan Liang,et al.  Bias estimation for asynchronous multi-rate multi-sensor fusion with unknown inputs , 2018, Inf. Fusion.

[31]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[32]  Ruqiang Yan,et al.  Convolutional Discriminative Feature Learning for Induction Motor Fault Diagnosis , 2017, IEEE Transactions on Industrial Informatics.

[33]  Yan Liang,et al.  Target State and Markovian Jump Ionospheric Height Bias Estimation for OTHR Tracking Systems , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[34]  Wei Zhang,et al.  Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction , 2019, Reliab. Eng. Syst. Saf..

[35]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[36]  Hui Ma,et al.  Review on dynamics of cracked gear systems , 2015 .