Intelligent cross-machine fault diagnosis approach with deep auto-encoder and domain adaptation

Abstract Recently, due to the rising industrial demands for intelligent machinery fault diagnosis with strong generalization, transfer learning techniques have been used to enhance adaptability of data-driven approaches. Particularly, the domain shift problem where training and testing data are sampled from different operating conditions of the same machine is well addressed. However, it is still difficult to prepare sufficient labeled data on the tested machine. Therefore, the idea of transferring fault diagnosis knowledge learned from one machine to different but related machines is motivated, and that is realized through a deep learning-based method in this paper. Features of different equipments are first projected into the same subspace using an auto-encoder structure, and cross-machine adaptation algorithm is adopted for knowledge generalization, where the distribution discrepancy between data from different machines is minimized. Experiments on three rolling bearing datasets are implemented to validate the proposed method. The results suggest it is feasible to transfer fault diagnosis knowledge across different machines, and the proposed method offers a novel and promising approach for knowledge generalization.

[1]  Wei Zhang,et al.  A robust intelligent fault diagnosis method for rolling element bearings based on deep distance metric learning , 2018, Neurocomputing.

[2]  Chunhui Zhao,et al.  Online Fault Diagnosis in Industrial Processes Using Multimodel Exponential Discriminant Analysis Algorithm , 2019, IEEE Transactions on Control Systems Technology.

[3]  Chunhui Zhao,et al.  Enhanced Random Forest With Concurrent Analysis of Static and Dynamic Nodes for Industrial Fault Classification , 2020, IEEE Transactions on Industrial Informatics.

[4]  Lixiang Duan,et al.  On cross-domain feature fusion in gearbox fault diagnosis under various operating conditions based on Transfer Component Analysis , 2016, 2016 IEEE International Conference on Prognostics and Health Management (ICPHM).

[5]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[6]  Sivaraman Balakrishnan,et al.  Optimal kernel choice for large-scale two-sample tests , 2012, NIPS.

[7]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[8]  Wei Jiang,et al.  Unsupervised fault diagnosis of rolling bearings using a deep neural network based on generative adversarial networks , 2018, Neurocomputing.

[9]  Hui Ma,et al.  Review on dynamics of cracked gear systems , 2015 .

[10]  Qiang Yang,et al.  Distant Domain Transfer Learning , 2017, AAAI.

[11]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[12]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[13]  Zhiwei Gao,et al.  Takagi–Sugeno Fuzzy Model Based Fault Estimation and Signal Compensation With Application to Wind Turbines , 2017, IEEE Transactions on Industrial Electronics.

[14]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  Ruqiang Yan,et al.  Convolutional Discriminative Feature Learning for Induction Motor Fault Diagnosis , 2017, IEEE Transactions on Industrial Informatics.

[16]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[17]  Shunming Li,et al.  Generalization of deep neural network for bearing fault diagnosis under different working conditions using multiple kernel method , 2019, Neurocomputing.

[18]  Kun Yu,et al.  A Combined Polynomial Chirplet Transform and Synchroextracting Technique for Analyzing Nonstationary Signals of Rotating Machinery , 2020, IEEE Transactions on Instrumentation and Measurement.

[19]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[20]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[21]  Hai Qiu,et al.  Wavelet filter-based weak signature detection method and its application on rolling element bearing prognostics , 2006 .

[22]  Jeff G. Schneider,et al.  Flexible Transfer Learning under Support and Model Shift , 2014, NIPS.

[23]  Wei Zhang,et al.  Multi-Layer domain adaptation method for rolling bearing fault diagnosis , 2019, Signal Process..

[24]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[25]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[26]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[27]  Moncef Gabbouj,et al.  Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks , 2017 .

[28]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[29]  Xiang Li,et al.  Diagnosing Rotating Machines With Weakly Supervised Data Using Deep Transfer Learning , 2020, IEEE Transactions on Industrial Informatics.

[30]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[31]  Chunhui Zhao,et al.  Sparse Exponential Discriminant Analysis and Its Application to Fault Diagnosis , 2018, IEEE Transactions on Industrial Electronics.

[32]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[33]  Fei Shen,et al.  Bearing fault diagnosis based on SVD feature extraction and transfer learning classification , 2015, 2015 Prognostics and System Health Management Conference (PHM).

[34]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[35]  Silvio Simani,et al.  Fault Diagnosis of a Wind Turbine Benchmark via Identified Fuzzy Models , 2015, IEEE Transactions on Industrial Electronics.

[36]  Xiang Li,et al.  Deep Learning-Based Machinery Fault Diagnostics With Domain Adaptation Across Sensors at Different Places , 2020, IEEE Transactions on Industrial Electronics.

[37]  Xiang Li,et al.  Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[38]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[39]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[40]  Chunhui Zhao,et al.  Robust Monitoring and Fault Isolation of Nonlinear Industrial Processes Using Denoising Autoencoder and Elastic Net , 2020, IEEE Transactions on Control Systems Technology.

[41]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[42]  Kristen Grauman,et al.  Connecting the Dots with Landmarks: Discriminatively Learning Domain-Invariant Features for Unsupervised Domain Adaptation , 2013, ICML.

[43]  Jun Wang,et al.  An intelligent diagnosis scheme based on generative adversarial learning deep neural networks and its application to planetary gearbox fault pattern recognition , 2018, Neurocomputing.

[44]  Zhong Luo,et al.  Research on vibration performance of the nonlinear combined support-flexible rotor system , 2019, Nonlinear Dynamics.

[45]  Robert B. Randall,et al.  Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study , 2015 .

[46]  Chunhui Zhao,et al.  Online Fault Diagnosis for Industrial Processes With Bayesian Network-Based Probabilistic Ensemble Learning Strategy , 2019, IEEE Transactions on Automation Science and Engineering.

[47]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.