Multi-Layer domain adaptation method for rolling bearing fault diagnosis

Abstract In the past years, data-driven approaches such as deep learning have been widely applied on machinery signal processing to develop intelligent fault diagnosis systems. In real-world applications, domain shift problem usually occurs where the distribution of the labeled training data, denoted as source domain, is different from that of the unlabeled testing data, known as target domain. That results in serious diagnosis performance degradation. This paper proposes a novel domain adaptation method for rolling bearing fault diagnosis based on deep learning techniques. A deep convolutional neural network is used as the main architecture. The multi-kernel maximum mean discrepancies (MMD) between the two domains in multiple layers are minimized to adapt the learned representations from supervised learning in the source domain to be applied in the target domain. The domain-invariant features can be efficiently extracted in this way, and the cross-domain testing performance can be significantly improved. Experiments on two rolling bearing datasets are carried out to validate the effectiveness of the domain adaptation approach. Comparisons with other approaches and related works demonstrate the superiority of the proposed method. The experimental results of this study suggest the proposed domain adaptation method offers a new and promising tool for intelligent fault diagnosis.

[1]  Zhu Huijie,et al.  Fault diagnosis of hydraulic pump based on stacked autoencoders , 2015, 2015 12th IEEE International Conference on Electronic Measurement & Instruments (ICEMI).

[2]  Tinne Tuytelaars,et al.  Unsupervised Visual Domain Adaptation Using Subspace Alignment , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Bingyuan Liu,et al.  Regularized Hierarchical Feature Learning with Non-negative Sparsity and Selectivity for Image Classification , 2014, 2014 22nd International Conference on Pattern Recognition.

[4]  Tommy W. S. Chow,et al.  Motor Bearing Fault Diagnosis Using Trace Ratio Linear Discriminant Analysis , 2014, IEEE Transactions on Industrial Electronics.

[5]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Guolin He,et al.  Semisupervised Distance-Preserving Self-Organizing Map for Machine-Defect Detection and Classification , 2013, IEEE Transactions on Instrumentation and Measurement.

[7]  Sivaraman Balakrishnan,et al.  Optimal kernel choice for large-scale two-sample tests , 2012, NIPS.

[8]  Ruqiang Yan,et al.  Convolutional Discriminative Feature Learning for Induction Motor Fault Diagnosis , 2017, IEEE Transactions on Industrial Informatics.

[9]  Richard S. Zemel,et al.  Generative Moment Matching Networks , 2015, ICML.

[10]  Bo-Suk Yang,et al.  Random forests classifier for machine fault diagnosis , 2008 .

[11]  Yitao Liang,et al.  A novel bearing fault diagnosis model integrated permutation entropy, ensemble empirical mode decomposition and optimized SVM , 2015 .

[12]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[13]  Claude Delpha,et al.  An optimal fault detection threshold for early detection using Kullback-Leibler Divergence for unknown distribution data , 2016, Signal Process..

[14]  Tinne Tuytelaars,et al.  Lightweight Unsupervised Domain Adaptation by Convolutional Filter Reconstruction , 2016, ECCV Workshops.

[15]  Wenliao Du,et al.  Wavelet leaders multifractal features based fault diagnosis of rotating mechanism , 2014 .

[16]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[17]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[18]  L. Qiang,et al.  Engineering signal processing based on adaptive step-changed stochastic resonance , 2007 .

[19]  D. Jacobs,et al.  Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch , 2011, CVPR 2011.

[20]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[21]  Bernhard Schölkopf,et al.  Domain Adaptation under Target and Conditional Shift , 2013, ICML.

[22]  S.A.V. Satya Murty,et al.  Roller element bearing fault diagnosis using singular spectrum analysis , 2013 .

[23]  Alberto Bellini,et al.  Detection of Generalized-Roughness Bearing Fault by Spectral-Kurtosis Energy of Vibration or Current Signals , 2009, IEEE Transactions on Industrial Electronics.

[24]  V. Sugumaran,et al.  Fault diagnosis of automobile hydraulic brake system using statistical features and support vector machines , 2015 .

[25]  Huajing Fang,et al.  Diversified learning for continuous hidden Markov models with application to fault diagnosis , 2015, Expert Syst. Appl..

[26]  Kristen Grauman,et al.  Connecting the Dots with Landmarks: Discriminatively Learning Domain-Invariant Features for Unsupervised Domain Adaptation , 2013, ICML.

[27]  Hu Xiao,et al.  Research of weak fault feature information extraction of planetary gear based on ensemble empirical mode decomposition and adaptive stochastic resonance , 2015 .

[28]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[29]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[30]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[31]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[32]  Balbir S. Dhillon,et al.  Early fault diagnosis of rotating machinery based on wavelet packets—Empirical mode decomposition feature extraction and neural network , 2012 .

[33]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[34]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[35]  Fei Shen,et al.  Bearing fault diagnosis based on SVD feature extraction and transfer learning classification , 2015, 2015 Prognostics and System Health Management Conference (PHM).

[36]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[37]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[38]  Xiang Li,et al.  Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[39]  Siliang Lu,et al.  Fault diagnosis of motor bearing with speed fluctuation via angular resampling of transient sound signals , 2016 .

[40]  Fengshou Gu,et al.  Thermal image enhancement using bi-dimensional empirical mode decomposition in combination with relevance vector machine for rotating machinery fault diagnosis , 2013 .

[41]  Barend J. van Wyk,et al.  Difference Histograms: A new tool for time series analysis applied to bearing fault diagnosis , 2009, Pattern Recognit. Lett..

[42]  Jeff G. Schneider,et al.  Flexible Transfer Learning under Support and Model Shift , 2014, NIPS.

[43]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[44]  Dong Xu,et al.  Exploiting web images for event recognition in consumer videos: A multiple source domain adaptation approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[46]  Wei Zhang,et al.  A robust intelligent fault diagnosis method for rolling element bearings based on deep distance metric learning , 2018, Neurocomputing.

[47]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[48]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[49]  Bin Li,et al.  Crack fault diagnosis of rotor systems using wavelet transforms , 2015, Comput. Electr. Eng..

[50]  Huibin Lin,et al.  Fault feature extraction of rolling element bearings using sparse representation , 2016 .

[51]  Peter W. Tse,et al.  Wavelet Analysis and Envelope Detection For Rolling Element Bearing Fault Diagnosis—Their Effectiveness and Flexibilities , 2001 .

[52]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[53]  Wei Chen,et al.  Intelligent fault diagnosis of rotating machinery using support vector machine with ant colony algorithm for synchronous feature selection and parameter optimization , 2015, Neurocomputing.

[54]  Lixiang Duan,et al.  On cross-domain feature fusion in gearbox fault diagnosis under various operating conditions based on Transfer Component Analysis , 2016, 2016 IEEE International Conference on Prognostics and Health Management (ICPHM).

[55]  Ivan Prebil,et al.  EEMD-based multiscale ICA method for slewing bearing fault detection and diagnosis , 2016 .

[56]  Robert B. Randall,et al.  Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study , 2015 .

[57]  Khe Chai Sim,et al.  On combining i-vectors and discriminative adaptation methods for unsupervised speaker normalization in DNN acoustic models , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[58]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[59]  Yoshua Bengio,et al.  Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach , 2011, ICML.

[60]  Moncef Gabbouj,et al.  Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks , 2017 .

[61]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[62]  Yuan Li,et al.  Bearing fault diagnosis with auto-encoder extreme learning machine: A comparative study , 2017 .

[63]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[64]  Yongbin Liu,et al.  Novel synthetic index-based adaptive stochastic resonance method and its application in bearing fault diagnosis , 2017 .

[65]  Jing Yuan,et al.  Multiwavelet transform and its applications in mechanical fault diagnosis – A review , 2014 .