Transfer learning with convolutional neural networks for small sample size problem in machinery fault diagnosis

Data-driven machinery fault diagnosis has gained much attention from academic research and industry to guarantee the machinery reliability. Traditional fault diagnosis frameworks are commonly under a default assumption: the training and test samples share the similar distribution. However, it is nearly impossible in real industrial applications, where the operating condition always changes over time and the quantity of the same-distribution samples is often not sufficient to build a qualified diagnostic model. Therefore, transfer learning, which possesses the capacity to leverage the knowledge learnt from the massive source data to establish a diagnosis model for the similar but small target data, has shown potential value in machine fault diagnosis with small sample size. In this paper, we propose a novel fault diagnosis framework for the small amount of target data based on transfer learning, using a modified TrAdaBoost algorithm and convolutional neural networks. First, the massive source data with different distributions is added to the target data as the training data. Then, a convolutional neural network is selected as the base learner and the modified TrAdaBoost algorithm is employed for the weight update of each training sample to form a stronger diagnostic model. The whole proposition is experimentally demonstrated and discussed by carrying out the tests of six three-phase induction motors under different operating conditions and fault types. Results show that compared with other methods, the proposed framework can achieve the highest fault diagnostic accuracy with inadequate target data.

[1]  Ruqiang Yan,et al.  Wind turbine condition monitoring and fault diagnosis in China , 2016, IEEE Instrumentation & Measurement Magazine.

[2]  Arezki Menacer,et al.  Fast Fourier and discrete wavelet transforms applied to sensorless vector control induction motor for rotor bar faults diagnosis. , 2014, ISA transactions.

[3]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[4]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[6]  Chao Liu,et al.  Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application , 2018, ISA transactions.

[7]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Liang Guo,et al.  Machinery health indicator construction based on convolutional neural networks considering trend burr , 2018, Neurocomputing.

[10]  Saeid Nahavandi,et al.  A sequential search-space shrinking using CNN transfer learning and a Radon projection pool for medical image retrieval , 2018, Expert Syst. Appl..

[11]  Yu Zhang,et al.  Learning to Transfer , 2017, ArXiv.

[12]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[14]  Xiaodong Li,et al.  Extreme learning machine based transfer learning for data classification , 2016, Neurocomputing.

[15]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[16]  Myeongsu Kang,et al.  Deep Residual Networks With Dynamically Weighted Wavelet Coefficients for Fault Diagnosis of Planetary Gearboxes , 2018, IEEE Transactions on Industrial Electronics.

[17]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[18]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[19]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[20]  Hee-Jun Kang,et al.  Two-stage feature selection for bearing fault diagnosis based on dual-tree complex wavelet transform and empirical mode decomposition , 2016 .

[21]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[22]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part II: Fault Diagnosis With Knowledge-Based and Hybrid/Active Approaches , 2015, IEEE Transactions on Industrial Electronics.

[23]  Jim Austin,et al.  Learning criteria for training neural network classifiers , 2005, Neural Computing & Applications.

[24]  Ivor W. Tsang,et al.  Heterogeneous Domain Adaptation for Multiple Classes , 2014, AISTATS.

[25]  Chao Zhang,et al.  A gearbox fault diagnosis method based on frequency-modulated empirical mode decomposition and support vector machine , 2018 .

[26]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[27]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[28]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[29]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[30]  Xuefeng Chen,et al.  Dislocated Time Series Convolutional Neural Architecture: An Intelligent Fault Diagnosis Approach for Electric Machine , 2017, IEEE Transactions on Industrial Informatics.

[31]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part I: Fault Diagnosis With Model-Based and Signal-Based Approaches , 2015, IEEE Transactions on Industrial Electronics.

[32]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[33]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[34]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[35]  Huijun Gao,et al.  Data-Based Techniques Focused on Modern Industry: An Overview , 2015, IEEE Transactions on Industrial Electronics.

[36]  Wenbo Lu,et al.  Application of a near-field acoustic holography-based diagnosis technique in gearbox fault diagnosis , 2013 .

[37]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .