Ensemble deep contractive auto-encoders for intelligent fault diagnosis of machines under noisy environment

Abstract Intelligent fault diagnosis methods based on deep auto-encoder have achieved great success in the past several years. However, these methods cannot effectively handle the data collected under noisy environment. Therefore, this paper proposes a new ensemble deep contractive auto-encoder (EDCAE) to address the problem. First, we design fifteen deep contractive auto-encoders (DCAE) to learn invariant feature representation automatically. Due to the Jacobian penalty term in DCAE and different characteristics, these models can deal with various noisy data effectively. Second, fisher discriminant analysis is applied to select low-dimensional features with the maximum class separability. Softmax classifier is adopted to identify the selected features and produce fifteen classification results. Finally, a new combination strategy is developed to combine these individual results. Benefitting from the combination strategy, it can produce accurate diagnosis results even under strong background noise. Additionally, to prove the effectiveness of EDCAE, theory analysis about error bound is conducted. The proposed method is verified on three case studies including bearing, gear box and self-priming centrifugal pump. Experiments are conducted under seven different signal-to-noise-ratios. Results show that EDCAE is better than other intelligent diagnosis methods, including individual DCAE, deep auto-encoder, sparse deep auto-encoder, deep denoising auto-encoder and several ensemble methods.

[1]  Nishchal K. Verma,et al.  Generating feature sets for fault diagnosis using denoising stacked auto-encoder , 2016, 2016 IEEE International Conference on Prognostics and Health Management (ICPHM).

[2]  Liang Gao,et al.  A new subset based deep feature learning method for intelligent fault diagnosis of bearing , 2018, Expert Syst. Appl..

[3]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[4]  Chong Wang,et al.  Simultaneous image classification and annotation , 2009, CVPR.

[5]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[6]  Haidong Shao,et al.  A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders , 2018 .

[7]  Nhat-Duc Hoang,et al.  Predicting earthquake-induced soil liquefaction based on a hybridization of kernel Fisher discriminant analysis and a least squares support vector machine: a multi-dataset study , 2018, Bulletin of Engineering Geology and the Environment.

[8]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[9]  Chao Liu,et al.  Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application , 2018, ISA transactions.

[10]  Chao Liu,et al.  Learning transferable features in deep convolutional neural networks for diagnosing unseen machine conditions. , 2019, ISA transactions.

[11]  Charu C. Aggarwal,et al.  Outlier Detection with Autoencoder Ensembles , 2017, SDM.

[12]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[13]  Lihui Wang,et al.  Imbalanced data fault diagnosis of rotating machinery using synthetic oversampling and feature learning , 2018, Journal of Manufacturing Systems.

[14]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[15]  Lei Wang,et al.  Comparison of random forest, artificial neural networks and support vector machine for intelligent diagnosis of rotating machinery , 2018, Trans. Inst. Meas. Control.

[16]  Chen Lu,et al.  Fault Diagnosis for Rotating Machinery: A Method based on Image Processing , 2016, PloS one.

[17]  Jane You,et al.  HSAE: A Hessian regularized sparse auto-encoders , 2016, Neurocomputing.

[18]  Xinyu Li,et al.  A multiobjective evolutionary algorithm based on decomposition for hybrid flowshop green scheduling problem , 2019, Comput. Ind. Eng..

[19]  Changqing Shen,et al.  Stacked Sparse Autoencoder-Based Deep Network for Fault Diagnosis of Rotating Machinery , 2017, IEEE Access.

[20]  Pascal Vincent,et al.  Higher Order Contractive Auto-Encoder , 2011, ECML/PKDD.

[21]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[22]  Liang Guo,et al.  A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines , 2018, Neurocomputing.

[23]  Pascal Vincent,et al.  Contractive Auto-Encoders: Explicit Invariance During Feature Extraction , 2011, ICML.

[24]  Yuval Elovici,et al.  Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detection , 2018, NDSS.

[25]  Seong-Whan Lee,et al.  Latent feature representation with stacked auto-encoder for AD/MCI diagnosis , 2013, Brain Structure and Function.

[26]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[27]  Xinyu Li,et al.  A Three-Stage Multiobjective Approach Based on Decomposition for an Energy-Efficient Hybrid Flow Shop Scheduling Problem , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  K. Loparo,et al.  Bearing fault diagnosis based on wavelet transform and fuzzy inference , 2004 .

[29]  Yu Tsao,et al.  Ensemble modeling of denoising autoencoder for speech spectrum restoration , 2014, INTERSPEECH.

[30]  Liang Gao,et al.  A Novel Data-Driven Fault Diagnosis Method Based on Deep Learning , 2017, DMBD.

[31]  Teng Gong,et al.  A novel intelligent method for mechanical fault diagnosis based on dual-tree complex wavelet packet transform and multiple classifier fusion , 2016, Neurocomputing.

[32]  Haidong Shao,et al.  An enhancement deep feature fusion method for rotating machinery fault diagnosis , 2017, Knowl. Based Syst..