Deep subclass reconstruction network for fault diagnosis of rotating machinery under various operating conditions

Abstract In the real world industrial application, all measured vibration signals are usually suffered from the substantial spurious factors and characterized as large intra-class and intra-subclass variations due to changes in the operating conditions (i.e., working loads, shaft speeds), which seriously deteriorates most of the machine learning methods’ ability to learn the discriminative feature representations. In this work, we propose a novel subclass reconstruction network (SCRN) to learn discriminative feature representations from raw vibration signals under different working conditions by suppressing the intra-class and intra-subclass variations in the feature space. Specifically, a novel and simple average strategy is developed to represent the cluster centroid of each subclass information as an effective supervised representation which is effectively embedded into the SCRN model. Furthermore, a new cost function of SCRN is formulated by jointly minimizing the basic and subclass-level reconstruction errors. To better exploit the discriminative information and improve classification performance, we further develop a deep subclass reconstruction network (DSCRN) model by stacking multiple SCRN models together through non-linear transformations for learning better deep feature representations. Extensive comparative evaluations on three benchmarks CWRU, 2009 PHM, and MFPT demonstrate that the proposed methods achieve consistently better diagnosis performance than existing state-of-the-art methods. Especially, when only 1% training samples from CWRU are used, the proposed DSCRN has significantly improvement with classification performance of 94.55% over compared method with an improvement of at least 9%.

[1]  N. F. F. Ebecken,et al.  On extending F-measure and G-mean metrics to multi-class problems , 2005, Data Mining VI.

[2]  Hongmei Liu,et al.  Rolling Bearing Fault Diagnosis Based on STFT-Deep Learning and Sound Signals , 2016 .

[3]  J. Rafiee,et al.  INTELLIGENT CONDITION MONITORING OF A GEARBOX USING ARTIFICIAL NEURAL NETWORK , 2007 .

[4]  Iman Nekooeimehr,et al.  Adaptive semi-unsupervised weighted oversampling (A-SUWO) for imbalanced datasets , 2016, Expert Syst. Appl..

[5]  Ming Zhao,et al.  A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox , 2017 .

[6]  Anil K. Jain Data clustering: 50 years beyond K-means , 2010, Pattern Recognit. Lett..

[7]  Kaplan Kaplan,et al.  An improved feature extraction method using texture analysis with LBP for bearing fault diagnosis , 2020, Appl. Soft Comput..

[8]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[9]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[10]  Xinyu Li,et al.  Ensemble deep contractive auto-encoders for intelligent fault diagnosis of machines under noisy environment , 2020, Knowl. Based Syst..

[11]  Guoliang Liu,et al.  Knowledge extraction and insertion to deep belief network for gearbox fault diagnosis , 2020, Knowl. Based Syst..

[12]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[13]  Gang Zhang,et al.  Nonlinear Model for Condition Monitoring and Fault Detection Based on Nonlocal Kernel Orthogonal Preserving Embedding , 2018 .

[14]  Myeongsu Kang,et al.  Multiple Wavelet Coefficients Fusion in Deep Residual Networks for Fault Diagnosis , 2019, IEEE Transactions on Industrial Electronics.

[15]  Pavle Boškoski,et al.  Fault detection of mechanical drives under variable operating conditions based on wavelet packet Rényi entropy signatures , 2012 .

[16]  Xuefeng Chen,et al.  Interpreting network knowledge with attention mechanism for bearing fault diagnosis , 2020, Appl. Soft Comput..

[17]  Yaguo Lei,et al.  Distribution-Invariant Deep Belief Network for Intelligent Fault Diagnosis of Machines Under New Working Conditions , 2021, IEEE Transactions on Industrial Electronics.

[18]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[19]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[20]  Haidong Shao,et al.  An enhancement deep feature fusion method for rotating machinery fault diagnosis , 2017, Knowl. Based Syst..

[21]  Xianmin Zhang,et al.  Deep multi-scale convolutional transfer learning network: A novel method for intelligent fault diagnosis of rolling bearings under variable working conditions and domains , 2020, Neurocomputing.

[22]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[23]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[24]  Deyong You,et al.  WPD-PCA-Based Laser Welding Process Monitoring and Defects Diagnosis by Using FNN and SVM , 2015, IEEE Transactions on Industrial Electronics.

[25]  Pierre Baldi,et al.  Autoencoders, Unsupervised Learning, and Deep Architectures , 2011, ICML Unsupervised and Transfer Learning.

[26]  Xin Li,et al.  Non-parallel least squares support matrix machine for rolling bearing fault diagnosis , 2020 .

[27]  Te Han,et al.  Deep transfer learning with limited data for machinery fault diagnosis , 2021, Appl. Soft Comput..

[28]  Pavle Boškoski,et al.  Bearing fault detection with application to PHM Data Challenge , 2011 .

[29]  Xinyu Li,et al.  Intelligent fault diagnosis of rotating machinery using a new ensemble deep auto-encoder method , 2020 .

[30]  Xianmin Zhang,et al.  Intelligent fault diagnosis of rolling bearings based on normalized CNN considering data imbalance and variable working conditions , 2020, Knowl. Based Syst..

[31]  Qiao Hu,et al.  Fault diagnosis of rotating machinery based on multiple ANFIS combination with GAs , 2007 .

[32]  Yaguo Lei,et al.  Applications of machine learning to machine fault diagnosis: A review and roadmap , 2020 .

[33]  Robert X. Gao,et al.  Probabilistic Transfer Factor Analysis for Machinery Autonomous Diagnosis Cross Various Operating Conditions , 2020, IEEE Transactions on Instrumentation and Measurement.

[34]  Mahmood Al-khassaweneh,et al.  Fault Diagnosis in Internal Combustion Engines Using Extension Neural Network , 2014, IEEE Transactions on Industrial Electronics.

[35]  Kuo-Ping Lin,et al.  A Novel Evolutionary Kernel Intuitionistic Fuzzy $C$ -means Clustering Algorithm , 2014, IEEE Transactions on Fuzzy Systems.

[36]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[37]  Paolo Pennacchi,et al.  Diagnostics of gear faults based on EMD and automatic selection of intrinsic mode functions , 2011 .

[38]  Meiying Qiao,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Rolling Bearing Fault Diagnosis Under Strong Noises and Variable Loads , 2020, IEEE Access.

[39]  Xiao-Sheng Si,et al.  A rotating machinery fault diagnosis method based on multi-scale dimensionless indicators and random forests , 2020, Mechanical Systems and Signal Processing.

[40]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[41]  Jipu Li,et al.  A Robust Weight-Shared Capsule Network for Intelligent Machinery Fault Diagnosis , 2020, IEEE Transactions on Industrial Informatics.

[42]  Jiafu Wan,et al.  Intelligent Fault Diagnosis of Rotor-Bearing System Under Varying Working Conditions With Modified Transfer Convolutional Neural Network and Thermal Images , 2020, IEEE Transactions on Industrial Informatics.

[43]  Robert B. Randall,et al.  Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study , 2015 .

[44]  Yang Yang,et al.  Fault diagnosis of rolling bearing of wind turbines based on the Variational Mode Decomposition and Deep Convolutional Neural Networks , 2020, Appl. Soft Comput..

[45]  Jianbo Yu,et al.  Local and Nonlocal Preserving Projection for Bearing Defect Classification and Performance Assessment , 2012, IEEE Transactions on Industrial Electronics.

[46]  Hadi Shahnazari,et al.  Fault diagnosis of nonlinear systems using recurrent neural networks , 2020 .

[47]  Myeongsu Kang,et al.  Deep Residual Networks With Dynamically Weighted Wavelet Coefficients for Fault Diagnosis of Planetary Gearboxes , 2018, IEEE Transactions on Industrial Electronics.

[48]  Dong Zhou,et al.  An integrated method based on CEEMD-SampEn and the correlation analysis algorithm for the fault diagnosis of a gearbox under different working conditions , 2017, Mechanical Systems and Signal Processing.

[49]  Siliang Lu,et al.  A New Methodology to Estimate the Rotating Phase of a BLDC Motor With Its Application in Variable-Speed Bearing Fault Diagnosis , 2018, IEEE Transactions on Power Electronics.

[50]  Guolin He,et al.  Semisupervised Distance-Preserving Self-Organizing Map for Machine-Defect Detection and Classification , 2013, IEEE Transactions on Instrumentation and Measurement.

[51]  Wei He,et al.  Generative Adversarial Networks With Comprehensive Wavelet Feature for Fault Diagnosis of Analog Circuits , 2020, IEEE Transactions on Instrumentation and Measurement.

[52]  Mengmeng Zhang,et al.  Medical Hyperspectral Image Classification Based on End-to-End Fusion Deep Neural Network , 2019, IEEE Transactions on Instrumentation and Measurement.

[53]  Lin Ma,et al.  Fault diagnosis of rolling element bearings using basis pursuit , 2005 .

[54]  Yu Zhou,et al.  Application of neural network algorithm in fault diagnosis of mechanical intelligence , 2020, Mechanical Systems and Signal Processing.

[55]  P. D. McFadden,et al.  APPLICATION OF SYNCHRONOUS AVERAGING TO VIBRATION MONITORING OF ROLLING ELEMENT BEARINGS , 2000 .

[56]  Konstantinos Gryllias,et al.  A deep learning method for bearing fault diagnosis based on Cyclic Spectral Coherence and Convolutional Neural Networks , 2020 .

[57]  Liang Chen,et al.  Knowledge mapping-based adversarial domain adaptation: A novel fault diagnosis method with high generalizability under variable working conditions , 2021 .

[58]  Wei Chen,et al.  Intelligent fault diagnosis of rotating machinery using support vector machine with ant colony algorithm for synchronous feature selection and parameter optimization , 2015, Neurocomputing.

[59]  Anders Krogh,et al.  A Simple Weight Decay Can Improve Generalization , 1991, NIPS.

[60]  Nicolò Bachschmid,et al.  Identification of multiple faults in rotor systems , 2002 .

[61]  Wenquan Feng,et al.  Knowledge distilling based model compression and feature learning in fault diagnosis , 2020, Appl. Soft Comput..

[62]  R. J. Kuo,et al.  A hybrid metaheuristic and kernel intuitionistic fuzzy c-means algorithm for cluster analysis , 2018, Appl. Soft Comput..

[63]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[65]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[66]  Wenliao Du,et al.  Wavelet leaders multifractal features based fault diagnosis of rotating mechanism , 2014 .

[67]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[68]  Minho Lee,et al.  Deep learning with support vector data description , 2015, Neurocomputing.

[69]  Weiwei Qian,et al.  Discriminative feature-based adaptive distribution alignment (DFADA) for rotating machine fault diagnosis under variable working conditions , 2020, Appl. Soft Comput..

[70]  Giansalvo Cirrincione,et al.  Bearing Fault Detection by a Novel Condition-Monitoring Scheme Based on Statistical-Time Features and Neural Networks , 2013, IEEE Transactions on Industrial Electronics.

[71]  Kai Wang,et al.  Multiscale Representations Fusion With Joint Multiple Reconstructions Autoencoder for Intelligent Fault Diagnosis , 2018, IEEE Signal Processing Letters.

[72]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[73]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[74]  Chuan Li,et al.  Fusing convolutional generative adversarial encoders for 3D printer fault detection with only normal condition signals , 2021 .

[75]  Jaskaran Singh,et al.  Multisensor data fusion for gearbox fault diagnosis using 2-D convolutional neural network and motor current signature analysis , 2020 .

[76]  Klaus-Robert Müller,et al.  Deep Boltzmann Machines and the Centering Trick , 2012, Neural Networks: Tricks of the Trade.

[77]  Xiang Li,et al.  Intelligent ball screw fault diagnosis using a deep domain adaptation methodology , 2020 .

[78]  Xiaoqi Wang,et al.  A novel method of combining nonlinear frequency spectrum and deep learning for complex system fault diagnosis , 2020 .

[79]  V. Miranda,et al.  Diagnosing Faults in Power Transformers With Autoassociative Neural Networks and Mean Shift , 2012, IEEE Transactions on Power Delivery.

[80]  Douglas A. Reynolds,et al.  Speaker Verification Using Adapted Gaussian Mixture Models , 2000, Digit. Signal Process..

[81]  Pascal Vincent,et al.  Contractive Auto-Encoders: Explicit Invariance During Feature Extraction , 2011, ICML.

[82]  Qi Jin,et al.  Imbalanced sample fault diagnosis of rotating machinery using conditional variational auto-encoder generative adversarial network , 2020, Appl. Soft Comput..

[83]  Peter I. Frazier,et al.  A Tutorial on Bayesian Optimization , 2018, ArXiv.

[84]  Yao Hu,et al.  New imbalanced bearing fault diagnosis method based on Sample-characteristic Oversampling TechniquE (SCOTE) and multi-class LS-SVM , 2020, Appl. Soft Comput..

[85]  Mohammed Bennamoun,et al.  Deep Reconstruction Models for Image Set Classification , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[86]  Yitao Liang,et al.  A novel bearing fault diagnosis model integrated permutation entropy, ensemble empirical mode decomposition and optimized SVM , 2015 .

[87]  Ke Zhao,et al.  An adaptive deep transfer learning method for bearing fault diagnosis , 2020 .

[88]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[89]  Robert B. Randall,et al.  Rolling element bearing fault diagnosis based on the combination of genetic algorithms and fast kurtogram , 2009 .

[90]  Ming Zhao,et al.  Residual joint adaptation adversarial network for intelligent transfer fault diagnosis , 2020 .

[91]  Yue Li,et al.  Learning Representations With Local and Global Geometries Preserved for Machine Fault Diagnosis , 2020, IEEE Transactions on Industrial Electronics.

[92]  Jun Yan,et al.  Multiscale Convolutional Neural Networks for Fault Diagnosis of Wind Turbine Gearbox , 2019, IEEE Transactions on Industrial Electronics.

[93]  I. Jolliffe Principal Component Analysis , 2005 .

[94]  Yi Shi,et al.  Neural Adaptive Control for MEMS Gyroscope With Full-State Constraints and Quantized Input , 2020, IEEE Transactions on Industrial Informatics.

[95]  Dong Yu,et al.  Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[96]  Zhiheng Li,et al.  A Deep Transfer Model With Wasserstein Distance Guided Multi-Adversarial Networks for Bearing Fault Diagnosis Under Different Working Conditions , 2019, IEEE Access.

[97]  Radoslaw Zimroz,et al.  Rolling bearing diagnosing method based on Empirical Mode Decomposition of machine vibration signal , 2014 .

[98]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[99]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[100]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[101]  Shaojiang Dong,et al.  Deep Residual Networks With Adaptively Parametric Rectifier Linear Units for Fault Diagnosis , 2021, IEEE Transactions on Industrial Electronics.

[102]  Thomas G. Habetler,et al.  An amplitude Modulation detector for fault diagnosis in rolling element bearings , 2004, IEEE Transactions on Industrial Electronics.

[103]  Wentao Mao,et al.  A new deep auto-encoder method with fusing discriminant information for bearing fault diagnosis , 2021 .

[104]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[105]  Peijun Du,et al.  Novel segmented stacked autoencoder for effective dimensionality reduction and feature extraction in hyperspectral imaging , 2016, Neurocomputing.

[106]  Xinyu Shao,et al.  Stacked pruning sparse denoising autoencoder based intelligent fault diagnosis of rolling bearings , 2020, Appl. Soft Comput..