A Robust Weight-Shared Capsule Network for Intelligent Machinery Fault Diagnosis

In practical industrial applications, the working conditions of machinery are changing with long-term operation, and the health status is declining with the degradation of crucial components. When the working condition changes, prior diagnosis models cannot be generalized from one condition to another. To solve this challenging issue, in this article a robust weight-shared capsule network (WSCN) is introduced for intelligent fault diagnosis of machinery under varying working conditions. First, taking raw accelerometer signals as inputs, one-dimensional convolutional neural network is constructed to extract discriminative characteristics. Second, various capsule layers based on multistacked weight-shared capsules are developed to enhance the generalization performance for further fault classification. Finally, margin loss function as well as agreement-based dynamic routing algorithm are employed to optimize the WSCN. In this article, two diagnosis cases are carried out to demonstrate the generalization performance of the WSCN which obtains higher accuracy under varying working conditions than that of other state-of-the-art methods.

[1]  Bo Zhang,et al.  Intelligent Fault Diagnosis Under Varying Working Conditions Based on Domain Adaptive Convolutional Neural Networks , 2018, IEEE Access.

[2]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[3]  Zhibin Zhao,et al.  Deep Transfer Learning Based on Sparse Autoencoder for Remaining Useful Life Prediction of Tool in Manufacturing , 2019, IEEE Transactions on Industrial Informatics.

[4]  Robert X. Gao,et al.  Machine health monitoring based on locally linear embedding with kernel sparse representation for neighborhood optimization , 2019, Mechanical Systems and Signal Processing.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Lingli Cui,et al.  A three-dimensional geometric features-based SCA algorithm for compound faults diagnosis , 2019, Measurement.

[7]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[8]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[9]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[10]  Fulei Chu,et al.  HVSRMS localization formula and localization law: Localization diagnosis of a ball bearing outer ring fault , 2019, Mechanical Systems and Signal Processing.

[11]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[12]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[13]  Chuang Sun,et al.  Discriminative Deep Belief Networks with Ant Colony Optimization for Health Status Assessment of Machine , 2017, IEEE Transactions on Instrumentation and Measurement.

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Bin Zhang,et al.  Liquid level detection in porcelain bushing type terminals using piezoelectric transducers based on auto-encoder networks , 2019, Measurement.

[16]  Diego Cabrera,et al.  Deep Hybrid State Network With Feature Reinforcement for Intelligent Fault Diagnosis of Delta 3-D Printers , 2020, IEEE Transactions on Industrial Informatics.

[17]  Bin Yang,et al.  An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings , 2019, Mechanical Systems and Signal Processing.

[18]  Ran Zhang,et al.  Transfer Learning With Neural Networks for Bearing Fault Diagnosis in Changing Working Conditions , 2017, IEEE Access.

[19]  Zhibin Zhao,et al.  Sparse Deep Stacking Network for Fault Diagnosis of Motor , 2018, IEEE Transactions on Industrial Informatics.

[20]  Guolin He,et al.  Non-stationary vibration feature extraction method based on sparse decomposition and order tracking for gearbox fault diagnosis , 2018 .

[21]  Jong-Myon Kim,et al.  Acoustic spectral imaging and transfer learning for reliable bearing fault diagnosis under variable speed conditions , 2019, Measurement.

[22]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[23]  Weihua Li,et al.  Deep Learning With Emerging New Labels for Fault Diagnosis , 2019, IEEE Access.

[24]  Yan Xu,et al.  A Digital-Twin-Assisted Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Access.

[25]  Qingmin Liao,et al.  Margin Loss: Making Faces More Separable , 2018, IEEE Signal Processing Letters.

[26]  Konstantinos Gryllias,et al.  Intelligent Fault Diagnosis for Rotary Machinery Using Transferable Convolutional Neural Network , 2020, IEEE Transactions on Industrial Informatics.

[27]  Bin Zhang,et al.  Bearing performance degradation assessment using long short-term memory recurrent network , 2019, Comput. Ind..

[28]  Xuefeng Chen,et al.  Dislocated Time Series Convolutional Neural Architecture: An Intelligent Fault Diagnosis Approach for Electric Machine , 2017, IEEE Transactions on Industrial Informatics.

[29]  Lingli Cui,et al.  Quantitative and Localization Diagnosis of a Defective Ball Bearing Based on Vertical–Horizontal Synchronization Signal Analysis , 2017, IEEE Transactions on Industrial Electronics.

[30]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[31]  Chuang Sun,et al.  Deep Coupling Autoencoder for Fault Diagnosis With Multimodal Sensory Data , 2018, IEEE Transactions on Industrial Informatics.

[32]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[33]  Guolin He,et al.  Double-dictionary signal decomposition method based on split augmented Lagrangian shrinkage algorithm and its application in gearbox hybrid faults diagnosis , 2018, Journal of Sound and Vibration.

[34]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[35]  Ruyi Huang,et al.  Deep Decoupling Convolutional Neural Network for Intelligent Compound Fault Diagnosis , 2019, IEEE Access.

[36]  Jianyu Long,et al.  Deep Fuzzy Echo State Networks for Machinery Fault Diagnosis , 2020, IEEE Transactions on Fuzzy Systems.

[37]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .

[38]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[39]  Haidong Shao,et al.  Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing , 2018 .

[40]  Huijun Gao,et al.  A convolutional neural network based on a capsule network with strong generalization for bearing fault diagnosis , 2019, Neurocomputing.

[41]  Huaqing Wang,et al.  A Novel Feature Enhancement Method Based on Improved Constraint Model of Online Dictionary Learning , 2019, IEEE Access.

[42]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[43]  Huibin Lin,et al.  Fault feature extraction of rolling element bearings using sparse representation , 2016 .

[44]  Weihua Li,et al.  Feature Denoising and Nearest–Farthest Distance Preserving Projection for Machine Fault Diagnosis , 2016, IEEE Transactions on Industrial Informatics.

[45]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .