Knowledge extraction and insertion to deep belief network for gearbox fault diagnosis

Abstract Deep neural network (DNN) with a complex structure and multiple nonlinear processing units has achieved great success for feature learning in machinery fault diagnosis. Due to the “black box” problem in DNNs, there are still many obstacles to the application of DNNs in fault diagnosis. This paper proposes a new DNN model, knowledge-based deep belief network (KBDBN), which inserts confidence and classification rules into the deep network structure. This not only enables the model to have good pattern recognition performance but also to adaptively determine the network structure and obtain a good understanding of the features learned by the deep network. The knowledge extraction algorithm is proposed to offer a good representation of layerwise networks (i.e., restricted Boltzmann machines (RBMs)). The layerwise extraction can produce an improvement in feature learning of RBMs. Moreover, the extracted confidence rules that characterize the deep network offers a novel method for insertion of prior knowledge in the deep RBM. The classification knowledge extracted from the data is further inserted into the classification layer of DBN. KBDBN is used to generate the discriminant features from the data and then construct a complex mapping between vibration signals and gearbox defects. The testing results of KBDBN on a gearbox test rig not only effectively extracts knowledge from the deep network, but also shows better classification performance than the typical classifiers and DBNs. Moreover, the interpretable network model helps us understand what DBN has learned from vibration signals and then makes it be applied easily in real-world cases.

[1]  Xiaojun Zhou,et al.  Intelligent monitoring and diagnosis of manufacturing processes using an integrated approach of KBANN and GA , 2008, Comput. Ind..

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Simon J. Doran,et al.  Stacked Autoencoders for Unsupervised Feature Learning and Multiple Organ Detection in a Pilot Study Using 4D Patient Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ming Zhao,et al.  A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox , 2017 .

[5]  Feixiang Zhao,et al.  EnLSTM-WPEO: Short-Term Traffic Flow Prediction by Ensemble LSTM, NNCT Weight Integration, and Population Extremal Optimization , 2020, IEEE Transactions on Vehicular Technology.

[6]  Jude W. Shavlik,et al.  Knowledge-Based Artificial Neural Networks , 1994, Artif. Intell..

[7]  Chuang Sun,et al.  Deep Coupling Autoencoder for Fault Diagnosis With Multimodal Sensory Data , 2018, IEEE Transactions on Industrial Informatics.

[8]  Tshilidzi Marwala,et al.  EARLY CLASSIFICATIONS OF BEARING FAULTS USING HIDDEN MARKOV MODELS, GAUSSIAN MIXTURE MODELS, MEL-FREQUENCY CEPSTRAL COEFFICIENTS AND FRACTALS , 2006 .

[9]  Jian Weng,et al.  Adaptive population extremal optimization-based PID neural network for multivariable nonlinear control systems , 2019, Swarm Evol. Comput..

[10]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .

[11]  Luc De Raedt,et al.  Neural-Symbolic Learning and Reasoning: Contributions and Challenges , 2015, AAAI Spring Symposia.

[12]  Qingbo He Vibration signal classification by wavelet packet energy flow manifold learning , 2013 .

[13]  Artur S. d'Avila Garcez,et al.  A Neural-Symbolic Cognitive Agent for Online Learning and Reasoning , 2011, IJCAI.

[14]  Haidong Shao,et al.  Rolling bearing fault detection using continuous deep belief network with locally linear embedding , 2018, Comput. Ind..

[15]  Gadi Pinkas,et al.  Reasoning, Nonmonotonicity and Learning in Connectionist Networks that Capture Propositional Knowledge , 1995, Artif. Intell..

[16]  Shu Zhan,et al.  Face detection using representation learning , 2016, Neurocomputing.

[17]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[18]  Haibo He,et al.  Stacked Multilevel-Denoising Autoencoders: A New Representation Learning Approach for Wind Turbine Gearbox Fault Diagnosis , 2017, IEEE Transactions on Instrumentation and Measurement.

[19]  Haidong Shao,et al.  Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing , 2018 .

[20]  Bin Jiang,et al.  Deep forest based multivariate classification for diagnostic health monitoring , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[21]  Wuneng Zhou,et al.  Constrained population extremal optimization-based robust load frequency control of multi-area interconnected power system , 2019, International Journal of Electrical Power & Energy Systems.

[22]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[23]  Yang Wang,et al.  Unsupervised local deep feature for image recognition , 2016, Inf. Sci..

[24]  Son N. Tran,et al.  Deep Logic Networks: Inserting and Extracting Knowledge From Deep Belief Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Stefan Boettcher,et al.  Optimization with Extremal Dynamics , 2000, Complex..

[26]  Diego Cabrera,et al.  Fault Diagnosis for Rotating Machinery Using Vibration Measurement Deep Statistical Feature Learning , 2016, Sensors.

[27]  Jianbo Yu,et al.  Bearing performance degradation assessment using locality preserving projections and Gaussian mixture models , 2011 .

[28]  Yoichi Hayashi,et al.  Greedy rule generation from discrete data and its use in neural network rule extraction , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[29]  Young-Joon Lee,et al.  Heath monitoring of a glass transfer robot in the mass production line of liquid crystal display using abnormal operating sounds based on wavelet packet transform and artificial neural network , 2012 .

[30]  Fernando Santos Osório,et al.  INSS: A hybrid system for constructive machine learning , 1999, Neurocomputing.

[31]  Dharminder Kumar,et al.  Mining Comprehensible and Interesting Rules: A Genetic Algorithm Approach , 2011 .

[32]  Jianbo Yu,et al.  Machinery fault diagnosis using joint global and local/nonlocal discriminant analysis with selective ensemble learning , 2016 .

[33]  Shen Li,et al.  Generalize Symbolic Knowledge With Neural Rule Engine , 2018, ArXiv.

[34]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[35]  Zhiqiang Chen,et al.  Deep neural networks-based rolling bearing fault diagnosis , 2017, Microelectron. Reliab..

[36]  Robert X. Gao,et al.  PCA-based feature selection scheme for machine defect classification , 2004, IEEE Transactions on Instrumentation and Measurement.

[37]  Paulo J. G. Lisboa,et al.  Orthogonal search-based rule extraction (OSRE) for trained neural networks: a practical and efficient approach , 2006, IEEE Transactions on Neural Networks.

[38]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[39]  Chengjiang Li,et al.  Signal fusion-based deep fast random forest method for machine health assessment , 2018 .

[40]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[41]  Qiao Hu,et al.  Fault diagnosis of rotating machinery based on improved wavelet package transform and SVMs ensemble , 2007 .

[42]  Zhi Gao Luo,et al.  Fault classification of rolling bearing based on reconstructed phase space and Gaussian mixture model , 2009 .

[43]  Jun Yan,et al.  Multiscale Convolutional Neural Networks for Fault Diagnosis of Wind Turbine Gearbox , 2019, IEEE Transactions on Industrial Electronics.

[44]  B. Samanta,et al.  Gear fault detection using artificial neural networks and support vector machines with genetic algorithms , 2004 .

[45]  Pingfeng Wang,et al.  Failure diagnosis using deep belief learning based health state classification , 2013, Reliab. Eng. Syst. Saf..

[46]  Florian Metze,et al.  Extracting deep bottleneck features using stacked auto-encoders , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[47]  Jing Lin,et al.  A multivariate encoder information based convolutional neural network for intelligent fault diagnosis of planetary gearboxes , 2018, Knowl. Based Syst..

[48]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[49]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[50]  Cong Wang,et al.  Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings , 2016 .

[51]  Haidong Shao,et al.  Electric Locomotive Bearing Fault Diagnosis Using a Novel Convolutional Deep Belief Network , 2018, IEEE Transactions on Industrial Electronics.