Degradation feature extraction using multi-source monitoring data via logarithmic normal distribution based variational auto-encoder

Abstract Degeneration features extraction from multi-source monitoring data is significant for data-driven based state assessment and RUL prediction of complex equipment. However, the massive data gathered continuously from condition monitoring systems has created challenges to extract degradation features effectively, and meanwhile the current existing feature extraction methods such as PCA pays more attention to the integrity of the extracted information, but ignores the priori information. In this paper, we developed logarithmic normal distribution based variational auto-encoder algorithms which can ensure that the final feature extraction results follow the lognormal prior hypothesis to address above problems. The main procedure of the developed method is as follows. First, create the multi-source information dataset consist of different monitoring indicators, and normalize the dataset. Then, the KL divergence regularization is deduced based on the principle of variational Bayes inference. Next, the three-layer variational auto-encoder network model is constructed, and normalized datasets is used to train and test the model. The experiment results demonstrate that the degradation trajectory obtained using the proposed method offers stronger predictive capabilities than do those obtained using original methods, thereby improving the accuracy of predictions of the equipment remaining useful life.

[1]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[2]  Biao Wang,et al.  LiftingNet: A Novel Deep Learning Network With Layerwise Feature Learning From Noisy Mechanical Data for Fault Classification , 2018, IEEE Transactions on Industrial Electronics.

[3]  Jonathan S. Litt,et al.  User's Guide for the Commercial Modular Aero-Propulsion System Simulation (C-MAPSS): Version 2 , 2012 .

[4]  Yupu Yang,et al.  Gaussian feature learning based on variational autoencoder for improving nonlinear process monitoring , 2019, Journal of Process Control.

[5]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[6]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[7]  Houxiang Zhang,et al.  Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture , 2019, Reliab. Eng. Syst. Saf..

[8]  Bo-Suk Yang,et al.  Application of nonlinear feature extraction and support vector machines for fault diagnosis of induction motors , 2007, Expert Syst. Appl..

[9]  Jian Sun,et al.  A novel method based upon modified composite spectrum and relative entropy for degradation feature extraction of hydraulic pump , 2019 .

[10]  Haidong Shao,et al.  Rolling bearing fault diagnosis using adaptive deep belief network with dual-tree complex wavelet packet. , 2017, ISA transactions.

[11]  Yanyang Zi,et al.  An unsupervised feature extraction method for nonlinear deterioration process of complex equipment under multi dimensional no-label signals , 2018 .

[12]  Qi Zhang,et al.  Degradation data-driven approach for remaining useful life estimation , 2013 .

[13]  Te Han,et al.  Intelligent fault diagnosis method for rotating machinery via dictionary learning and sparse representation-based classification , 2018 .

[14]  Bin Dai,et al.  Recurrent Variational Autoencoders for Learning Nonlinear Generative Models in the Presence of Outliers , 2018, IEEE Journal of Selected Topics in Signal Processing.

[15]  Haidong Shao,et al.  A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders , 2018 .

[16]  Yanyang Zi,et al.  A GKPCA-NHSMM based methodology for accurate RUL prognostics of nonlinear mechanical system with multistate deterioration , 2016, 2016 Prognostics and System Health Management Conference (PHM-Chengdu).

[17]  Qiao Hu,et al.  Fault diagnosis of rotating machinery based on multiple ANFIS combination with GAs , 2007 .

[18]  Yaguo Lei,et al.  Intelligent Fault Diagnosis and Remaining Useful Life Prediction of Rotating Machinery , 2016 .

[19]  LinLin Shen,et al.  Improving variational autoencoder with deep feature consistent and generative adversarial training , 2019, Neurocomputing.

[20]  Abhinav Saxena,et al.  Damage propagation modeling for aircraft engine run-to-failure simulation , 2008, 2008 International Conference on Prognostics and Health Management.

[21]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[22]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[23]  David He,et al.  Hidden semi-Markov model-based methodology for multi-sensor equipment health diagnosis and prognosis , 2007, Eur. J. Oper. Res..

[24]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[25]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[26]  Yaguo Lei,et al.  Degradation data analysis and remaining useful life estimation: A review on Wiener-process-based methods , 2018, Eur. J. Oper. Res..

[27]  Jing Li,et al.  An enhancement denoising autoencoder for rolling bearing fault diagnosis , 2018, Measurement.

[28]  Jun Wang,et al.  An automatic and robust features learning method for rotating machinery fault diagnosis based on contractive autoencoder , 2018, Eng. Appl. Artif. Intell..

[29]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[30]  Yaguo Lei,et al.  A Model-Based Method for Remaining Useful Life Prediction of Machinery , 2016, IEEE Transactions on Reliability.

[31]  Yuanhui Xiao,et al.  A fast algorithm for two-dimensional Kolmogorov-Smirnov two sample tests , 2017, Comput. Stat. Data Anal..

[32]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.