Deep learning for fault-relevant feature extraction and fault classification with stacked supervised auto-encoder

Abstract Stacked auto-encoder (SAE)-based deep learning has been introduced for fault classification in recent years, which has the potential to extract deep abstract features from the raw input data. However, SAE cannot ensure the relevance of deep features with the fault types due to its unsupervised self-reconstruction in the pretraining stage. To overcome this problem, a stacked supervised auto-encoder is proposed to pretrain the deep network and obtain deep fault-relevant features from raw input data. In each supervised auto-encoder, informative features are learned from the input data with the goal that they can largely distinguish different fault types. By stacking multiple supervised auto-encoders hierarchically, high-level fault-relevant features are gradually learned from raw input data, which can improve the classification accuracy of the classifiers. The proposed SSAE is tested on the Tennessee–Eastman (TE) benchmark process and a real industrial hydrocracking process. The results show the effectiveness and flexibility of SSAE.

[1]  Biao Huang,et al.  Deep Learning-Based Feature Representation and Its Application for Soft Sensor Modeling With Variable-Wise Weighted SAE , 2018, IEEE Transactions on Industrial Informatics.

[2]  Zhiqiang Ge,et al.  Quality variable prediction for chemical processes based on semisupervised Dirichlet process mixture of Gaussians , 2019, Chemical Engineering Science.

[3]  Sohag Kabir,et al.  A fuzzy Bayesian network approach for risk analysis in process industries , 2017 .

[4]  Weihua Gui,et al.  Temperature prediction for roller kiln based on hybrid first-principle model and data-driven MW-DLWKPCR model. , 2020, ISA transactions.

[5]  Xiaofeng Yuan,et al.  A two‐layer ensemble learning framework for data‐driven soft sensor of the diesel attributes in an industrial hydrocracking process , 2019, Journal of Chemometrics.

[6]  Zhiqiang Ge,et al.  Semi-supervised fault classification based on dynamic Sparse Stacked auto-encoders model , 2017 .

[7]  Yan Xue-feng,et al.  Hybrid artificial neural network based on BP-PLSR and its application in development of soft sensors , 2010 .

[8]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[9]  Xiaofeng Yuan,et al.  A spatial-temporal LWPLS for adaptive soft sensor modeling and its application for an industrial hydrocracking process , 2020 .

[10]  James Brusey,et al.  A dynamic linear model for heteroscedastic LDA under class imbalance , 2019, Neurocomputing.

[11]  Zhiqiang Ge,et al.  Semisupervised JITL Framework for Nonlinear Industrial Soft Sensing Based on Locally Semisupervised Weighted PCR , 2017, IEEE Transactions on Industrial Informatics.

[12]  Yue Cao,et al.  An improved Bayesian network method for fault diagnosis , 2018 .

[13]  Steven X. Ding,et al.  Fault Detection for Non-Gaussian Processes Using Generalized Canonical Correlation Analysis and Randomized Algorithms , 2018, IEEE Transactions on Industrial Electronics.

[14]  Dexian Huang,et al.  Data-driven soft sensor development based on deep learning technique , 2014 .

[15]  Hao Wu,et al.  Deep convolutional neural network model based chemical process fault diagnosis , 2018, Comput. Chem. Eng..

[16]  Zhiqiang Ge,et al.  Review on data-driven modeling and monitoring for plant-wide industrial processes , 2017 .

[17]  Lu Weining,et al.  Fault diagnosis method study in roller bearing based on wavelet transform and stacked auto-encoder , 2015, The 27th Chinese Control and Decision Conference (2015 CCDC).

[18]  Zhiqiang Ge,et al.  Deep Learning of Semisupervised Process Data With Hierarchical Extreme Learning Machine and Soft Sensor Application , 2018, IEEE Transactions on Industrial Electronics.

[19]  Yupu Yang,et al.  Automated feature learning for nonlinear process monitoring – An approach using stacked denoising autoencoder and k-nearest neighbor rule , 2018 .

[20]  Xiaofeng Yuan,et al.  Deep Learning With Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development , 2020, IEEE Transactions on Industrial Electronics.

[21]  Yalin Wang,et al.  Stacked Enhanced Auto-Encoder for Data-Driven Soft Sensing of Quality Variable , 2020, IEEE Transactions on Instrumentation and Measurement.

[22]  R. K. Bisarya,et al.  The Bhopal gas tragedy—A perspective , 2005 .

[23]  Jie Yu,et al.  Localized Fisher discriminant analysis based complex chemical process monitoring , 2011 .

[24]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[25]  Weihua Gui,et al.  Deep quality-related feature extraction for soft sensing modeling: A deep learning approach with hybrid VW-SAE , 2020, Neurocomputing.

[26]  Zhiqiang Ge,et al.  Ensemble semi-supervised Fisher discriminant analysis model for fault classification in industrial processes. , 2019, ISA transactions.

[27]  Chenglin Wen,et al.  Fault diagnosis based on deep learning , 2016, 2016 American Control Conference (ACC).

[28]  Chen Jing,et al.  SVM and PCA based fault classification approaches for complicated industrial process , 2015, Neurocomputing.

[29]  Zhi-Huan Song,et al.  A novel fault diagnosis system using pattern classification on kernel FDA subspace , 2011, Expert Syst. Appl..

[30]  Lei Liu,et al.  Dynamic Soft Sensor Development Based on Convolutional Neural Networks , 2019, Industrial & Engineering Chemistry Research.

[31]  Tao Zhang,et al.  Bearing fault diagnosis method based on stacked autoencoder and softmax regression , 2015, 2015 34th Chinese Control Conference (CCC).

[32]  Yongfang Xie,et al.  A semi-supervised Laplacian extreme learning machine and feature fusion with CNN for industrial superheat identification , 2020, Neurocomputing.

[33]  Xiaofeng Yuan,et al.  LDA-based deep transfer learning for fault diagnosis in industrial chemical processes , 2020, Comput. Chem. Eng..

[34]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[35]  Zhiqiang Ge,et al.  A Probabilistic Just-in-Time Learning Framework for Soft Sensor Development With Missing Data , 2017, IEEE Transactions on Control Systems Technology.

[36]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[37]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[38]  Zhiqiang Ge,et al.  Process Data Analytics via Probabilistic Latent Variable Models: A Tutorial Review , 2018, Industrial & Engineering Chemistry Research.

[39]  Yang Wang,et al.  Data-Driven Distributed Local Fault Detection for Large-Scale Processes Based on the GA-Regularized Canonical Correlation Analysis , 2017, IEEE Transactions on Industrial Electronics.

[40]  Weihua Gui,et al.  Deep learning for quality prediction of nonlinear dynamic processes with variable attention‐based long short‐term memory network , 2020 .

[41]  Ning Chen,et al.  Temperature Prediction Model for Roller Kiln by ALD-Based Double Locally Weighted Kernel Principal Component Regression , 2018, IEEE Transactions on Instrumentation and Measurement.

[42]  Manabu Kano,et al.  Data-based process monitoring, process control, and quality improvement: Recent developments and applications in steel industry , 2008, Comput. Chem. Eng..

[43]  Le Yao,et al.  Nonlinear probabilistic latent variable regression models for soft sensor application: From shallow to deep structure , 2020 .

[44]  Weihua Gui,et al.  A Layer-Wise Data Augmentation Strategy for Deep Learning Networks and Its Soft Sensor Application in an Industrial Hydrocracking Process , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Weihua Gui,et al.  A Deep Supervised Learning Framework for Data-Driven Soft Sensor Modeling of Industrial Processes , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[46]  Lin Li,et al.  Nonlinear Dynamic Soft Sensor Modeling With Supervised Long Short-Term Memory Network , 2020, IEEE Transactions on Industrial Informatics.

[47]  Weihua Gui,et al.  A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network. , 2019, ISA transactions.

[48]  Biao Huang,et al.  Hierarchical Quality-Relevant Feature Representation for Soft Sensor Modeling: A Novel Deep Learning Strategy , 2020, IEEE Transactions on Industrial Informatics.

[49]  Weihua Gui,et al.  A novel semi-supervised pre-training strategy for deep networks and its application for quality variable prediction in industrial processes , 2020 .

[50]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[51]  Biao Huang,et al.  Performance-Driven Distributed PCA Process Monitoring Based on Fault-Relevant Variable Selection and Bayesian Inference , 2016, IEEE Transactions on Industrial Electronics.

[52]  Zhiqiang Ge,et al.  Multimode Process Monitoring Based on Switching Autoregressive Dynamic Latent Variable Model , 2018, IEEE Transactions on Industrial Electronics.

[53]  Weihua Gui,et al.  Soft sensor model for dynamic processes based on multichannel convolutional neural network , 2020 .

[54]  Zhiqiang Ge,et al.  Weighted Linear Dynamic System for Feature Representation and Soft Sensor Application in Nonlinear Dynamic Industrial Processes , 2018, IEEE Transactions on Industrial Electronics.