Deep quality-related feature extraction for soft sensing modeling: A deep learning approach with hybrid VW-SAE

Abstract Soft sensors have been extensively used to predict difficult-to-measure quality variables for effective modeling, control and optimization of industrial processes. To construct accurate soft sensors, it is significant to carry out feature extraction for massive high-dimensional process data. Recently, deep learning has been introduced for feature representation in process data modeling. However, most of them cannot capture deep quality-related features for output prediction. In this paper, a hybrid variable-wise weighted stacked autoencoder (HVW-SAE) is developed to learn quality-related features for soft sensor modeling. By measuring the linear Pearson and nonlinear Spearman correlations for variables at the input layer with the quality variable at each encoder, a corresponding weighted reconstruction objective function is designed to successively pretrain the deep networks. With the constraint of preferential reconstruction for more quality-related variables, it can ensure that the learned features contain more information for quality prediction. Finally, the effectiveness of the proposed HVW-SAE based soft sensor method is validated on an industrial debutanizer column process.

[1]  Weihua Gui,et al.  Probabilistic density-based regression model for soft sensing of nonlinear industrial processes , 2017 .

[2]  Wei Xiong,et al.  Stacked Convolutional Denoising Auto-Encoders for Feature Representation , 2017, IEEE Transactions on Cybernetics.

[3]  Roman Rosipal,et al.  Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space , 2002, J. Mach. Learn. Res..

[4]  Zhiqiang Ge,et al.  A Probabilistic Just-in-Time Learning Framework for Soft Sensor Development With Missing Data , 2017, IEEE Transactions on Control Systems Technology.

[5]  Xiaofeng Yuan,et al.  Multi‐similarity measurement driven ensemble just‐in‐time learning for soft sensing of industrial processes , 2018 .

[6]  Luigi Fortuna,et al.  Soft Sensors for Monitoring and Control of Industrial Processes (Advances in Industrial Control) , 2006 .

[7]  Zhiqiang Ge,et al.  Soft Sensor Modeling of Nonlinear Industrial Processes Based on Weighted Probabilistic Projection Regression , 2017, IEEE Transactions on Instrumentation and Measurement.

[8]  Biao Huang,et al.  A Bayesian framework for real‐time identification of locally weighted partial least squares , 2015 .

[9]  Angshul Majumdar,et al.  Asymmetric stacked autoencoder , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[10]  Luiz Augusto da Cruz Meleiro,et al.  ANN-based soft-sensor for real-time process monitoring and control of an industrial polymerization process , 2009, Comput. Chem. Eng..

[11]  Yi Liu,et al.  Integrated soft sensor using just-in-time support vector regression and probabilistic analysis for quality prediction of multi-grade processes , 2013 .

[12]  Biao Huang,et al.  Deep Learning-Based Feature Representation and Its Application for Soft Sensor Modeling With Variable-Wise Weighted SAE , 2018, IEEE Transactions on Industrial Informatics.

[13]  Steven X. Ding,et al.  Fault Detection for Non-Gaussian Processes Using Generalized Canonical Correlation Analysis and Randomized Algorithms , 2018, IEEE Transactions on Industrial Electronics.

[14]  Alexander Binder,et al.  Evaluating the Visualization of What a Deep Neural Network Has Learned , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Lin Li,et al.  Nonlinear Dynamic Soft Sensor Modeling With Supervised Long Short-Term Memory Network , 2020, IEEE Transactions on Industrial Informatics.

[16]  Jan Hauke,et al.  Comparison of Values of Pearson's and Spearman's Correlation Coefficients on the Same Sets of Data , 2011 .

[17]  Zhihuan Song,et al.  Autoregressive Dynamic Latent Variable Models for Process Monitoring , 2017, IEEE Transactions on Control Systems Technology.

[18]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[19]  Biao Huang,et al.  Design of inferential sensors in the process industry: A review of Bayesian methods , 2013 .

[20]  Ning Chen,et al.  Temperature Prediction Model for Roller Kiln by ALD-Based Double Locally Weighted Kernel Principal Component Regression , 2018, IEEE Transactions on Instrumentation and Measurement.

[21]  Yang Wang,et al.  Data-Driven Distributed Local Fault Detection for Large-Scale Processes Based on the GA-Regularized Canonical Correlation Analysis , 2017, IEEE Transactions on Industrial Electronics.

[22]  Biao Huang,et al.  Dynamic Modelling and Predictive Control in Solid Oxide Fuel Cells: First Principle and Data-Based Approaches: Huang/Dynamic Modelling and Predictive Control in Solid Oxide Fuel Cells: First Principle and Data-Based Approaches , 2013 .

[23]  Zhiqiang Ge,et al.  Data Mining and Analytics in the Process Industry: The Role of Machine Learning , 2017, IEEE Access.

[24]  Zhiqiang Ge,et al.  Semisupervised JITL Framework for Nonlinear Industrial Soft Sensing Based on Locally Semisupervised Weighted PCR , 2017, IEEE Transactions on Industrial Informatics.

[25]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[26]  Jun Yu,et al.  Multitask Autoencoder Model for Recovering Human Poses , 2018, IEEE Transactions on Industrial Electronics.

[27]  Plant-Wide Industrial Process Monitoring: A Distributed Modeling Framework , 2016, IEEE Transactions on Industrial Informatics.

[28]  Joon-Hyuk Chang,et al.  Oscillometric Blood Pressure Estimation Based on Deep Learning , 2017, IEEE Transactions on Industrial Informatics.

[29]  Luigi Fortuna,et al.  Soft sensors for product quality monitoring in debutanizer distillation columns , 2005 .

[30]  Ming Shao,et al.  Stacked Denoising Tensor Auto-Encoder for Action Recognition With Spatiotemporal Corruptions , 2018, IEEE Transactions on Image Processing.

[31]  Biao Huang,et al.  Performance-Driven Distributed PCA Process Monitoring Based on Fault-Relevant Variable Selection and Bayesian Inference , 2016, IEEE Transactions on Industrial Electronics.

[32]  Zhiqiang Ge,et al.  Multimode Process Monitoring Based on Switching Autoregressive Dynamic Latent Variable Model , 2018, IEEE Transactions on Industrial Electronics.

[33]  Zhiqiang Ge,et al.  Weighted Linear Dynamic System for Feature Representation and Soft Sensor Application in Nonlinear Dynamic Industrial Processes , 2018, IEEE Transactions on Industrial Electronics.

[34]  Zhi-huan Song,et al.  Locally Weighted Kernel Principal Component Regression Model for Soft Sensing of Nonlinear Time-Variant Processes , 2014 .