Nonlinear Dynamic Soft Sensor Modeling With Supervised Long Short-Term Memory Network

Soft sensor has been extensively utilized in industrial processes for prediction of key quality variables. To build an accurate virtual sensor model, it is very significant to model the dynamic and nonlinear behaviors of process sequential data properly. Recently, a long short-term memory (LSTM) network has shown great modeling ability on various time series, in which basic LSTM units can handle data nonlinearities and dynamics with a dynamic latent variable structure. However, the hidden variables in the basic LSTM unit mainly focus on describing the dynamics of input variables, which lack representation for the quality data. In this paper, a supervised LSTM (SLSTM) network is proposed to learn quality-relevant hidden dynamics for soft sensor application, which is composed of basic SLSTM unit at each sampling instant. In the basic SLSTM unit, the quality and input variables are simultaneously utilized to learn the dynamic hidden states, which are more relevant and useful for quality prediction. The effectiveness of the proposed SLSTM network is demonstrated on a penicillin fermentation process and an industrial debutanizer column.

[1]  Brosilow,et al.  Inferential control of processes: Construction of optimal and suboptimal dynamic estimators , 1976 .

[2]  T K Radhakrishnan,et al.  Soft sensor based composition estimation and controller design for an ideal reactive distillation column. , 2011, ISA transactions.

[3]  Biao Huang,et al.  Design of inferential sensors in the process industry: A review of Bayesian methods , 2013 .

[4]  A. Kouadri,et al.  A Modified Moving Window dynamic PCA with Fuzzy Logic Filter and application to fault detection , 2018, Chemometrics and Intelligent Laboratory Systems.

[5]  L. T. Fan,et al.  Monitoring the process of curing of epoxy/graphite fiber composites with a recurrent neural network as a soft sensor , 1998 .

[6]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[7]  Zhiqiang Ge,et al.  Process Data Analytics via Probabilistic Latent Variable Models: A Tutorial Review , 2018, Industrial & Engineering Chemistry Research.

[8]  Hiromasa Kaneko,et al.  Application of Online Support Vector Regression for Soft Sensors , 2014 .

[9]  Dexian Huang,et al.  Data-driven soft sensor development based on deep learning technique , 2014 .

[10]  Zhiqiang Ge,et al.  Semisupervised JITL Framework for Nonlinear Industrial Soft Sensing Based on Locally Semisupervised Weighted PCR , 2017, IEEE Transactions on Industrial Informatics.

[11]  Luigi Fortuna,et al.  Soft Sensors for Monitoring and Control of Industrial Processes (Advances in Industrial Control) , 2006 .

[12]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[13]  Biao Huang,et al.  Deep Learning-Based Feature Representation and Its Application for Soft Sensor Modeling With Variable-Wise Weighted SAE , 2018, IEEE Transactions on Industrial Informatics.

[14]  Björn W. Schuller,et al.  Combining Long Short-Term Memory and Dynamic Bayesian Networks for Incremental Emotion-Sensitive Artificial Listening , 2010, IEEE Journal of Selected Topics in Signal Processing.

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Coleman B. Brosilow,et al.  Inferential control of processes: Part II. The structure and dynamics of inferential control systems , 1978 .

[17]  Nitish Srivastava,et al.  Unsupervised Learning of Video Representations using LSTMs , 2015, ICML.

[18]  Zhiqiang Ge,et al.  Dynamic Probabilistic Latent Variable Model for Process Data Modeling and Regression Application , 2019, IEEE Transactions on Control Systems Technology.

[19]  Björn W. Schuller,et al.  Noise robust ASR in reverberated multisource environments applying convolutive NMF and Long Short-Term Memory , 2013, Comput. Speech Lang..

[20]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Manabu Kano,et al.  Data-based process monitoring, process control, and quality improvement: Recent developments and applications in steel industry , 2008, Comput. Chem. Eng..

[22]  Zhiqiang Ge,et al.  Weighted Linear Dynamic System for Feature Representation and Soft Sensor Application in Nonlinear Dynamic Industrial Processes , 2018, IEEE Transactions on Industrial Electronics.

[23]  Weihua Li,et al.  Recursive PCA for adaptive process monitoring , 1999 .

[24]  Gülnur Birol,et al.  A modular simulation package for fed-batch fermentation: penicillin production , 2002 .

[25]  Salvatore Graziani,et al.  Low-order Nonlinear Finite-Impulse Response Soft Sensors for Ionic Electroactive Actuators Based on Deep Learning , 2019, IEEE Transactions on Instrumentation and Measurement.

[26]  Manabu Kano,et al.  Inferential control system of distillation compositions using dynamic partial least squares regression , 1998 .

[27]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[28]  Zhiqiang Ge,et al.  Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application , 2019, IEEE Transactions on Industrial Informatics.

[29]  Babu Joseph,et al.  Inferential control of processes: Part I. Steady state analysis and design , 1978 .

[30]  Zhiqiang Ge,et al.  Soft Sensor Modeling of Nonlinear Industrial Processes Based on Weighted Probabilistic Projection Regression , 2017, IEEE Transactions on Instrumentation and Measurement.