Online quality prediction of nonlinear and non-Gaussian chemical processes with shifting dynamics using finite mixture model based Gaussian process regression approach

Abstract Reliable quality prediction of chemical processes often encounters different challenges including process nonlinearity and non-Gaussianity, shifting operating modes and dynamics, and system uncertainty. In this paper, a novel soft sensor prediction method is proposed by integrating finite mixture model (FMM) and nonlinear kernel Gaussian process regression (GPR). The finite mixture model is first estimated to identify the different operating modes of the process that correspond to the switching dynamics. Then the multiple localized Gaussian process regression models in the nonlinear kernel space are built to characterize the different dynamic relationships between process and quality variables within various operating modes. Further, the posterior probabilities of each new test sample with respect to different modes can be estimated through Bayesian inference strategy and used to incorporate multiple localized GPR models into a global model for quality variable prediction. The proposed FMM–GPR approach is applied to the Tennessee Eastman Chemical process with multiple operating modes and its performance is compared to that of the multi-model LSSVM method using two test cases. The soft sensor prediction results show that the FMM–GPR approach is superior to the LSSVM method in terms of much higher prediction accuracy and reliability.

[1]  Shi-Shang Jang,et al.  Development of a Novel Soft Sensor Using a Local Model Network with an Adaptive Subtractive Clustering Approach , 2010 .

[2]  Xiao Fan Wang,et al.  Soft sensing modeling based on support vector machine and Bayesian model selection , 2004, Comput. Chem. Eng..

[3]  Luigi Fortuna,et al.  Soft Sensors for Monitoring and Control of Industrial Processes (Advances in Industrial Control) , 2006 .

[4]  N. Lawrence Ricker,et al.  Decentralized control of the Tennessee Eastman Challenge Process , 1996 .

[5]  Sirish L. Shah,et al.  Inferential sensors for estimation of polymer quality parameters: Industrial application of a PLS-based soft sensor for a LDPE plant , 2006 .

[6]  E. Martin,et al.  Non-linear projection to latent structures revisited: the quadratic PLS algorithm , 1999 .

[7]  Jie Yu A nonlinear kernel Gaussian mixture model based inferential monitoring approach for fault detection and diagnosis of chemical processes , 2012 .

[8]  K.A. Hoo,et al.  Multivariate statistics for process control , 2002, IEEE Control Systems.

[9]  S. Qin,et al.  Multimode process monitoring with Bayesian inference‐based finite Gaussian mixture models , 2008 .

[10]  Luiz Augusto da Cruz Meleiro,et al.  ANN-based soft-sensor for real-time process monitoring and control of an industrial polymerization process , 2009, Comput. Chem. Eng..

[11]  Jie Yu,et al.  A Bayesian inference based two-stage support vector regression framework for soft sensor development in batch bioprocesses , 2012, Comput. Chem. Eng..

[12]  S. Joe Qin,et al.  Variance component analysis based fault diagnosis of multi-layer overlay lithography processes , 2009 .

[13]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[14]  D. Dochain,et al.  On-Line Estimation and Adaptive Control of Bioreactors , 2013 .

[15]  Sten Bay Jørgensen,et al.  A systematic approach for soft sensor development , 2007, Comput. Chem. Eng..

[16]  A. Çinar,et al.  Online batch/fed-batch process performance monitoring, quality prediction, and variable-contribution analysis for diagnosis , 2003 .

[17]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Francis J. Doyle,et al.  Neural network-based software sensor: training set design and application to a continuous pulp digester , 2005 .

[19]  Chi Ma,et al.  Fault diagnosis of nonlinear processes using multiscale KPCA and multiscale KPLS , 2011 .

[20]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[21]  Davide Fissore,et al.  Design and validation of an innovative soft-sensor for pharmaceuticals freeze-drying monitoring , 2011 .

[22]  Jie Yu,et al.  Localized Fisher discriminant analysis based complex chemical process monitoring , 2011 .

[23]  Diego Martinez Prata,et al.  Simultaneous robust data reconciliation and gross error detection through particle swarm optimization for an industrial polypropylene reactor , 2010 .

[24]  Philippe Bogaerts,et al.  Parameter identification for state estimation—application to bioprocess software sensors , 2004 .

[25]  S. Qin Recursive PLS algorithms for adaptive data modeling , 1998 .

[26]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[27]  Hiromasa Kaneko,et al.  Development of a new soft sensor method using independent component analysis and partial least squares , 2009 .

[28]  S. Qin,et al.  Multiway Gaussian Mixture Model Based Multiphase Batch Process Monitoring , 2009 .

[29]  Manabu Kano,et al.  Soft‐sensor development using correlation‐based just‐in‐time modeling , 2009 .

[30]  Biao Huang,et al.  Dealing with Irregular Data in Soft Sensors: Bayesian Method and Comparative Study , 2008 .

[31]  Jie Yu,et al.  Nonlinear Bioprocess Monitoring Using Multiway Kernel Localized Fisher Discriminant Analysis , 2011 .

[32]  D. S. Young An Overview of Mixture Models , 2008, 0808.0383.

[33]  Xi Zhang,et al.  Nonlinear Multivariate Quality Estimation and Prediction Based on Kernel Partial Least Squares , 2008 .

[34]  Rubens Maciel Filho,et al.  Soft sensors development for on-line bioreactor state estimation , 2000 .