Quality variable prediction for chemical processes based on semisupervised Dirichlet process mixture of Gaussians

Abstract Data driven soft sensors have found widespread applications in chemical processes for predicting those important yet difficult-to-measure quality variables. In the vast majority of chemical processes, relationships among primary and secondary variables are nonlinear, and process data inherently contain uncertainties and present strongly non-Gaussian characteristics. In addition, labeled samples are often scarce due to certain technical or economical difficulties. These process and data characteristics impose challenges on high-accuracy soft sensors. To deal with these issues, this paper proposes a soft sensing approach referred to as the semisupervised Dirichlet process mixture of Gaussians (SsDPMG). In the SsDPMG, a fully Bayesian model structure is first designed to enable semisupervised tasks that are suitable for regression applications. Subsequently, a Bayesian learning procedure for the SsDPMG is developed based on variational inference framework, where information contained in both labeled and unlabeled samples are extracted. Case studies are carried out on one numerical example and two real-life chemical processes to evaluate the performance of the proposed approach. The results demonstrate that the SsDPMG is an effective soft sensing approach with promising application foreground.

[1]  In-Beum Lee,et al.  Fault Detection Based on a Maximum-Likelihood Principal Component Analysis (PCA) Mixture , 2005 .

[2]  Zhiqiang Ge,et al.  Moving window adaptive soft sensor for state shifting process based on weighted supervised latent factor analysis , 2017 .

[3]  Sami Bourouis,et al.  Bayesian learning of finite generalized inverted Dirichlet mixtures: Application to object classification and forgery detection , 2014, Expert Syst. Appl..

[4]  Zhiqiang Ge,et al.  Locally Weighted Prediction Methods for Latent Factor Analysis With Supervised and Semisupervised Process Data , 2017, IEEE Transactions on Automation Science and Engineering.

[5]  Sheng Chen,et al.  Monitoring Nonlinear and Non-Gaussian Processes Using Gaussian Mixture Model-Based Weighted Kernel Independent Component Analysis , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Zhiqiang Ge,et al.  Soft sensor model development in multiphase/multimode processes based on Gaussian mixture regression , 2014 .

[7]  Zhiqiang Ge,et al.  Weighted Linear Dynamic System for Feature Representation and Soft Sensor Application in Nonlinear Dynamic Industrial Processes , 2018, IEEE Transactions on Industrial Electronics.

[8]  Jie Yu.  Multiway Gaussian Mixture Model Based Adaptive Kernel Partial Least Squares Regression Method for Soft Sensor Estimation and Reliable Quality Prediction of Nonlinear Multiphase Batch Processes , 2012 .

[9]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[10]  Zhiqiang Ge,et al.  Probabilistic latent variable regression model for process-quality monitoring , 2014 .

[11]  Nizar Bouguila,et al.  Hybrid Generative/Discriminative Approaches for Proportional Data Modeling and Classification , 2012, IEEE Transactions on Knowledge and Data Engineering.

[12]  S. Qin,et al.  Multimode process monitoring with Bayesian inference‐based finite Gaussian mixture models , 2008 .

[13]  Weiming Shao,et al.  Adaptive soft sensor for quality prediction of chemical processes based on selective ensemble of local partial least squares models , 2015 .

[14]  Di Tang,et al.  A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application , 2017, IEEE Transactions on Industrial Electronics.

[15]  Ke Xiao,et al.  Variational Bayesian inference for a Dirichlet process mixture of beta distributions and application , 2018, Neurocomputing.

[16]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[17]  Zhiqiang Ge,et al.  A Probabilistic Just-in-Time Learning Framework for Soft Sensor Development With Missing Data , 2017, IEEE Transactions on Control Systems Technology.

[18]  Hiromasa Kaneko,et al.  Applicability domains and accuracy of prediction of soft sensor models , 2011 .

[19]  Jie Yu,et al.  Online quality prediction of nonlinear and non-Gaussian chemical processes with shifting dynamics using finite mixture model based Gaussian process regression approach , 2012 .

[20]  Wei Zhang,et al.  JITL based MWGPR soft sensor for multi-mode process with dual-updating strategy , 2016, Comput. Chem. Eng..

[21]  Sidan Du,et al.  A multi-manifold semi-supervised Gaussian mixture model for pattern classification , 2013, Pattern Recognit. Lett..

[22]  Rui Araújo,et al.  Review of soft sensor methods for regression applications , 2016 .

[23]  Zhiqiang Ge,et al.  Variational Bayesian Gaussian Mixture Regression for Soft Sensing Key Variables in Non-Gaussian Industrial Processes , 2017, IEEE Transactions on Control Systems Technology.

[24]  Guohai Liu,et al.  Dynamic soft sensor development based on Gaussian mixture regression for fermentation processes , 2017 .

[25]  Jialin Liu,et al.  Development of Self-Validating Soft Sensors Using Fast Moving Window Partial Least Squares , 2010 .

[26]  Zhiqiang Ge,et al.  Data Mining and Analytics in the Process Industry: The Role of Machine Learning , 2017, IEEE Access.

[27]  Dražen Slišković,et al.  Adaptive soft sensor for online prediction and process monitoring based on a mixture of Gaussian process models , 2013, Comput. Chem. Eng..

[28]  Dongxiang Zhang,et al.  Soft Sensor Development Based on the Hierarchical Ensemble of Gaussian Process Regression Models for Nonlinear and Non-Gaussian Chemical Processes , 2016 .

[29]  J. Sethuraman.  A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[30]  Chee Khiang Pang,et al.  Gaussian Mixture Model Using Semisupervised Learning for Probabilistic Fault Diagnosis Under New Data Categories , 2017, IEEE Transactions on Instrumentation and Measurement.

[31]  T. Ferguson.  A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[32]  Lei Xie,et al.  Novel Just-In-Time Learning-Based Soft Sensor Utilizing Non-Gaussian Information , 2014, IEEE Transactions on Control Systems Technology.

[33]  Chen Sun,et al.  Cognitive radio with smart sensing: enabling architecture and use cases (ソフトウェア無線) , 2008 .

[34]  Adrian E. Raftery,et al.  Approximate Bayes Factors for Image Segmentation: The Pseudolikelihood Information Criterion (PLIC) , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[36]  David R. Anderson,et al.  Multimodel Inference , 2004 .

[37]  Junghui Chen,et al.  Melt index prediction with a mixture of Gaussian process regression with embedded clustering and variable selections , 2017 .

[38]  Zhiqiang Ge,et al.  Multimode process data modeling: A Dirichlet process mixture model based Bayesian robust factor analyzer approach , 2015 .

[39]  Luca Callegaro,et al.  On the Calibration of Direct-Current Current Transformers (DCCT) , 2015, IEEE Transactions on Instrumentation and Measurement.

[40]  Andre Wibisono,et al.  Streaming Variational Bayes , 2013, NIPS.

[41]  Yu Tian,et al.  A Framework and Modeling Method of Data-Driven Soft Sensors Based on Semisupervised Gaussian Regression , 2016 .