Data-Driven Predictive Model Based on Locally Weighted Bayesian Gaussian Regression

In this paper, a data-driven modeling approach referred to as the ‘locally weighted Bayesian Gaussian regression (LWBGR)’ is proposed to develop soft sensor for nonlinear industrial process. The LWBGR handles nonlinearities by constructing localized models and accommodates process uncertainties by adopting the probabilistic way. An important feature of the LWBGR is that each localized model is a fully Bayesian Gaussian regression model where the mean and covariance are treated as random variables rather than deterministic parameters. By doing so the LWBGR can achieve enhanced capabilities in dealing with overfitting and numerical issues, which leads to higher predictive accuracy and more stable solution. The performance of the LWBGR is evaluated using a real-world industrial process, and the results demonstrate the advantages of the LWBGR over the deterministic and other probabilistic locally weighted models.

[1]  Zhiqiang Ge,et al.  Data Mining and Analytics in the Process Industry: The Role of Machine Learning , 2017, IEEE Access.

[3]  Zhiqiang Ge,et al.  Parallel Computing and SGD-Based DPMM For Soft Sensor Development With Large-Scale Semisupervised Data , 2019, IEEE Transactions on Industrial Electronics.

[4]  Li Wang,et al.  Dual learning-based online ensemble regression approach for adaptive soft sensor modeling of nonlinear time-varying processes , 2016 .

[5]  Rui Araújo,et al.  Mixture of partial least squares experts and application in prediction settings with multiple operating modes , 2014 .

[6]  Zhiqiang Ge,et al.  Soft-Sensor Development for Processes With Multiple Operating Modes Based on Semisupervised Gaussian Mixture Regression , 2019, IEEE Transactions on Control Systems Technology.

[7]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[8]  Manabu Kano,et al.  Long-Term Industrial Applications of Inferential Control Based on Just-In-Time Soft-Sensors: Economical Impact and Challenges , 2013 .

[9]  Zhiqiang Ge,et al.  Probabilistic latent variable regression model for process-quality monitoring , 2014 .

[10]  Sheng Chen,et al.  Adaptive Soft Sensor Development for Multi-Output Industrial Processes Based on Selective Ensemble Learning , 2018, IEEE Access.

[11]  Morimasa Ogawa,et al.  The state of the art in chemical process control in Japan: Good practice and questionnaire survey , 2010 .

[12]  Jialin Liu,et al.  Development of Self-Validating Soft Sensors Using Fast Moving Window Partial Least Squares , 2010 .

[13]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[14]  Zhiqiang Ge,et al.  Locally Weighted Prediction Methods for Latent Factor Analysis With Supervised and Semisupervised Process Data , 2017, IEEE Transactions on Automation Science and Engineering.

[15]  S. Wold,et al.  The kernel algorithm for PLS , 1993 .

[16]  Zhiqiang Ge,et al.  Nonlinear semisupervised principal component regression for soft sensor modeling and its mixture form , 2014 .

[17]  Koichi Fujiwara,et al.  Virtual sensing technology in process industries: Trends and challenges revealed by recent industria , 2013 .