A Bayesian approach to robust process identification with ARX models

In the context of process industries, outlying observations mostly represent a large random error resulting from irregular process disturbances, instrument failures, or transmission problems. Statistical analysis of process data contaminated with outliers may lead to biased parameter estimation and plant-model mismatch. The problem of process identification in the presence of outliers has received great attention and a wide variety of outlier identification approaches have been proposed. However, there is a great need to seek for more general solutions and a robust framework to deal with different types of outliers. The main objective of this work is to formulate and solve the robust process identification problem under a Bayesian framework. The proposed solution strategy not only yields maximum a posteriori estimates of model parameters but also provides hyperparameters that determine data quality as well as prior distribution of model parameters. Identification of a simulated continuous fermentation reactor is considered to show the effectiveness and robustness of the proposed Bayesian framework. The advantages of the method are further illustrated through an experimental case study of a pilot-scale continuous stirred tank heater. © 2012 American Institute of Chemical Engineers AIChE J, 59: 845–859, 2013

[1]  F. E. Grubbs.  Procedures for Detecting Outlying Observations in Samples , 1969 .

[2]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[3]  Alexandre Varbanov.  Bayesian approach to outlier detection in multivariate normal samples and linear models , 1998 .

[4]  David J. C. MacKay,et al.  Comparison of Approximate Methods for Handling Hyperparameters , 1999, Neural Computation.

[5]  David Mackay,et al.  Probable networks and plausible predictions - a review of practical Bayesian methods for supervised neural networks , 1995 .

[6]  Kevin Van Geem,et al.  First principle‐based simulation of ethane steam cracking , 2011 .

[7]  Nikolas P. Galatsanos,et al.  Hierarchical Bayesian image restoration from partially known blurs , 2000, IEEE Trans. Image Process..

[8]  Ian K. Craig,et al.  Modelling, validation, and control of an industrial fuel gas blending system☆ , 2011 .

[9]  B. Bequette,et al.  Product property and production rate control of styrene polymerization , 2002 .

[10]  Biao Huang,et al.  Dealing with Irregular Data in Soft Sensors: Bayesian Method and Comparative Study , 2008 .

[11]  Bonnie Ghosh-Dastider,et al.  Outlier Detection and Editing Procedures for Continuous Multivariate Data , 2003 .

[12]  Gunter Ritter,et al.  Outliers in statistical pattern recognition and an application to automatic chromosome classification , 1997, Pattern Recognit. Lett..

[13]  Wei Jiang,et al.  On-line outlier detection and data cleaning , 2004, Comput. Chem. Eng..

[14]  Bokyoung Kang,et al.  Integrating independent component analysis and local outlier factor for plant-wide process monitoring , 2011 .

[15]  Chuanhou Gao,et al.  Improvement of identification of blast furnace ironmaking process by outlier detection and missing value imputation , 2009 .

[16]  Christopher M. Bishop,et al.  Novelty detection and neural network validation , 1994 .

[17]  R. Molina,et al.  Variational posterior distribution approximation in Bayesian super resolution reconstruction of multispectral images , 2008 .

[18]  Manabu Kano,et al.  Data-based process monitoring, process control, and quality improvement: Recent developments and applications in steel industry , 2008, Comput. Chem. Eng..

[19]  Deepak Agarwal,et al.  Detecting anomalies in cross-classified streams: a Bayesian approach , 2006, Knowledge and Information Systems.

[20]  Leo H. Chiang,et al.  Exploring process data with the use of robust outlier detection algorithms , 2003 .

[21]  James T. Kwok,et al.  The evidence framework applied to support vector machines , 2000, IEEE Trans. Neural Networks Learn. Syst..

[22]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[23]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[24]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[25]  Victoria J. Hodge,et al.  A Survey of Outlier Detection Methodologies , 2004, Artificial Intelligence Review.

[26]  Nina F. Thornhill,et al.  A continuous stirred tank heater simulation model with applications , 2008 .

[27]  Jie Yu,et al.  A Bayesian inference based two-stage support vector regression framework for soft sensor development in batch bioprocesses , 2012, Comput. Chem. Eng..