Bayesian migration of Gaussian process regression for rapid process modeling and optimization

Data-based empirical models, though widely used in process optimization, are restricted to a specific process being modeled. Model migration has been proved to be an effective technique to adapt a base model from a old process to a new but similar process. This paper proposes to apply the flexible Gaussian process regression (GPR) for empirical modeling, and develops a Bayesian method for migrating the GPR model. The migration is conducted by a functional scale-bias correction of the base model, as opposed to the restrictive parametric scale-bias approach. Furthermore, an iterative approach that jointly accomplishes model migration and process optimization is presented. This is in contrast to the conventional “two-step” method whereby an accurate model is developed prior to model-based optimization. A rigorous statistical measure, the expected improvement, is adopted for optimization in the presence of prediction uncertainty. The proposed methodology has been applied to the optimization of a simulated chemical process, and a real catalytic reaction for the epoxidation of trans-stilbene.

[1]  Neil D. Lawrence,et al.  Sparse Convolved Gaussian Processes for Multi-output Regression , 2008, NIPS.

[2]  Mohammad Ali Karimi,et al.  ANN modeling of water consumption in the lead-acid batteries , 2007 .

[3]  Furong Gao,et al.  Model Migration with Inclusive Similarity for Development of a New Process Model , 2008 .

[4]  Yong Zhang,et al.  Uniform Design: Theory and Application , 2000, Technometrics.

[5]  Marcus R. Frean,et al.  Using Gaussian Processes to Optimize Expensive Functions , 2008, Australasian Conference on Artificial Intelligence.

[6]  Karsten-Ulrich Klatt,et al.  Perspectives for process systems engineering - Personal views from academia and industry , 2009, Comput. Chem. Eng..

[7]  Edward S. Rubin,et al.  Parameter design methodology for chemical processes using a simulator , 1994 .

[8]  Tao Yu,et al.  Reliable multi-objective optimization of high-speed WEDM process based on Gaussian process regression , 2008 .

[9]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[10]  A. O'Hagan,et al.  Curve Fitting and Optimal Design for Prediction , 1978 .

[11]  Furong Gao,et al.  Model Migration for Development of a New Process Model , 2009 .

[12]  Junghui Chen,et al.  Product and process development using artificial neural‐network model and information analysis , 1998 .

[13]  Yanhui Yang,et al.  Response surface methodology using Gaussian processes: Towards optimizing the trans-stilbene epoxidation over Co2+-NaX catalysts , 2010 .

[14]  Yuan Wang,et al.  Some Applications of Number-Theoretic Methods in Statistics , 1994 .

[15]  F. Tian,et al.  Modeling and prediction of binding affinities between the human amphiphysin SH3 domain and its peptide ligands using genetic algorithm‐Gaussian processes , 2008, Biopolymers.

[16]  Russell R. Barton,et al.  A review on design, modeling and applications of computer experiments , 2006 .

[17]  Bo Wang,et al.  Bayesian variable selection for Gaussian process regression: Application to chemometric calibration of spectrometers , 2010, Neurocomputing.

[18]  Claude Mirodatos,et al.  Using Artificial Neural Networks to Boost High‐throughput Discovery in Heterogeneous Catalysis , 2004 .

[19]  Shi-Shang Jang,et al.  Nonlinear Dynamic Artificial Neural Network Modeling Using an Information Theory Based Experimental Design Approach , 1998 .

[20]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[21]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[22]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[23]  Carolyn Conner Seepersad,et al.  Building Surrogate Models Based on Detailed and Approximate Simulations , 2004, DAC 2004.

[24]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[25]  Urmila M. Diwekar,et al.  An efficient sampling technique for off-line quality control , 1997 .

[26]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[27]  Furong Gao,et al.  Process similarity and developing new process models through migration , 2009 .

[28]  A. Niazi,et al.  Least-squares support vector machines for simultaneous voltammetric determination of lead and tin: A comparison between LS-SVM and PLS in voltammetric data , 2008 .

[29]  J Q Shi,et al.  Gaussian Process Functional Regression Modeling for Batch Data , 2007, Biometrics.

[30]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[31]  E. Martin,et al.  Gaussian process regression for multivariate spectroscopic calibration , 2007 .

[32]  Yanhui Yang,et al.  Response surface methodology using Gaussian processes : towards optimizing the trans-stilbene epoxidation over Co 2 +-NaX catalysts , 2009 .

[33]  Fernando di Sciascio,et al.  Biomass estimation in batch biotechnological processes by Bayesian Gaussian process regression , 2008, Comput. Chem. Eng..

[34]  David E. Block,et al.  Nonlinear experimental design using Bayesian regularized neural networks , 2007 .

[35]  Martha A. Grover,et al.  Stochastic Dynamic Predictions Using Kriging for Nanoparticle Synthesis , 2009 .

[36]  Furong Gao,et al.  Process Modeling Based on Process Similarity , 2008 .

[37]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[38]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..