Response surface methodology with prediction uncertainty: A multi-objective optimisation approach

Abstract In the field of response surface methodology (RSM), the prediction uncertainty of the empirical model needs to be considered for effective process optimisation. Current methods combine the prediction mean and uncertainty through certain weighting strategies, either explicitly or implicitly, to form a single objective function for optimisation. This paper proposes to address this problem under the multi-objective optimisation framework. Overall, the method iterates through initial experimental design, empirical modelling and model-based optimisation to allocate promising experiments for the next iteration. Specifically, the Gaussian process regression is adopted as the empirical model due to its demonstrated prediction accuracy and reliable quantification of prediction uncertainty in the literature. The non-dominated sorting genetic algorithm II (NSGA-II) is used to search for Pareto points that are further clustered to give experimental points to be conducted in the next iteration. The application study, on the optimisation of a catalytic epoxidation process, demonstrates that the proposed method is a powerful tool to aid the development of chemical and potentially other processes.

[1]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[2]  Bojan Likar,et al.  Predictive control of a gas-liquid separation plant based on a Gaussian process model , 2007, Comput. Chem. Eng..

[3]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[4]  Junghui Chen,et al.  Product and process development using artificial neural‐network model and information analysis , 1998 .

[5]  A. Saltelli,et al.  Sensitivity analysis for chemical models. , 2005, Chemical reviews.

[6]  Daniel W. Apley,et al.  Understanding the Effects of Model Uncertainty in Robust Design With Computer Experiments , 2006 .

[7]  Shaotong Jiang,et al.  Optimization of Molecular Distillation for Recovery of Tocopherol from Rapeseed Oil Deodorizer Distillate Using Response Surface and Artificial Neural Network Models , 2007 .

[8]  Tao Yu,et al.  Reliable multi-objective optimization of high-speed WEDM process based on Gaussian process regression , 2008 .

[9]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[10]  Wenjin Yan,et al.  Development of high performance catalysts for CO oxidation using data-based modeling , 2011 .

[11]  Mira Zečević,et al.  Application of neural networks for response surface modeling in HPLC optimization , 1998 .

[12]  Diego Andina,et al.  Application of Neural Networks , 2007 .

[13]  Yong Zhang,et al.  Uniform Design: Theory and Application , 2000, Technometrics.

[14]  Yanhui Yang,et al.  Response surface methodology using Gaussian processes: Towards optimizing the trans-stilbene epoxidation over Co2+-NaX catalysts , 2010 .

[15]  Mohammad Reza Hadjmohammadi,et al.  Response surface methodology and support vector machine for the optimization of separation in linear gradient elution. , 2008, Journal of separation science.

[16]  Claude Mirodatos,et al.  Using Artificial Neural Networks to Boost High‐throughput Discovery in Heterogeneous Catalysis , 2004 .

[17]  Rintu Banerjee,et al.  Optimization of culture parameters for extracellular protease production from a newly isolated Pseudomonas sp. using response surface and artificial neural network models , 2004 .

[18]  Shi-Shang Jang,et al.  Nonlinear Dynamic Artificial Neural Network Modeling Using an Information Theory Based Experimental Design Approach , 1998 .

[19]  David J. C. MacKay,et al.  Information-Based Objective Functions for Active Data Selection , 1992, Neural Computation.

[20]  D. M. Titterington,et al.  Bayesian regression and classification using mixtures of Gaussian processes , 2003 .

[21]  T. Bajd,et al.  Nonlinear modeling of FES-supported standing-up in paraplegia for selection of feedback sensors , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Tor Arne Johansen,et al.  Explicit stochastic predictive control of combustion plants based on Gaussian process models , 2008, Autom..

[23]  Tao Chen,et al.  Interpretation of non-linear empirical data-based process models using global sensitivity analysis , 2011 .

[24]  Aki Vehtari,et al.  Gaussian process regression with Student-t likelihood , 2009, NIPS.

[25]  Pierre Dardenne,et al.  Validation and verification of regression in small data sets , 1998 .

[26]  David E. Block,et al.  Nonlinear experimental design using Bayesian regularized neural networks , 2007 .

[27]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[28]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[29]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[30]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[31]  R. H. Myers,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[32]  Pedro Serna,et al.  Combining high-throughput experimentation, advanced data modeling and fundamental knowledge to develop catalysts for the epoxidation of large olefins and fatty esters , 2008 .

[33]  Geoffrey E. Hinton,et al.  Evaluation of Gaussian processes and other methods for non-linear regression , 1997 .

[34]  Zhiqiang Ge,et al.  Nonlinear Probabilistic Monitoring Based on the Gaussian Process Latent Variable Model , 2010 .

[35]  Isneri Talavera,et al.  Relevance vector machines for multivariate calibration purposes , 2008 .

[36]  J.-S. Chang Product and Process Development via Sequential Pseudo-Uniform Design , 2004 .

[37]  Daniel W. Apley,et al.  Understanding the effects of model uncertainty in robust design with computer experiments , 2006, DAC 2006.

[38]  Furong Gao,et al.  Bayesian migration of Gaussian process regression for rapid process modeling and optimization , 2011 .

[39]  Matthew J. Realff,et al.  Metamodeling Approach to Optimization of Steady-State Flowsheet Simulations: Model Generation , 2002 .

[40]  Urmila M. Diwekar,et al.  An efficient sampling technique for off-line quality control , 1997 .

[41]  E. M. Khazen,et al.  Reduction of dimensionality in choosing optimal control , 2003 .

[42]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[43]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[44]  R. Jasra,et al.  Effect of alkali and alkaline earth metal ions on the catalytic epoxidation of styrene with molecular oxygen using cobalt(II)-exchanged zeolite X , 2006 .