Adaptive optimisation of noisy black-box functions inherent in microscopic models

For systems where exact constitutive relations are unknown, a microscopic level description can be alternatively used. As microscopic simulations are computationally expensive, there is a need for the development of robust algorithms in order to efficiently optimise such systems taking into consideration the inherent noise associated with the microscopic description. Three optimisation strategies are proposed and tested using a stochastic reaction system as a case study. The first method generates optimal difference intervals to formulate and solve a non-linear program (NLP), whereas the other methods build response surface models and optimise using either a direct search algorithm changing to a steepest descent method once the optimum region is located, or sequential quadratic programming (SQP). The performance of these methods is compared to that of a steepest descent optimisation method commonly used for response surfaces. Their effectiveness is evaluated in terms of the number of microscale function calls and computational time.

[1]  P. Gill,et al.  User's Guide for SOL/NPSOL: A Fortran Package for Nonlinear Programming. , 1983 .

[2]  Kun-Nan Chen,et al.  Optimization on response surface models for the optimal manufacturing conditions of dairy tofu , 2005 .

[3]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[4]  R. Haftka,et al.  Response surface approximations for structural optimization , 1996 .

[5]  C. T. Kelley,et al.  Superlinear Convergence and Implicit Filtering , 1999, SIAM J. Optim..

[6]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[7]  城塚 正,et al.  Chemical Engineering Scienceについて , 1962 .

[8]  Ioannis G. Kevrekidis,et al.  “Coarse” stability and bifurcation analysis using stochastic simulators: Kinetic Monte Carlo examples , 2001, nlin/0111038.

[9]  Panos M. Pardalos,et al.  A Collection of Test Problems for Constrained Global Optimization Algorithms , 1990, Lecture Notes in Computer Science.

[10]  Arnold Neumaier,et al.  Global Optimization by Multilevel Coordinate Search , 1999, J. Glob. Optim..

[11]  P. Christofides,et al.  Dynamic optimization of dissipative PDE systems using nonlinear order reduction , 2002 .

[12]  Nielen Stander,et al.  On the robustness of a simple domain reduction scheme for simulation‐based optimization , 2002 .

[13]  Antanas Zilinskas,et al.  A review of statistical models for global optimization , 1992, J. Glob. Optim..

[14]  Ian David Lockhart Bogle,et al.  Computers and Chemical Engineering , 2008 .

[15]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[16]  Carl Tim Kelley,et al.  Iterative methods for optimization , 1999, Frontiers in applied mathematics.

[17]  Antonios Armaou,et al.  Equation-free, coarse-grained computational optimization using timesteppers , 2006 .

[18]  A. Armaou,et al.  Multiscale optimization using hybrid PDE/kMC process systems with application to thin film growth , 2005 .

[19]  C. W. Gear,et al.  'Coarse' integration/bifurcation analysis via microscopic simulators: Micro-Galerkin methods , 2002 .

[20]  D. Gillespie A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[21]  P. Christofides,et al.  Multivariable Predictive Control of Thin Film Deposition Using a Stochastic PDE Model , 2005 .

[22]  Panagiotis D. Christofides,et al.  Optimization of transport-reaction processes using nonlinear model reduction , 2000 .

[23]  Andreas A. Linninger,et al.  Solving kinetic inversion problems via a physically bounded Gauss - Newton (PGN) method , 2005 .

[24]  J. S. Hunter,et al.  Statistics for experimenters : an introduction to design, data analysis, and model building , 1979 .

[25]  C. T. Kelley,et al.  An Implicit Filtering Algorithm for Optimization of Functions with Many Local Minima , 1995, SIAM J. Optim..

[26]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .