Deterministic global derivative-free optimization of black-box problems with bounded Hessian

Obtaining guaranteed lower bounds for problems with unknown algebraic form has been a major challenge in derivative-free optimization. In this work, we present a deterministic global optimization method for black-box problems where the derivatives are not available or it is computationally expensive to obtain. However, a global upper bound on the diagonal Hessian elements is known. An edge-concave underestimator (Hasan in J Glob Optim 71:735–752, 2018 ) can be then constructed with vertex polyhedral solution. Evaluating this underestimator only at the vertices leads to a valid lower bound on the original black-box problem. We have implemented this lower bounding technique within a branch-and-bound framework and assessed its computational performance in locating $$\epsilon $$ ϵ -global optimal solution for several box-constrained, nonconvex black-box functions.

[1]  Arnold Neumaier,et al.  SNOBFIT -- Stable Noisy Optimization by Branch and Fit , 2008, TOMS.

[2]  Ishan Bajaj,et al.  Integrated Carbon Capture and Conversion To Produce Syngas: Novel Process Design, Intensification, and Optimization , 2017 .

[3]  Katya Scheinberg,et al.  Introduction to derivative-free optimization , 2010, Math. Comput..

[4]  Nikolaos V. Sahinidis,et al.  Derivative-free optimization: a review of algorithms and comparison of software implementations , 2013, J. Glob. Optim..

[5]  M. M. Faruque Hasan,et al.  An edge-concave underestimator for the global optimization of twice-differentiable nonconvex problems , 2018, J. Glob. Optim..

[6]  Christodoulos A. Floudas,et al.  Global optimization advances in Mixed-Integer Nonlinear Programming, MINLP, and Constrained Derivative-Free Optimization, CDFO , 2016, Eur. J. Oper. Res..

[7]  R. Horst,et al.  Global Optimization: Deterministic Approaches , 1992 .

[8]  Russell R. Barton,et al.  Metamodeling: a state of the art review , 1994, Proceedings of Winter Simulation Conference.

[9]  Albert Donally Bethke,et al.  Genetic Algorithms as Function Optimizers , 1980 .

[10]  Ishan Bajaj,et al.  Optimal synthesis of periodic sorption enhanced reaction processes with application to hydrogen production , 2018, Comput. Chem. Eng..

[11]  M. Heinkenschloss,et al.  Shape optimization in steady blood flow: A numerical study of non-Newtonian effects , 2005, Computer methods in biomechanics and biomedical engineering.

[12]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[13]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[14]  Hans-Martin Gutmann,et al.  A Radial Basis Function Method for Global Optimization , 2001, J. Glob. Optim..

[15]  Mehri Sanati,et al.  Targeting by comparison with laboratory experiments the SCR catalyst deactivation process by potassium and zinc salts in a large-scale biomass combustion boiler , 2006 .

[16]  Christodoulos A Floudas,et al.  Cost-effective CO2 capture based on in silico screening of zeolites and process optimization. , 2013, Physical chemistry chemical physics : PCCP.

[17]  Ehl Emile Aarts,et al.  Statistical cooling : a general approach to combinatorial optimization problems , 1985 .

[18]  M. Powell.  The BOBYQA algorithm for bound constrained optimization without derivatives , 2009 .

[19]  Nikolaos V. Sahinidis,et al.  Global optimization of mixed-integer nonlinear programs: A theoretical and computational study , 2004, Math. Program..

[20]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[21]  J D Pinter,et al.  Global Optimization in Action—Continuous and Lipschitz Optimization: Algorithms, Implementations and Applications , 2010 .

[22]  L. Biegler,et al.  Simulation and Optimization of Pressure Swing Adsorption Systems Using Reduced-Order Modeling , 2009 .

[23]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[24]  F. Tardella.  On the existence of polyhedral convex envelopes , 2004 .

[25]  Arnold Neumaier,et al.  Global Optimization by Multilevel Coordinate Search , 1999, J. Glob. Optim..

[26]  Grégory François,et al.  Dynamic Optimization of Batch Emulsion Polymerization Using MSIMPSA, a Simulated-Annealing-Based Algorithm , 2004 .

[27]  Christodoulos A. Floudas,et al.  ANTIGONE: Algorithms for coNTinuous / Integer Global Optimization of Nonlinear Equations , 2014, Journal of Global Optimization.

[28]  Christodoulos A. Floudas,et al.  Performance of convex underestimators in a branch-and-bound framework , 2016, Optim. Lett..

[29]  Claire S. Adjiman,et al.  A Rigorous Global Optimization Algorithm for Problems with Ordinary Differential Equations , 2002, J. Glob. Optim..

[30]  Ishan Bajaj,et al.  Optimal Methanol Production via Sorption-Enhanced Reaction Process , 2018, Industrial & Engineering Chemistry Research.

[31]  Robert L. Smith,et al.  Hit-and-Run Algorithms for Generating Multivariate Distributions , 1993, Math. Oper. Res..

[32]  B. Shubert.  A Sequential Method Seeking the Global Maximum of a Function , 1972 .

[33]  Ishan Bajaj,et al.  A trust region-based two phase algorithm for constrained black-box and grey-box optimization with infeasible initial point , 2017, Comput. Chem. Eng..

[34]  M. Hasan,et al.  Combined Natural Gas Separation and Storage Based on in Silico Material Screening and Process Optimization , 2018, Industrial & Engineering Chemistry Research.