MrDIRECT: a multilevel robust DIRECT algorithm for global optimization problems

Although DIRECT global optimization algorithm quickly gets close to the basin of the optimum, it often takes much longer to refine the solution to a high degree of accuracy. This behavior of DIRECT is similar to the “smooth mode phenomenon” encountered when solving linear systems discretized from partial differential equation (PDE). In the case of PDE, this smooth mode phenomenon can be eliminated efficiently by the multigrid algorithm in which the PDE solver is applied at different levels of discretization. In this paper we adapt the multigrid approach to a robust version of DIRECT algorithm, obtaining a “multilevel” robust DIRECT (MrDIRECT) algorithm. Although additional parameters are needed, our numerical results show that MrDIRECT is insensitive to the parameters, and the parameters setting proposed in this paper performs very well on the tested sets of benchmark problems, in terms of the speed with which the global optimum is found to a high degree of accuracy.

[1]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[2]  Patrice Marcotte,et al.  An overview of bilevel optimization , 2007, Ann. Oper. Res..

[3]  Nikolaos V. Sahinidis,et al.  Derivative-free optimization: a review of algorithms and comparison of software implementations , 2013, J. Glob. Optim..

[4]  Stefano Lucidi,et al.  A partition-based global optimization algorithm , 2010, J. Glob. Optim..

[5]  D. Finkel,et al.  Convergence analysis of the direct algorithm , 2004 .

[6]  Donald R. Jones,et al.  Direct Global Optimization Algorithm , 2009, Encyclopedia of Optimization.

[7]  William L. Briggs,et al.  A multigrid tutorial, Second Edition , 2000 .

[8]  William L. Briggs,et al.  A multigrid tutorial , 1987 .

[9]  Stefan M. Wild,et al.  Benchmarking Derivative-Free Optimization Algorithms , 2009, SIAM J. Optim..

[10]  Arnold Neumaier,et al.  Global Optimization by Multilevel Coordinate Search , 1999, J. Glob. Optim..

[11]  Petr Posík,et al.  BBOB-benchmarking the DIRECT global optimization algorithm , 2009, GECCO '09.

[12]  C. T. Kelley,et al.  A Locally-Biased form of the DIRECT Algorithm , 2001, J. Glob. Optim..

[13]  Qingwei Li,et al.  A Fast Tabu Search Algorithm for the Reliable P-Median Problem , 2015 .

[14]  M. Sasena,et al.  Global optimization of problems with disconnected feasible regions via surrogate modeling , 2002 .

[15]  Nikolaos V. Sahinidis,et al.  A polyhedral branch-and-cut approach to global optimization , 2005, Math. Program..

[16]  Christodoulos A. Floudas,et al.  αBB: A global optimization method for general constrained nonconvex problems , 1995, J. Glob. Optim..

[17]  Qunfeng Liu,et al.  Global optimization by multilevel partition , 2015, J. Glob. Optim..

[18]  Julius Zilinskas,et al.  Globally-biased Disimpl algorithm for expensive global optimization , 2014, Journal of Global Optimization.

[19]  Yaroslav D. Sergeyev,et al.  Algorithm 829: Software for generation of classes of test functions with known local and global minima for global optimization , 2003, TOMS.

[20]  Sverker Holmgren,et al.  Simultaneous search for multiple QTL using the global optimization algorithm DIRECT , 2004, Bioinform..

[21]  Daniel E. Finkel,et al.  Additive Scaling and the DIRECT Algorithm , 2006, J. Glob. Optim..

[22]  Qunfeng Liu,et al.  Linear scaling and the DIRECT algorithm , 2012, Journal of Global Optimization.

[23]  Qunfeng Liu,et al.  A modified DIRECT algorithm with bilevel partition , 2014, J. Glob. Optim..

[24]  Fen Chen,et al.  Modified DIRECT Algorithm for Scaled Global Optimization Problems , 2015 .

[25]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[26]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[27]  Donald Ervin Knuth,et al.  The Art of Computer Programming , 1968 .

[28]  Stefano Lucidi,et al.  A DIRECT-based approach exploiting local minimizations for the solution of large-scale global optimization problems , 2010, Comput. Optim. Appl..

[29]  R. Horst,et al.  Global Optimization: Deterministic Approaches , 1992 .

[30]  Christodoulos A. Floudas,et al.  A review of recent advances in global optimization , 2009, J. Glob. Optim..

[31]  Daniel E. Finkel,et al.  Global optimization with the direct algorithm , 2005 .