A constrained, globalized, and bounded Nelder–Mead method for engineering optimization

One of the fundamental difficulties in engineering design is the multiplicity of local solutions. This has triggered much effort in the development of global search algorithms. Globality, however, often has a prohibitively high numerical cost for real problems. A fixed cost local search, which sequentially becomes global, is developed in this work. Globalization is achieved by probabilistic restarts. A spacial probability of starting a local search is built based on past searches. An improved Nelder–Mead algorithm is the local optimizer. It accounts for variable bounds and nonlinear inequality constraints. It is additionally made more robust by reinitializing degenerated simplexes. The resulting method, called the Globalized Bounded Nelder–Mead (GBNM) algorithm, is particularly adapted to tackling multimodal, discontinuous, constrained optimization problems, for which it is uncertain that a global optimization can be afforded. Numerical experiments are given on two analytical test functions and two composite laminate design problems. The GBNM method compares favorably with an evolutionary algorithm, both in terms of numerical cost and accuracy.

[1]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[2]  R. Haftka,et al.  Elements of Structural Optimization , 1984 .

[3]  David K. Smith,et al.  Mathematical Programming: Theory and Algorithms , 1986 .

[4]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[5]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[6]  Gilbert Syswerda,et al.  A Study of Reproduction in Generational and Steady State Genetic Algorithms , 1990, FOGA.

[7]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[8]  Margaret H. Wright,et al.  Direct search methods: Once scorned, now respectable , 1996 .

[9]  Jacob Barhen,et al.  TRUST: A deterministic algorithm for global optimization , 1997 .

[10]  Y. Yaxiang,et al.  A Simple Multistart Algorithm for Global Optimization , 1997 .

[11]  D. Fogel Evolutionary algorithms in theory and practice , 1997, Complex..

[12]  D. Tominaga,et al.  Nonlinear numerical optimization with use of a hybrid Genetic Algorithm incorporating the Modified Powell method , 1998 .

[13]  David E. Goldberg,et al.  Optimizing Global-Local Search Hybrids , 1999, GECCO.

[14]  J. Alliot,et al.  A combined nelder-mead simplex and genetic algorithm , 1999 .

[15]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[16]  J. Berthelot,et al.  Composite Materials: Mechanical Behavior and Structural Analysis , 1999 .

[17]  Markus P. J. Fromherz,et al.  Toward Adaptive Cooperation between Global and Local Solvers for Continuous Constraint Problems , 2001 .

[18]  Rodolphe Le Riche,et al.  Dual Evolutionary Optimization , 2001, Artificial Evolution.