Second-Order Convergence of Mesh-Adaptive Direct Search

Abstract: A previous analysis of second-order behavior of pattern search algorithms for unconstrained and linearly constrained minimization is extended to the more general class of mesh adaptive direct search (MADS) algorithms for general constrained optimization. Because of the ability of MADS to generate an asymptotically dense set of search directions, we are able to establish reasonable conditions under which a subsequence of MADS iterates converges to a limit point satisfying second-order necessary or sufficient optimality conditions for general set-constrained optimization problems.

[1]  Charles Audet,et al.  Analysis of Generalized Pattern Searches , 2000, SIAM J. Optim..

[2]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[3]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[4]  Chandler Davis.  THEORY OF POSITIVE LINEAR DEPENDENCE. , 1954 .

[5]  David G. Luenberger,et al.  Linear and nonlinear programming , 1984 .

[6]  Virginia Torczon,et al.  On the Convergence of Pattern Search Algorithms , 1997, SIAM J. Optim..

[7]  D. Finkel,et al.  Convergence analysis of the direct algorithm , 2004 .

[8]  J. Hiriart-Urruty,et al.  Generalized Hessian matrix and second-order optimality conditions for problems withC1,1 data , 1984 .

[9]  I. Coope,et al.  Frame Based Methods for Unconstrained Optimization , 2000 .

[10]  Charles Audet,et al.  Mesh Adaptive Direct Search Algorithms for Constrained Optimization , 2006, SIAM J. Optim..

[11]  R. Rockafellar.  Generalized Directional Derivatives and Subgradients of Nonconvex Functions , 1980, Canadian Journal of Mathematics.

[12]  J. Jahn.  Introduction to the Theory of Nonlinear Optimization , 1994 .

[13]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[14]  Charles Audet,et al.  Finding Optimal Algorithmic Parameters Using the Mesh Adaptive Direct Search Algorithm , 2004 .

[15]  Roberto Cominetti,et al.  A generalized second-order derivative in nonsmooth optimization , 1990 .

[16]  Charles Audet,et al.  A Pattern Search Filter Method for Nonlinear Programming without Derivatives , 2001, SIAM J. Optim..

[17]  Robert Michael Lewis,et al.  Pattern Search Methods for Linearly Constrained Minimization , 1999, SIAM J. Optim..

[18]  C. J. Price,et al.  On the Convergence of Grid-Based Methods for Unconstrained Optimization , 2000, SIAM J. Optim..

[19]  A. J. Booker,et al.  A rigorous framework for optimization of expensive functions by surrogates , 1998 .

[20]  Charles Audet,et al.  Generalized pattern searches with derivative information , 2002, Math. Program..

[21]  Mark A. Abramson,et al.  Second-Order Behavior of Pattern Search , 2005, SIAM J. Optim..

[22]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[23]  Robert Michael Lewis,et al.  A Globally Convergent Augmented Lagrangian Pattern Search Algorithm for Optimization with General Constraints and Simple Bounds , 2002, SIAM J. Optim..