On the Local Convergence of Pattern Search

We examine the local convergence properties of pattern search methods, complementing the previously established global convergence properties for this class of algorithms. We show that the step-length control parameter which appears in the definition of pattern search algorithms provides a reliable asymptotic measure of first-order stationarity. This gives an analytical justification for a traditional stopping criterion for pattern search methods. Using this measure of first-order stationarity, we analyze the behavior of pattern search in the neighborhood of an isolated local minimizer. We show that a recognizable subsequence converges r-linearly to the minimizer.

[1]  Chandler Davis.  THEORY OF POSITIVE LINEAR DEPENDENCE. , 1954 .

[2]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[3]  M. J. Box,et al.  Non-linear optimization techniques; , 1969 .

[4]  R. Fletcher,et al.  Mathematical and Statistical Techniques for Industry, ICI Monograph No. 5, "Non Linear Optimization Techniques" , 1970, The Mathematical Gazette.

[5]  P. Boggs,et al.  A stability analysis for perturbed nonlinear iterative methods , 1976 .

[6]  W. Yu.  POSITIVE BASIS AND A CLASS OF DIRECT SEARCH TECHNIQUES , 1979 .

[7]  S. Nash,et al.  Linear and Nonlinear Programming , 1987 .

[8]  J. Sneddon.  Sequential simplex optimization , 1992 .

[9]  V. Torczon,et al.  RANK ORDERING AND POSITIVE BASES IN PATTERN SEARCH ALGORITHMS , 1996 .

[10]  O. SIAMJ.,et al.  ON THE CONVERGENCE OF PATTERN SEARCH ALGORITHMS , 1997 .

[11]  F. Yuan,et al.  SPONSORING / MONITORING AGENCY NAME(S) AND ADDRESS(ES) , 1999 .

[12]  Robert Michael Lewis,et al.  Pattern Search Algorithms for Bound Constrained Minimization , 1999, SIAM J. Optim..

[13]  Robert Michael Lewis,et al.  Pattern Search Methods for Linearly Constrained Minimization , 1999, SIAM J. Optim..

[14]  Adam P. Gurson,et al.  Simplex Search Behavior in Nonlinear Optimization , 2000 .

[15]  Tamara G. Kolda,et al.  Asynchronous Parallel Pattern Search for Nonlinear Optimization , 2001, SIAM J. Sci. Comput..

[16]  Robert Michael Lewis,et al.  A Globally Convergent Augmented Lagrangian Pattern Search Algorithm for Optimization with General Constraints and Simple Bounds , 2002, SIAM J. Optim..

[17]  Charles Audet,et al.  Convergence Results for Pattern Search Algorithms are Tight , 2002 .

[18]  Tamara G. Kolda,et al.  On the Convergence of Asynchronous Parallel Pattern Search , 2002, SIAM J. Optim..