A nonmonotone trust region method for unconstrained optimization

In this paper, we propose a nonmonotone trust region method for unconstrained optimization. Our method can be regarded as a combination of nonmonotone technique, fixed steplength and trust region method. When a trial step is not accepted, the method does not resolve the subproblem but generates a iterative point whose steplength is defined by a formula. We only allow increase in function value when trial steps are not accepted in close succession of iterations. Under mild conditions, we prove that the algorithm is global convergence and superlinear convergence. Primary numerical results are reported.

[1]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[2]  E. Michael Gertz,et al.  A quasi-Newton trust-region method , 2004, Math. Program..

[3]  Philippe L. Toint,et al.  Non-monotone trust-region algorithms for nonlinear optimization subject to convex constraints , 1997, Math. Program..

[4]  P. Gill,et al.  Combination trust-region line-search methods for unconstrained optimization , 1999 .

[5]  S. Goldfeld,et al.  Maximization by Quadratic Hill-Climbing , 1966 .

[6]  Ya-Xiang Yuan.  Advances in Nonlinear Programming , 1998 .

[7]  Xiang-Sun Zhang,et al.  A nonmonotone adaptive trust region method and its convergence , 2003 .

[8]  N. Deng,et al.  Nonmonotonic trust region algorithm , 1993 .

[9]  Detong Zhu,et al.  Nonmonotonic projected algorithm with both trust region and line search for constrained optimization , 2000 .

[10]  Jiye Han,et al.  A Nonmonotone Trust Region Method for Nonlinear Programming with Simple Bound Constraints , 2001 .

[11]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[12]  Wenyu Sun,et al.  Nonmonotone trust region method for solving optimization problems , 2004, Appl. Math. Comput..

[13]  Ya-Xiang Yuan,et al.  Optimization theory and methods , 2006 .

[14]  Jiapu Zhang,et al.  Global Convergence of Conjugate Gradient Methods without Line Search , 2001, Ann. Oper. Res..

[15]  Jie Sun,et al.  Global convergence of a two-parameter family of conjugate gradient methods without line search , 2002 .

[16]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[17]  Nicholas I. M. Gould,et al.  Trust Region Methods , 2000, MOS-SIAM Series on Optimization.