An ODE-Based Trust Region Filter Algorithm for Unconstrained Optimization

In this article, an ODE-based trust region filter algorithm for unconstrained optimization is proposed. It can be regarded as a combination of trust region and filter techniques with ODE-based methods. Unlike the existing trust-region-filter methods and ODE-based methods, a distinct feature of this method is that at each iteration, a reduced linear system is solved to obtain a trial step, thus avoiding solving a trust region subproblem. Under some standard assumptions, it is proven that the algorithm is globally convergent. Preliminary numerical results show that the new algorithm is efficient for large scale problems.

[1]  Nicholas I. M. Gould,et al.  A Multidimensional Filter Algorithm for Nonlinear Equations and Nonlinear Least-Squares , 2004, SIAM J. Optim..

[2]  Zhenhai Liu,et al.  A derivative-free filter algorithm for nonlinear complementarity problem , 2006, Appl. Math. Comput..

[3]  Stefan Ulbrich,et al.  A globally convergent primal-dual interior-point filter method for nonlinear programming , 2004, Math. Program..

[4]  Sven Leyffer,et al.  Nonlinear programming without a penalty function , 2002, Math. Program..

[5]  Yigui Ou,et al.  A SUPERLINEARLY CONVERGENT TRUST REGION ALGORITHM FOR LC 1 CONSTRAINED OPTIMIZATION PROBLEMS , 2005 .

[6]  A superlinearly convergent ODE-type trust region algorithm for nonsmooth nonlinear equations , 2006 .

[7]  Ou Yigui.  A filter trust region method for solving semi-infinite programming problems , 2009 .

[8]  M. Bartholomew-Biggs,et al.  Some effective methods for unconstrained optimization based on the solution of systems of ordinary differential equations , 1989 .

[9]  Yan Zhang,et al.  A Nonmonotone Filter Barzilai-Borwein Method for Optimization , 2010, Asia Pac. J. Oper. Res..

[10]  P. Nie,et al.  Sequential penalty quadratic programming filter methods for nonlinear programming , 2007 .

[11]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[12]  Wenyu Sun,et al.  On filter-successive linearization methods for nonlinear semidefinite programming , 2009 .

[13]  Zhiwei Xu,et al.  The convergence of subspace trust region methods , 2009, J. Comput. Appl. Math..

[14]  Shujun Li,et al.  A new trust region filter algorithm , 2008, Appl. Math. Comput..

[15]  Nicholas I. M. Gould,et al.  A Filter-Trust-Region Method for Unconstrained Optimization , 2005, SIAM J. Optim..

[16]  Ya-Xiang Yuan,et al.  Optimization Theory and Methods: Nonlinear Programming , 2010 .

[17]  D. Pu,et al.  A nonmonotone filter trust region method for nonlinear constrained optimization , 2009 .