A conic trust-region method and its convergence properties

In this paper we consider a conic trust-region method for unconstrained optimization problems and analyze its convergence properties. We propose a convenient curvilinear search method to approximately solve the arising conic trust-region subproblem. Note that this approximate method preserves the strong convergence properties of the exact solution methods and is easy to implement. Both the linear and superlinear convergence of the method are established under commonly used conditions. Numerical experiments are conducted to show the efficiency of the new method.

[1]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[2]  Nicholas I. M. Gould,et al.  Trust Region Methods , 2000, MOS-SIAM Series on Optimization.

[3]  M. J. D. Powell,et al.  On the global convergence of trust region algorithms for unconstrained minimization , 1984, Math. Program..

[4]  K. A. Ariyawansa,et al.  Local and Q-superlinear convergence of a class of collinear scaling algorithms that extends quasi-newton methods with broyden's bounded-⊘ class of updates† ‡ , 1992 .

[5]  J. Nocedal,et al.  A Conic Algorithm for Optimization , 1985 .

[6]  Richard H. Byrd,et al.  Approximate solution of the trust region problem by minimization over two-dimensional subspaces , 1988, Math. Program..

[7]  Ya-Xiang Yuan,et al.  A Conic Trust-Region Method for Nonlinearly Constrained Optimization , 2001, Ann. Oper. Res..

[8]  Wenyu Sun,et al.  An adaptive approach of conic trust-region method for unconstrained optimization problems , 2005 .

[9]  J. Vial,et al.  A restricted trust region algorithm for unconstrained optimization , 1985 .

[10]  Nicholas I. M. Gould,et al.  CUTE: constrained and unconstrained testing environment , 1995, TOMS.

[11]  David G. Wilson,et al.  2. Constrained Optimization , 2005 .

[12]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[13]  S. Sheng,et al.  Interpolation by conic model for unconstrained optimization , 1995, Computing.

[14]  W. Davidon.  Conic Approximations and Collinear Scalings for Optimizers , 1980 .

[15]  Ya-Xiang Yuan,et al.  Optimization theory and methods , 2006 .

[16]  Richard H. Byrd,et al.  A Family of Trust Region Based Algorithms for Unconstrained Minimization with Strong Global Convergence Properties. , 1985 .

[17]  Wenyu Sun,et al.  A trust region method for conic model to solve unconstraind optimizaions , 1996 .

[18]  M GayDavid,et al.  Algorithm 611: Subroutines for Unconstrained Minimization Using a Model/Trust-Region Approach , 1983 .

[19]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .