Globally convergent algorithms for solving unconstrained optimization problems

New algorithms for solving unconstrained optimization problems are presented based on the idea of combining two types of descent directions: the direction of anti-gradient and either the Newton or quasi-Newton directions. The use of latter directions allows one to improve the convergence rate. Global and superlinear convergence properties of these algorithms are established. Numerical experiments using some unconstrained test problems are reported. Also, the proposed algorithms are compared with some existing similar methods using results of experiments. This comparison demonstrates the efficiency of the proposed combined methods.

[1]  Ya-Xiang Yuan,et al.  Optimization Theory and Methods: Nonlinear Programming , 2010 .

[2]  Jisheng Kou,et al.  A third-order modification of Newton method for systems of non-linear equations , 2007, Appl. Math. Comput..

[3]  Yixun Shi,et al.  Globally Convergent Algorithms for Unconstrained Optimization , 2000, Comput. Optim. Appl..

[4]  Herbert H. H. Homeier.  A modified Newton method with cubic convergence: the multivariate case , 2004 .

[5]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[6]  Francisco Facchinei,et al.  A semismooth equation approach to the solution of nonlinear complementarity problems , 1996, Math. Program..

[7]  Xingui He,et al.  Process Neural Networks , 2010 .

[8]  Albert G. Buckley,et al.  Extending the relationship between the conjugate gradient and BFGS algorithms , 1978, Math. Program..

[9]  A. G. B U C K L E Y.  A COMBINED CONJUGATE-GRADIENT QUASI-NEWTON MINIMIZATION ALGORITHM , 2005 .

[10]  Yixun Shi,et al.  A globalization procedure for solving nonlinear systems of equations , 1996, Numerical Algorithms.

[11]  Jianke Yang,et al.  Newton-conjugate-gradient methods for solitary wave computations , 2009, J. Comput. Phys..

[12]  T. N. Grapsa,et al.  Improved Newton's method without direct function evaluations , 2009 .

[13]  W. Leong,et al.  A Switching Criterion in Hybrid Quasi-NewtonBFGS - Steepest Descent Direction , 1999 .

[14]  WeiWang,et al.  A REVISED CONJUGATE GRADIENT PROJECTION ALGORITHM FOR INEQUALITY CONSTRAINED OPTIMIZATIONS , 2005 .

[15]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[16]  Jafar Biazar,et al.  A Modification on Newton's Method for Solving Systems of Nonlinear Equations , 2009 .

[17]  Yixun Shi.  Modified Quasi-Newton Methods for Solving Systems of Linear Equations , 2007 .