A new class of self-scaling for quasi-newton method based on the quadratic model

Quasi-Newton method is an efficient method for solving unconstrained optimization problems. Self-scaling is one of the common approaches in the modification of the quasi-Newton method. A large variety of self-scaling of quasi-Newton methods is very well known. In this paper, based on quadratic function we derive the new self-scaling of quasi-Newton method and study the convergence property. Numerical results on the collection of problems showed the self-scaling of quasi-Newton methods which improves overall numerical performance for BFGS method.

[1]  Gonglin Yuan,et al.  The global convergence of a modified BFGS method for nonconvex functions , 2018, J. Comput. Appl. Math..

[2]  A new variants of quasi-newton equation based on the quadratic function for unconstrained optimization , 2020 .

[3]  Guoyin Li,et al.  New quasi-Newton methods for unconstrained optimization problems , 2006, Appl. Math. Comput..

[4]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[5]  Basim A. Hassan.  Development a Special Conjugate Gradient Algorithm for Solving Unconstrained Minimization Problems , 2012 .

[6]  Gonglin Yuan,et al.  Convergence analysis of a modified BFGS method on convex minimizations , 2010, Comput. Optim. Appl..

[7]  B. Hassan.  A Globally Convergence Spectral Conjugate Gradient Method for Solving Unconstrained Optimization Problems , 2013 .

[8]  Jianzhon Zhang,et al.  Properties and numerical performance of quasi-Newton methods with modified quasi-Newton equations , 2001 .

[9]  Zhiwei Qin.  The Relationships Between CG, BFGS, and Two Limited-memory Algorithms , 2007 .

[10]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[11]  Phillipp Kaestner,et al.  Linear And Nonlinear Programming , 2016 .

[12]  Xiwen Lu,et al.  Global convergence of BFGS and PRP methods under a modified weak Wolfe–Powell line search , 2017 .

[13]  Ya-Xiang Yuan,et al.  A modified BFGS algorithm for unconstrained optimization , 1991 .

[14]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[15]  L. H. Chen,et al.  A Modified Quasi-Newton Method for Structured Optimization with Partial Information on the Hessian , 2006, Comput. Optim. Appl..

[16]  Xiwen Lu,et al.  BFGS trust-region method for symmetric nonlinear equations , 2009 .

[17]  Basim A. Hassan.  A new type of quasi-newton updating formulas based on the new quasi-newton equation , 2020, Numerical Algebra, Control & Optimization.

[19]  Ya-Xiang Yuan,et al.  Optimization Theory and Methods: Nonlinear Programming , 2010 .