Global convergence of the nonmonotone MBFGS method for nonconvex unconstrained minimization

In this paper, we propose a new nonmonotone Armijo type line search and prove that the MBFGS method proposed by Li and Fukushima with this new line search converges globally for nonconvex minimization. Some numerical experiments show that this nonmonotone MBFGS method is efficient for the given test problems.

[1]  Stefano Lucidi,et al.  Curvilinear Stabilization Techniques for Truncated Newton Methods in Large Scale Unconstrained Optimization , 1998, SIAM J. Optim..

[2]  Yu-Hong Dai,et al.  Convergence Properties of the BFGS Algoritm , 2002, SIAM J. Optim..

[3]  A. Tits,et al.  Avoiding the Maratos effect by means of a nonmonotone line search I. general constrained problems , 1991 .

[4]  William W. Hager,et al.  A Nonmonotone Line Search Technique and Its Application to Unconstrained Optimization , 2004, SIAM J. Optim..

[5]  Defeng Sun,et al.  Global convergece of the bfgs algorithm with nonmonotone linesearch ∗ ∗this work is supported by national natural science foundation$ef: , 1995 .

[6]  L. Grippo,et al.  A truncated Newton method with nonmonotone line search for unconstrained optimization , 1989 .

[7]  Philippe L. Toint,et al.  An Assessment of Nonmonotone Linesearch Techniques for Unconstrained Optimization , 1996, SIAM J. Sci. Comput..

[8]  DaiYuhong,et al.  A NONMONOTONE CONJUGATE GRADIENT ALGORITHM FOR UNCONSTRAINED OPTIMIZATION , 2002 .

[9]  Yuhong Dai.  On the Nonmonotone Line Search , 2002 .

[10]  Walter F. Mascarenhas,et al.  The BFGS method with exact line searches fails for non-convex objective functions , 2004, Math. Program..

[11]  Philippe L. Toint,et al.  Non-monotone trust-region algorithms for nonlinear optimization subject to convex constraints , 1997, Math. Program..

[12]  Guanghui Liu,et al.  Global Convergence Analysis of a New Nonmonotone BFGS Algorithm on Convex Objective Functions , 1997, Comput. Optim. Appl..

[13]  M. Fukushima,et al.  A modified BFGS method and its global convergence in nonconvex minimization , 2001 .

[14]  J. Nocedal,et al.  A tool for the analysis of Quasi-Newton methods with application to unconstrained minimization , 1989 .

[15]  Lixing Han,et al.  A Class of Nonmonotone Conjugate Gradient Methods for Unconstrained Optimization , 1999 .

[16]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[17]  Marcos Raydan,et al.  The Barzilai and Borwein Gradient Method for the Large Scale Unconstrained Minimization Problem , 1997, SIAM J. Optim..

[18]  Guanghui Liu,et al.  Convergence of the Nonmonotone Perry and Shanno Method for Optimization , 2000, Comput. Optim. Appl..

[19]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.