A Theoretical and Experimental Study of the Symmetric Rank-One Update
暂无分享,去创建一个
This paper first discusses computational experience using the SRi update in conventional line search and trust region algorithms for unconstrained optimization. The experiments show that the SRi is very competitive with the widely used BFGS method. They also indicate two interesting features: the final Hessian approximations produced by the SRi method are not generally appreciably better than those produced by the BFGS, and the sequences of steps produced by the SRi do not usually seem to have the “uniform linear independence” property that is assumed in recent convergence analysis. This paper presents a new analysis that shows that the SRi method with a line search is $( n + 1)$-step q-superlinearly convergent without the assumption of linearly independent iterates. This analysis assumes that the Hessian approximations are positive definite and bounded asymptotically, which, from computational experience, are reasonable assumptions.
[1] Richard H. Byrd,et al. A Theoretical and Experimental Study of the Symmetric Rank One Update ; CU-CS-489-90 , 1990 .
[2] Jorge J. Moré,et al. Testing Unconstrained Optimization Software , 1981, TOMS.
[3] Renpu Ge,et al. The convergence of variable metric matrices in unconstrained optimization , 1983, Math. Program..