Multipoint secant and interpolation methods with nonmonotone line search for solving systems of nonlinear equations

Multipoint secant and interpolation methods are effective tools for solving systems of nonlinear equations. They use quasi-Newton updates for approximating the Jacobian matrix. Owing to their ability to more completely utilize the information about the Jacobian matrix gathered at the previous iterations, these methods are especially efficient in the case of expensive functions. They are known to be local and superlinearly convergent. We combine these methods with the nonmonotone line search proposed by Li and Fukushima (2000), and study global and superlinear convergence of this combination. Results of numerical experiments are presented. They indicate that the multipoint secant and interpolation methods tend to be more robust and efficient than Broyden's method globalized in the same way.

[1]  C. G. Broyden A Class of Methods for Solving Nonlinear Simultaneous Equations , 1965 .

[2]  Oleg Burdakov On properties of Newton's method for smooth and nonsmooth equations , 1995 .

[3]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[4]  Oleg Burdakov,et al.  On Superlinear Convergence of Some Stable Variants of the Secant Method , 1986 .

[5]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[6]  O. Burdakov Some globally convergent modifications of Newton's method for solving systems of nonlinear equations , 1980 .

[7]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[8]  O. Burdakov A greedy algorithm for the optimal basis problem , 1997 .

[9]  Chi-Kwong Li,et al.  Isometries for the vector (p,q) norm and the induced (p,q) norm , 1995 .

[10]  Anderas Griewank The “global” convergence of Broyden-like methods with suitable line search , 1986, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[11]  R. Schnabel,et al.  Solving Systems of Non-Linear Equations by Broyden&Apos;S Method with Projected Updates , 1977 .

[12]  Oleg Burdakov,et al.  Stable versions of the secants method for solving systems of equations , 1983 .

[13]  M. Fukushima,et al.  A derivative-free line search and global convergence of Broyden-like method for nonlinear equations , 2000 .

[14]  Oleg Burdakov,et al.  Stable multipoint secant methods with released requirements to points position , 1993, System Modelling and Optimization.