A New Sparsity Preserving Quasi-Newton Update for Solving Nonlinear Equations

A new quasi-Newton update is proposed based on a least relative change in the updated matrix, rather than on a least absolute change as is normally the case for quasi-Newton methods. The method corresponds to a quasi-Newton method weighted in a scale corresponding to a row scaling. The new method retains sparsity without having to include it as an affine transformation within the derivation. Unlike Broyden's and Schubert's methods, the method is scale-invariant. Comparisons are made on a set of problems that show promising results for the new method.

[1]  R. Schnabel,et al.  Least Change Secant Updates for Quasi-Newton Methods , 1978 .

[2]  E. Marwil,et al.  Convergence Results for Schubert’s Method for Solving Sparse Nonlinear Equations , 1979 .

[3]  I.D.L. Bogle,et al.  Sparse Newton-like methods in equation oriented flowsheeting , 1988 .

[4]  M. Powell,et al.  On the Estimation of Sparse Jacobian Matrices , 1974 .

[5]  H. Markowitz.  The Elimination form of the Inverse and its Application to Linear Programming , 1957 .

[6]  Lenhart K. Schubert.  Modification of a quasi-Newton method for nonlinear equations with a sparse Jacobian , 1970 .

[7]  C. G. Broyden.  A Class of Methods for Solving Nonlinear Simultaneous Equations , 1965 .

[8]  I. D. L. Bogle.  The numerical solution of flowsheeting problems characterised by large sparse Jacobian matrices , 1983 .

[9]  Ph. L. Toint.  Numerical solution of large sets of algebraic nonlinear equations , 1986 .

[10]  Jorge J. Moré,et al.  Recent Developments in Algorithms and Software for Trust Region Methods , 1982, ISMP.

[11]  C. G. Broyden,et al.  The convergence of an algorithm for solving sparse nonlinear systems , 1971 .

[12]  J. M. Bennett.  Triangular factors of modified matrices , 1965 .

[13]  Iain S. Duff,et al.  MA28 --- A set of Fortran subroutines for sparse unsymmetric linear equations , 1980 .

[14]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[15]  Jorge R. Paloschi,et al.  Scale invariant quasi-Newton methods for the solution of nonlinear equations , 1988 .