Quasi-Newton preconditioners for the inexact Newton method.

In this paper preconditioners for solving the linear systems of the Newton method in each nonlinear iteration are studied. In particular, we define a sequence of preconditioners built by means of Broyden-type rank-one updates. Optimality conditions are derived which guarantee that the preconditioned matrices are not far from the identity in a matrix norm. Some notes on the implementation of the corresponding inexact Newton method are given and some numerical results on two model problems illustrate the application of the proposed preconditioners.

[1]  J. J. Moré,et al.  Quasi-Newton Methods, Motivation and Theory , 1974 .

[2]  J. Meijerink,et al.  An iterative solution method for linear systems of which the coefficient matrix is a symmetric -matrix , 1977 .

[3]  H. Walker.  Quasi-Newton Methods , 1978 .

[4]  R. Dembo,et al.  INEXACT NEWTON METHODS , 1982 .

[5]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[6]  C. Kelley.  Iterative Methods for Linear and Nonlinear Equations , 1987 .

[7]  Jorge Nocedal,et al.  A Numerical Study of the Limited Memory BFGS Method and the Truncated-Newton Method for Large Scale Optimization , 1991, SIAM J. Optim..

[8]  Henk A. van der Vorst,et al.  Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems , 1992, SIAM J. Sci. Comput..

[9]  J. M. Martínez,et al.  A theory of secant preconditioners , 1993 .

[10]  L. Kolotilina,et al.  Factorized Sparse Approximate Inverse Preconditionings I. Theory , 1993, SIAM J. Matrix Anal. Appl..

[11]  Yousef Saad,et al.  ILUT: A dual threshold incomplete LU factorization , 1994, Numer. Linear Algebra Appl..

[12]  José Mario Martínez,et al.  An extension of the theory of secant preconditioners , 1995 .

[13]  Homer F. Walker,et al.  Choosing the Forcing Terms in an Inexact Newton Method , 1996, SIAM J. Sci. Comput..

[14]  Danny C. Sorensen,et al.  Deflation Techniques for an Implicitly Restarted Arnoldi Iteration , 1996, SIAM J. Matrix Anal. Appl..

[15]  Michele Benzi,et al.  A Sparse Approximate Inverse Preconditioner for Nonsymmetric Linear Systems , 1998, SIAM J. Sci. Comput..

[16]  Gerard L. G. Sleijpen,et al.  Accelerated Inexact Newton Schemes for Large Systems of Nonlinear Equations , 1998, SIAM J. Sci. Comput..

[17]  Stephen J. Wright,et al.  Quasi-Newton Methods , 1999 .

[18]  M. Benzi,et al.  A comparative study of sparse approximate inverse preconditioners , 1999 .

[19]  M. Benzi,et al.  A Two-Level Parallel Preconditioner Based on Sparse Approximate Inverses , 1999 .

[20]  Jorge Nocedal,et al.  Automatic Preconditioning by Limited Memory Quasi-Newton Updating , 1999, SIAM J. Optim..

[21]  Luca Bergamaschi,et al.  Parallel Acceleration of Krylov Solvers by Factorized Approximate Inverse Preconditioners , 2004, VECPAR.

[22]  M. Tuma,et al.  Preconditioner Updates for Solving Sequences of Large and Sparse Nonsymmetric Linear Systems , 2005 .