Differential equations and solution of linear systems

Abstract Many iterative processes can be interpreted as discrete dynamical systems and, in certain cases, they correspond to a time discretization of differential systems. In this paper, we propose to derive iterative schemes for solving linear systems of equations by modeling the problem to solve as a stable state of a proper differential system; the solution of the original linear problem is then computed numerically by applying a time marching scheme. We discuss some aspects of this approach, which allows to recover some known methods but also to introduce new ones. We give convergence results and numerical illustrations.

[1]  Henk A. van der Vorst,et al.  Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems , 1992, SIAM J. Sci. Comput..

[2]  M. Benzi.  Preconditioning techniques for large linear systems: a survey , 2002 .

[3]  J. Bolte,et al.  A second-order gradient-like dissipative dynamical system with Hessian-driven damping.: Application to optimization and mechanics , 2002 .

[4]  U. Helmke,et al.  Optimization and Dynamical Systems , 1994, Proceedings of the IEEE.

[5]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[6]  J. H. Hubbard,et al.  Differential equations: a dynamical systems approach. Part I: ordinary differential equations , 1991 .

[7]  Claude Brezinski.  Difference and differential equations and convergence acceleration algorithms , 2000 .

[8]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[9]  Claude Brezinski,et al.  Nonlinear hybrid procedures and fixed point iterations , 1998 .

[10]  Eugenius Kaszkurewicz,et al.  Iterative methods as dynamical systems with feedback control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[11]  Andrew M. Stuart,et al.  Numerical analysis of dynamical systems , 1994, Acta Numerica.

[12]  Annie Cuyt,et al.  Nonlinear Methods in Numerical Analysis , 1987 .

[13]  M. Hirsch,et al.  Differential Equations, Dynamical Systems, and Linear Algebra , 1974 .

[14]  Marcos Raydan,et al.  Preconditioned Spectral Gradient Method , 2002, Numerical Algorithms.

[15]  C. Brezinski.  Dynamical systems and sequence transformations , 2001 .

[16]  R. D. Murphy,et al.  Iterative solution of nonlinear equations , 1994 .

[17]  Claude Brezinski,et al.  Variations on Richardson's method and acceleration. , 1996 .

[18]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[19]  R. Freund,et al.  QMR: a quasi-minimal residual method for non-Hermitian linear systems , 1991 .

[20]  Claude Brezinski,et al.  Projection methods for systems of equations , 1997 .