The method called Arnoldi is currently a very popular method to solve largescale eigenvalue problems. The general purpose of this paper is to generalize Arnoldi to the characteristic equation of a delay-differential equation (DDE), here called a delay eigenvalue problem. The DDE can equivalently be expressed with a linear infinite dimensional operator which eigenvalues are the solutions to the delay eigenvalue problem. A common approach to solve the delay eigenvalue problem is to discretize the operator and compute the eigenvalues of a standard or generalized eigenvalue problem. We derive a new method by applying Arnoldi to the generalized eigenvalue problem associated with a spectral discretization of the operator. It turns out that the structure of the problem can be heavily exploited and we derive an efficient matrix vector product. More importantly, the structure is such that if the Arnoldi scheme is started in an appropriate way, it is mathematically equivalent to an Arnoldi scheme with an infinite matrix, corresponding to the limit where we have an infinite number of discretization points. The resulting method is a scheme where we expand a subspace, not only in the traditional way done in Arnoldi, but the subspace vectors are also expanded with one block of rows in each iteration. In this way, the number of discretization points increases with the number of Arnoldi iterations such that the number of discretization points does not have to be fixed before the iteration starts. It turns out that there is a complete equivalence between the presented method and Arnoldi applied in the setting of the infinite dimensional operator. More precisely, we show that if the functions space on which the operator acts is equipped with an appropriate scalar product, the vectors in the Arnoldi iteration can be interpreted as the coefficients in a Chebyshev expansion of a function, and the Hessenberg matrix produced by the presented method and the standard Arnoldi scheme applied to the linear infinite dimensional operator are equal. AN ARNOLDI LIKE METHOD FOR THE DELAY EIGENVALUE PROBLEM ELIAS JARLEBRING , KARL MEERBERGEN , AND WIM MICHIELS∗ Abstract. The method called Arnoldi is currently a very popular method to solve large-scale eigenvalue problems. The general purpose of this paper is to generalize Arnoldi to the characteristic equation of a delay-differential equation (DDE), here called a delay eigenvalue problem. The DDE can equivalently be expressed with a linear infinite dimensional operator which eigenvalues are the solutions to the delay eigenvalue problem. A common approach to solve the delay eigenvalue problem is to discretize the operator and compute the eigenvalues of a standard or generalized eigenvalue problem. We derive a new method by applying Arnoldi to the generalized eigenvalue problem associated with a spectral discretization of the operator. It turns out that the structure of the problem can be heavily exploited and we derive an efficient matrix vector product. More importantly, the structure is such that if the Arnoldi scheme is started in an appropriate way, it is mathematically equivalent to an Arnoldi scheme with an infinite matrix, corresponding to the limit where we have an infinite number of discretization points. The resulting method is a scheme where we expand a subspace, not only in the traditional way done in Arnoldi, but the subspace vectors are also expanded with one block of rows in each iteration. In this way, the number of discretization points increases with the number of Arnoldi iterations such that the number of discretization points does not have to be fixed before the iteration starts. It turns out that there is a complete equivalence between the presented method and Arnoldi applied in the setting of the infinite dimensional operator. More precisely, we show that if the functions space on which the operator acts is equipped with an appropriate scalar product, the vectors in the Arnoldi iteration can be interpreted as the coefficients in a Chebyshev expansion of a function, and the Hessenberg matrix produced by the presented method and the standard Arnoldi scheme applied to the linear infinite dimensional operator are equal. The method called Arnoldi is currently a very popular method to solve large-scale eigenvalue problems. The general purpose of this paper is to generalize Arnoldi to the characteristic equation of a delay-differential equation (DDE), here called a delay eigenvalue problem. The DDE can equivalently be expressed with a linear infinite dimensional operator which eigenvalues are the solutions to the delay eigenvalue problem. A common approach to solve the delay eigenvalue problem is to discretize the operator and compute the eigenvalues of a standard or generalized eigenvalue problem. We derive a new method by applying Arnoldi to the generalized eigenvalue problem associated with a spectral discretization of the operator. It turns out that the structure of the problem can be heavily exploited and we derive an efficient matrix vector product. More importantly, the structure is such that if the Arnoldi scheme is started in an appropriate way, it is mathematically equivalent to an Arnoldi scheme with an infinite matrix, corresponding to the limit where we have an infinite number of discretization points. The resulting method is a scheme where we expand a subspace, not only in the traditional way done in Arnoldi, but the subspace vectors are also expanded with one block of rows in each iteration. In this way, the number of discretization points increases with the number of Arnoldi iterations such that the number of discretization points does not have to be fixed before the iteration starts. It turns out that there is a complete equivalence between the presented method and Arnoldi applied in the setting of the infinite dimensional operator. More precisely, we show that if the functions space on which the operator acts is equipped with an appropriate scalar product, the vectors in the Arnoldi iteration can be interpreted as the coefficients in a Chebyshev expansion of a function, and the Hessenberg matrix produced by the presented method and the standard Arnoldi scheme applied to the linear infinite dimensional operator are equal.
[1]
Patrick Amestoy,et al.
A Fully Asynchronous Multifrontal Solver Using Distributed Dynamic Scheduling
,
2001,
SIAM J. Matrix Anal. Appl..
[2]
Karl Meerbergen,et al.
The Quadratic Arnoldi Method for the Solution of the Quadratic Eigenvalue Problem
,
2008,
SIAM J. Matrix Anal. Appl..
[3]
Olaf Schenk,et al.
Solving unsymmetric sparse systems of linear equations with PARDISO
,
2002,
Future Gener. Comput. Syst..
[4]
Dirk Roose,et al.
Numerical bifurcation analysis of delay differential equations using DDE-BIFTOOL
,
2002,
TOMS.
[5]
V. Mehrmann,et al.
Nonlinear eigenvalue problems: a challenge for modern eigenvalue methods
,
2004
.
[6]
Zhaojun Bai,et al.
SOAR: A Second-order Arnoldi Method for the Solution of the Quadratic Eigenvalue Problem
,
2005,
SIAM J. Matrix Anal. Appl..
[7]
H. Voss.
An Arnoldi Method for Nonlinear Eigenvalue Problems
,
2004
.
[8]
Axel Ruhe,et al.
Rational Krylov: A Practical Algorithm for Large Sparse Nonsymmetric Matrix Pencils
,
1998,
SIAM J. Sci. Comput..
[9]
P. Lancaster,et al.
Linearization of matrix polynomials expressed in polynomial bases
,
2008
.
[10]
Timothy A. Davis,et al.
Algorithm 832: UMFPACK V4.3---an unsymmetric-pattern multifrontal method
,
2004,
TOMS.
[11]
Lloyd N. Trefethen,et al.
An Extension of MATLAB to Continuous Functions and Operators
,
2004,
SIAM J. Sci. Comput..
[12]
Axel Ruhe.
ALGORITHMS FOR THE NONLINEAR EIGENVALUE PROBLEM
,
1973
.
[13]
Peter Lancaster,et al.
Lambda-matrices and vibrating systems
,
2002
.
[14]
L. Trefethen.
Spectral Methods in MATLAB
,
2000
.
[15]
Chao Yang,et al.
ARPACK users' guide - solution of large-scale eigenvalue problems with implicitly restarted Arnoldi methods
,
1998,
Software, environments, tools.
[16]
W. Arnoldi.
The principle of minimized iterations in the solution of the matrix eigenvalue problem
,
1951
.
[17]
Jack Dongarra,et al.
Templates for the Solution of Algebraic Eigenvalue Problems
,
2000,
Software, environments, tools.
[18]
Tomás Vyhlídal,et al.
Mapping Based Algorithm for Large-Scale Computation of Quasi-Polynomial Zeros
,
2009,
IEEE Transactions on Automatic Control.
[19]
Dimitri Breda,et al.
Pseudospectral Differencing Methods for Characteristic Roots of Delay Differential Equations
,
2005,
SIAM J. Sci. Comput..
[20]
E. Jarlebring.
The spectrum of delay-differential equations: numerical methods, stability and perturbation
,
2008
.
[21]
Danny C. Sorensen,et al.
Implicit Application of Polynomial Filters in a k-Step Arnoldi Method
,
1992,
SIAM J. Matrix Anal. Appl..
[22]
Stefano Maset,et al.
Numerical solution of constant coefficient linear delay differential equations as abstract Cauchy problems
,
2000,
Numerische Mathematik.
[23]
G. Samaey,et al.
DDE-BIFTOOL v. 2.00: a Matlab package for bifurcation analysis of delay differential equations
,
2001
.
[24]
Timo Betcke,et al.
A Jacobi-Davidson-type projection method for nonlinear eigenvalue problems
,
2004,
Future Gener. Comput. Syst..
[25]
Kathrin Schreiber,et al.
Nonlinear Eigenvalue Problems: Newton-type Methods and Nonlinear Rayleigh Functionals
,
2008
.
[26]
Dirk Roose,et al.
Efficient computation of characteristic roots of delay differential equations using LMS methods
,
2008
.
[27]
Wim Michiels,et al.
An Arnoldi method with structured starting vectors for the delay eigenvalue problem
,
2010
.
[28]
Danny C. Sorensen,et al.
Deflation Techniques for an Implicitly Restarted Arnoldi Iteration
,
1996,
SIAM J. Matrix Anal. Appl..
[29]
Jianhong Wu.
Theory and Applications of Partial Functional Differential Equations
,
1996
.
[30]
Daniel Kressner,et al.
A block Newton method for nonlinear eigenvalue problems
,
2009,
Numerische Mathematik.
[31]
Volker Mehrmann,et al.
Vector Spaces of Linearizations for Matrix Polynomials
,
2006,
SIAM J. Matrix Anal. Appl..
[32]
Dimitri Breda,et al.
Solution operator approximations for characteristic roots of delay differential equations
,
2006
.
[33]
Arno B. J. Kuijlaars,et al.
Convergence Analysis of Krylov Subspace Iterations with Methods from Potential Theory
,
2006,
SIAM Rev..
[34]
S. Niculescu,et al.
Stability and Stabilization of Time-Delay Systems: An Eigenvalue-Based Approach
,
2007
.
[35]
D. Breda,et al.
Numerical approximation of characteristic values of partial retarded functional differential equations
,
2009,
Numerische Mathematik.
[36]
R. Vermiglio,et al.
Pseudospectral approximation of eigenvalues of derivative operators with non-local boundary conditions
,
2006
.
[37]
James Demmel,et al.
A Supernodal Approach to Sparse Partial Pivoting
,
1999,
SIAM J. Matrix Anal. Appl..
[38]
A. Neumaier.
RESIDUAL INVERSE ITERATION FOR THE NONLINEAR EIGENVALUE PROBLEM
,
1985
.
[39]
D. Sorensen.
Numerical methods for large eigenvalue problems
,
2002,
Acta Numerica.
[40]
Elias Jarlebring.
spectrum of delay-differential equationsThe : numerical methods, stability and perturbation
,
2008
.