Control theoretic approach to stationary iterative methods for large-scale Toeplitz-type equations

In this paper, stationary iterative methods for large-scale Toeplitz-type equations are investigated from a control theoretic point of view. We utilize spatially invariant structure of Toeplitz matrices, to avoid the curse of dimensionality arising in analysis and design of the convergence properties. Nonlinearities in the system are theoretically handled with the small gain theorem and stability analysis for Lur'e systems. This theory enables us to achieve the desired global convergence of the proposed numerical scheme. We also evaluate the efficacy of the proposed method through a numerical simulation comparison with the Broyden's method.

[1]  Shinji Wakao,et al.  Large-scale and highly accurate magnetic field analysis of magnetic shield , 2006 .

[2]  G. Strang.  A proposal for toeplitz matrix calculations , 1986 .

[3]  K. Gustafsson,et al.  API stepsize control for the numerical solution of ordinary differential equations , 1988 .

[4]  C. G. Broyden.  A Class of Methods for Solving Nonlinear Simultaneous Equations , 1965 .

[5]  W. F. Trench.  An Algorithm for the Inversion of Finite Toeplitz Matrices , 1964 .

[6]  R. Brockett.  Dynamical systems that sort lists, diagonalize matrices, and solve linear programming problems , 1991 .

[7]  W. Rudin.  Principles of mathematical analysis , 1964 .

[8]  Eric C. Kerrigan,et al.  An ISS and l-stability approach to forward error analysis of iterative numerical algorithms , 2010, 49th IEEE Conference on Decision and Control (CDC).

[9]  Paul Tseng.  Control perspectives on numerical algorithms and matrix problems , 2008, Math. Comput..

[10]  Kenji Kashima,et al.  System theory for numerical analysis , 2007, Autom..

[11]  A. Böttcher,et al.  The First Order Asymptotics of the Extreme Eigenvectors of Certain Hermitian Toeplitz Matrices , 2009 .

[12]  N. Wiener.  The Wiener RMS (Root Mean Square) Error Criterion in Filter Design and Prediction , 1949 .

[13]  J. L. Hock,et al.  An exact recursion for the composite nearest‐neighbor degeneracy for a 2×N lattice space , 1984 .

[14]  N. Levinson.  The Wiener (Root Mean Square) Error Criterion in Filter Design and Prediction , 1946 .

[15]  Robert M. Gray,et al.  Toeplitz and Circulant Matrices: A Review , 2005, Found. Trends Commun. Inf. Theory.

[16]  Raymond H. Chan,et al.  Conjugate Gradient Methods for Toeplitz Systems , 1996, SIAM Rev..

[17]  David Y. Y. Yun,et al.  Fast Solution of Toeplitz Systems of Equations and Computation of Padé Approximants , 1980, J. Algorithms.

[18]  Eugenius Kaszkurewicz,et al.  Control Perspectives on Numerical Algorithms And Matrix Problems (Advances in Design and Control) (Advances in Design and Control 10) , 2006 .

[19]  U. Helmke,et al.  Controllability of matrix eigenvalue algorithms: the inverse power method☆ , 2000 .

[20]  Eugenius Kaszkurewicz,et al.  A Control-Theoretic Approach to the Design of Zero Finding Numerical Methods , 2007, IEEE Transactions on Automatic Control.