Efficiency improving implementation techniques for large scale matrix equation solvers

We address the important field of large scale matrix based algorithms in control and model order reduction. Many important tools from theory and applications in systems theory have been widely ignored during the recent decades in the context of PDE constraint optimal control problems and simulation of electric circuits. Often this is due to the fact that large scale matrices are suspected to be unsolvable in large scale applications. Since around 2000 efficient low rank theory for matrix equation solvers exists for sparse and also data sparse systems. Unfortunately upto now only incomplete or experimental MATLAB® implementations of most of these solvers have existed. Here we aim on the implementation of these algorithms in a higher programming language (in our case C) that allows for a high performance solver for many matrix equations arising in the context of large scale standard and generalized state space systems. We especially focus on efficient memory saving data structures and implementation techniques as well as the shared memory parallelization of the underlying algorithms.

[1]  Timothy A. Davis,et al.  Algorithm 837: AMD, an approximate minimum degree ordering algorithm , 2004, TOMS.

[2]  K. Jbilou,et al.  Projection methods for large Lyapunov matrix equations , 2006 .

[3]  Peter Benner,et al.  Dimension Reduction of Large-Scale Systems , 2005 .

[4]  Valeria Simoncini,et al.  Convergence Analysis of Projection Methods for the Numerical Solution of Large Lyapunov Equations , 2009, SIAM J. Numer. Anal..

[5]  N.Yu. Bakaev The numerical solution of elliptic differential equations , 1986 .

[6]  Valeria Simoncini,et al.  A New Iterative Method for Solving Large-Scale Lyapunov Matrix Equations , 2007, SIAM J. Sci. Comput..

[7]  Timothy A. Davis,et al.  Direct Methods for Sparse Linear Systems (Fundamentals of Algorithms 2) , 2006 .

[8]  Peter Benner,et al.  Efficient Balancing based MOR for Second Order Systems Arising in Control of Machine Tools , 2009 .

[9]  Kirsten Morris,et al.  SOLUTION OF ALGEBRAIC RICCATI EQUATIONS ARISING IN CONTROL OF PARTIAL DIFFERENTIAL EQUATIONS , 2007 .

[10]  Michael Garland,et al.  Implementing sparse matrix-vector multiplication on throughput-oriented processors , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[11]  Lars Grasedyck,et al.  Existence of a low rank or ℋ︁‐matrix approximant to the solution of a Sylvester equation , 2004, Numer. Linear Algebra Appl..

[12]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.

[13]  Y. Saad,et al.  Numerical solution of large Lyapunov equations , 1989 .

[14]  I. Jaimoukha,et al.  Krylov subspace methods for solving large Lyapunov equations , 1994 .

[15]  Michael Garland,et al.  Efficient Sparse Matrix-Vector Multiplication on CUDA , 2008 .

[16]  Athanasios C. Antoulas,et al.  Approximation of Large-Scale Dynamical Systems , 2005, Advances in Design and Control.

[17]  J. Gilbert Predicting Structure in Sparse Matrix Computations , 1994 .

[18]  R. Triggiani,et al.  Control Theory for Partial Differential Equations: Continuous and Approximation Theories , 2000 .

[19]  D. Kleinman On an iterative technique for Riccati equation computations , 1968 .

[20]  Peter Benner,et al.  On the Parameter Selection Problem in the Newton-ADI Iteration for Large Scale Riccati Equations , 2007 .

[21]  Khalide Jbilou,et al.  ADI preconditioned Krylov methods for large Lyapunov matrix equations , 2010 .

[22]  M. Heyouni,et al.  AN EXTENDED BLOCK ARNOLDI ALGORITHM FOR LARGE-SCALE SOLUTIONS OF THE CONTINUOUS-TIME ALGEBRAIC RICCATI EQUATI ON ∗ , 2008 .

[23]  J. Gilbert,et al.  Sparse Partial Pivoting in Time Proportional to Arithmetic Operations , 1986 .

[24]  Alain Bensoussan,et al.  Representation and Control of Infinite Dimensional Systems, 2nd Edition , 2007, Systems and control.

[25]  Thilo Penzl,et al.  A Cyclic Low-Rank Smith Method for Large Sparse Lyapunov Equations , 1998, SIAM J. Sci. Comput..

[26]  Timothy A. Davis,et al.  Algorithm 832: UMFPACK V4.3---an unsymmetric-pattern multifrontal method , 2004, TOMS.

[27]  Jacob K. White,et al.  Low-Rank Solution of Lyapunov Equations , 2004, SIAM Rev..

[28]  P. Benner,et al.  Solving large-scale control problems , 2004, IEEE Control Systems.

[29]  Y. Zhou,et al.  On the decay rate of Hankel singular values and related issues , 2002, Syst. Control. Lett..

[30]  Gene H. Golub,et al.  Matrix computations , 1983 .