Optimal interpolation-based model reduction

This dissertation is devoted to the development and study of new techniques in the field of model reduction for large-scale linear time-invariant (LTI) dynamical systems. The behavior of processes in electrical networks, mechanics, aeronautics, civil engineering, micro-electro-mechanical-systems, weather prediction and many others can be described by mathematical models. Such models are usually determined by suitable systems of partial differential equations. Their linearization and discretization by means of finite element or finite difference methods lead to high-dimensional systems of linear ordinary differential or difference equations. The number of resulting equations depends on the quality of the discretization and is typically very large. It can easily reach a few millions. Model reduction methods can then be helpful as they provide automatic processes which construct a reduced order system of the same form but of lower complexity, whose input-output behavior approximates the behavior of the original system. Most of the current methods are designed for approximating asymptotically stable systems. However, some processes such as weather development are unstable. A standard approach to reduce the order of an unstable system is to divide the system into a completely stable and completely unstable subsystems and then apply model reduction only to the stable part. This approach does not always give a satisfactory result. In contrast, in this thesis new interpolation-based methods are proposed that aim to compute an optimal reduced-order model for stable as well as for unstable systems. For these optimization problems tangential interpolation-based first order necessary optimality conditions are derived. On the basis of the established theory, a MIMO (multiple-input-multiple-output) Iterative Rational Interpolation Algorithm (MIRIAm) is proposed which, if it converges, provides a reduced-order system that satisfies the aforementioned first order necessary conditions. For asymptotically stable systems several different sets of the first order necessary optimality conditions have already been developed. Among them, the gramian-based conditions given by Wilson and Hyland-Bernstein are of special interest. In this thesis a generalization of these conditions to unstable continuous-time and discrete-time LTI dynamical systems is introduced and shown to be equivalent to the tangential interpolation-based first order necessary conditions. The major drawback of the gramian-based approach is its high computational cost caused by the need for solving two large Lyapunov equations for continuous-time systems and of two Stein equations for discrete-time systems in each iteration. The complexity of the tangential interpolation-based approach (MIRIAm), introduced in this thesis, is much smaller. In numerical experiments using an example of the CD player, the accuracy of the new method is illustrated and compared with other existing methods. The benefit of the new approach to model order reduction of unstable systems is also demonstrated in several numerical experiments with shallow water test models. In case of systems with large number of small unstable poles, the method is shown to be significantly better than the currently used approach based on the decomposition of the system into stable and unstable part.

[1]  Paul Van Dooren,et al.  A rational Lanczos algorithm for model reduction , 1996, Numerical Algorithms.

[2]  Yoram Halevi,et al.  Frequency weighted model reduction via optimal projection , 1992 .

[3]  Ulrike Baur,et al.  Control-Oriented Model Reduction for Parabolic Systems , 2008 .

[4]  Eduardo D. Sontag,et al.  Mathematical control theory: deterministic systems , 1990 .

[5]  E. Davison,et al.  On "A method for simplifying linear dynamic systems" , 1966 .

[6]  Zhaojun Bai,et al.  A partial Padé-via-Lanczos method for reduced-order modeling , 2001 .

[7]  Jing-Rebecca Li Model reduction of large linear systems via low rank system gramians , 2000 .

[8]  L. Meier,et al.  Approximation of linear constant systems , 1967, IEEE Transactions on Automatic Control.

[9]  Paul Van Dooren,et al.  Model reduction of state space systems via an implicitly restarted Lanczos method , 1996, Numerical Algorithms.

[10]  Serkan Gugercin,et al.  H2 Model Reduction for Large-Scale Linear Dynamical Systems , 2008, SIAM J. Matrix Anal. Appl..

[11]  James Rovnyak,et al.  Topics in Hardy Classes and Univalent Functions , 1994 .

[12]  D. Bernstein,et al.  The optimal projection equations for model reduction and the relationships among the methods of Wilson, Skelton, and Moore , 1985 .

[13]  Yimin Wei,et al.  Model-order reduction of large-scale second-order MIMO dynamical systems via a block second-order Arnoldi method , 2007, Int. J. Comput. Math..

[14]  James Lam,et al.  An approximate approach to H2 optimal model reduction , 1999, IEEE Trans. Autom. Control..

[15]  GrimmeIntel CorporationSanta Clara On Some Recent Developments in Projection-based Model Reduction , 1998 .

[16]  Eric James Grimme,et al.  Krylov Projection Methods for Model Reduction , 1997 .

[17]  A. Antoulas,et al.  H 2 Model Reduction for Large-scale Linear Dynamical Systems * , 2022 .

[18]  B. Moore Principal component analysis in linear systems: Controllability, observability, and model reduction , 1981 .

[19]  Martine Olivi,et al.  Identification and rational L2 approximation A gradient algorithm , 1991, Autom..

[20]  Roland W. Freund,et al.  A Lanczos-type method for multiple starting vectors , 2000, Math. Comput..

[21]  C. Lanczos An iteration method for the solution of the eigenvalue problem of linear differential and integral operators , 1950 .

[22]  James Demmel,et al.  Structured and parameter-dependent eigensolvers for simulation-based design of resonant mems , 2006 .

[23]  Zhaojun Bai,et al.  Structure-Preserving Model Reduction , 2004, PARA.

[24]  Peter Benner,et al.  Passivity preserving model reduction via a structured Lanczos method , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[25]  P. Astrid,et al.  Reduction of process simulation models : a proper orthogonal decomposition approach , 2004 .

[26]  Sheldon X.-D. Tan,et al.  Advanced Model Order Reduction Techniques in VLSI Design , 2007 .

[27]  P. Dooren,et al.  Asymptotic Waveform Evaluation via a Lanczos Method , 1994 .

[28]  K. Olsson,et al.  Model Order Reduction with Rational Krylov Methods , 2005 .

[29]  Roy M. Howard,et al.  Linear System Theory , 1992 .

[30]  Yiran Chen,et al.  Model reduction in the time-domain using Laguerre polynomials and Krylov methods , 2002, Proceedings 2002 Design, Automation and Test in Europe Conference and Exhibition.

[31]  B. Lohmann,et al.  Structure Preserving Order Reduction of Large Scale Second Order Systems , 2004 .

[32]  P. Benner,et al.  Singular perturbation approximation of large, dense linear systems , 2000, CACSD. Conference Proceedings. IEEE International Symposium on Computer-Aided Control System Design (Cat. No.00TH8537).

[33]  M Maarten Steinbuch,et al.  Iterative model and controller reduction using closed-loop balancing, with application to a Compact Disc mechanism , 1999 .

[34]  L. LITZ,et al.  Praktische Ergebnisse mit einem neuen modalen Verfahren zur Ordnungsreduktion/ Practical results by a new modal method of order reduction , 1979 .

[35]  D. Wilson,et al.  A new algorithm for optimal reduction of multivariable systems , 1980 .

[36]  Z. Bai Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems , 2002 .

[37]  Diederich Hinrichsen,et al.  Mathematical Systems Theory I , 2006, IEEE Transactions on Automatic Control.

[38]  Thilo Penzl,et al.  A Cyclic Low-Rank Smith Method for Large Sparse Lyapunov Equations , 1998, SIAM J. Sci. Comput..

[39]  A. Bunse-Gerstner,et al.  Zentrum für Technomathematik Fachbereich 3 – Mathematik und Informatik Equivalences between necessary optimality conditions for H 2-norm optimal model reduction , 2008 .

[40]  R. Freund Krylov-subspace methods for reduced-order modeling in circuit simulation , 2000 .

[41]  Peter Benner,et al.  Factorized Solution of Lyapunov Equations Based on Hierarchical Matrix Arithmetic , 2006, Computing.

[42]  P. Duren Theory of Hp Spaces , 2000 .

[43]  Antoine Vandendorpe,et al.  Model reduction of linear systems : an interpolation point of view/ , 2004 .

[44]  S. Liberty,et al.  Linear Systems , 2010, Scientific Parallel Computing.

[45]  Zu-Qing Qu,et al.  Model Order Reduction Techniques with Applications in Finite Element Analysis , 2004 .

[46]  D. Wilson,et al.  Model reduction for multivariable systems , 1974 .

[47]  D. Sorensen,et al.  A Survey of Model Reduction Methods for Large-Scale Systems , 2000 .

[48]  Huipin Zhang Krylov Subspace Methods and Applications to System and Control Problems , 2007 .

[49]  Tuyen V. Nguyen,et al.  Multipoint Pade approximation using a rational block Lanczos algorithm , 1997, 1997 Proceedings of IEEE International Conference on Computer Aided Design (ICCAD).

[50]  D. Hinrichsen,et al.  Mathematical Systems Theory I: Modelling, State Space Analysis, Stability and Robustness , 2010 .

[51]  Serkan Gugercin,et al.  Projection methods for model reduction of large-scale dynamical systems , 2003 .

[52]  Daniel Boley,et al.  Numerical Methods for Linear Control Systems , 1994 .

[53]  John H. Mathews,et al.  Complex analysis for mathematics and engineering , 1995 .

[54]  M. Nimchek Banach spaces of analytic functions , 1996 .

[55]  Michel Nakhla,et al.  Asymptotic waveform Evaluation , 1994 .

[56]  Paul Van Dooren,et al.  Model Reduction of MIMO Systems via Tangential Interpolation , 2005, SIAM J. Matrix Anal. Appl..

[57]  Cheng-Kok Koh,et al.  Efficient approximate balanced truncation of general large-scale RLC systems via Krylov methods , 2002, Proceedings of ASP-DAC/VLSI Design 2002. 7th Asia and South Pacific Design Automation Conference and 15h International Conference on VLSI Design.

[58]  P. Duren Theory of H[p] spaces , 1970 .

[59]  Tatjana Stykel,et al.  Rational interpolation , minimal realization and model reduction , 2007 .

[60]  Laurent Baratchart,et al.  Existence and Generic Properties of L2 Approximants for Linear Systems , 1986 .

[61]  B. Lohmann,et al.  Order reduction of large scale second-order systems using Krylov subspace methods , 2006 .

[62]  Angelika Bunse-Gerstner,et al.  h2-norm optimal model reduction for large scale discrete dynamical MIMO systems , 2010, J. Comput. Appl. Math..

[63]  P. V. Doorenb,et al.  Sylvester equations and projection-based model reduction , 2003 .

[64]  Stephen P. Boyd,et al.  Subharmonic functions and performance bounds on linear time-invariant feedback systems , 1984, The 23rd IEEE Conference on Decision and Control.

[65]  P. Koosis Introduction to H[p] spaces , 1999 .

[66]  P. Dooren,et al.  Model reduction of second order systems , 2005 .

[67]  Roland W. Freund,et al.  Reduced-Order Modeling of Large Linear Subcircuits via a Block Lanczos Algorithm , 1995, 32nd Design Automation Conference.

[68]  P. Benner,et al.  Solving large-scale control problems , 2004, IEEE Control Systems.

[69]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[70]  Serkan Gugercin,et al.  Rational Krylov methods for optimal ℒ2 model reduction , 2010, 49th IEEE Conference on Decision and Control (CDC).

[71]  R. Freund Model reduction methods based on Krylov subspaces , 2003, Acta Numerica.

[72]  Peter Benner,et al.  Dimension Reduction of Large-Scale Systems , 2005 .

[73]  Yunkai Zhou Numerical methods for large scale matrix equations with applications in LTI system model reduction , 2002 .

[74]  Peter Benner,et al.  Numerical Linear Algebra for Model Reduction in Control and Simulation , 2006 .

[75]  Lawrence T. Pileggi,et al.  Asymptotic waveform evaluation for timing analysis , 1990, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[76]  Sabine Van Huffel,et al.  The numerics in control network NICONET , 1998 .

[77]  R. Skelton,et al.  Covariance Equivalent Realizations with Application to Model Reduction of Large-Scale Systems , 1985 .

[78]  PJ Pieter Heres,et al.  Robust and Efficient Krylov Subspace Methods for Model Order Reduction , 2005 .

[79]  Athanasios C. Antoulas,et al.  Approximation of Large-Scale Dynamical Systems , 2005, Advances in Design and Control.

[80]  James Demmel,et al.  Sugar: Advancements in a 3D Multi-domain Simulation Package for MEMS , 2001 .

[81]  D. Wilson Optimum solution of model-reduction problem , 1970 .

[82]  Roland W. Freund,et al.  Efficient linear circuit analysis by Pade´ approximation via the Lanczos process , 1994, EURO-DAC '94.

[83]  Caroline Böß Using model reduction techniques within the incremental 4D-Var method , 2008 .

[84]  K. Glover All optimal Hankel-norm approximations of linear multivariable systems and their L, ∞ -error bounds† , 1984 .

[85]  Paul Van Dooren,et al.  A collection of benchmark examples for model reduction of linear time invariant dynamical systems. , 2002 .

[86]  R. Freund Reduced-Order Modeling Techniques Based on Krylov Subspaces and Their Use in Circuit Simulation , 1999 .

[87]  Paul Van Dooren,et al.  The Lanczos algorithm and Pad(cid:19)e approximations , 1995 .

[88]  W. Gragg,et al.  On the partial realization problem , 1983 .

[89]  C. Lanczos Solution of Systems of Linear Equations by Minimized Iterations1 , 1952 .

[90]  H. Padé Sur la représentation approchée d'une fonction par des fractions rationnelles , 1892 .

[91]  Zhaojun Bai,et al.  Error Estimation of the Padé Approximation of Transfer Functions via the Lanczos Process , 1998 .

[92]  Martine Olivi,et al.  Matrix Rational H 2 Approximation: A Gradient Algorithm Based on Schur Analysis , 1995 .

[93]  R. Skelton,et al.  Linear system approximation via covariance equivalent realizations , 1985 .

[94]  John T. Spanos,et al.  A new algorithm for L2 optimal model reduction , 1992, Autom..