Model Order Reduction Based on Semidefinite Programming

The main topic of this PhD thesis is complexity reduction of linear time-invariant models. The complexity in such systems is measured by the number of differential equations forming the dynamical system. This number is called the order of the system. Order reduction is typically used as a tool to model complex systems, the simulation of which takes considerable time and/or has overwhelming memory requirements. Any model reflects an approximation of a real world system. Therefore, it is reasonable to sacrifice some model accuracy in order to obtain a simpler representation. Once a low-order model is obtained, the simulation becomes computationally cheaper, which saves time and resources. A low-order model still has to be "similar" to the full order one in some sense. There are many ways of measuring "similarity" and, typically, such a measure is chosen depending on the application. Three different settings of model order reduction were investigated in the thesis. The first one is H infinity model order reduction, i.e., the distance between two models is measured by the H infinity norm. Although, the problem has been tackled by many researchers, all the optimal solutions are yet to be found. However, there are a large number of methods, which solve suboptimal problems and deliver accurate approximations. Recently, research community has devoted more attention to large-scale systems and computationally scalable extensions of existing model reduction techniques. The algorithm developed in the thesis is based on the frequency response samples matching. For a large class of systems the computation of the frequency response samples can be done very efficiently. Therefore, the developed algorithm is relatively computationally cheap. The proposed algorithm can be seen as a computationally scalable extension to the well-known Hankel model reduction, which is known to deliver very accurate solutions. One of the reasons for such an assessment is that the relaxation employed in the proposed algorithm is tightly related to the one used in Hankel model reduction. Numerical simulations also show that the accuracy of the method is comparable to the Hankel model reduction one. The second part of the thesis is devoted to parameterized model order reduction. A parameterized model is essentially a family of models which depend on certain design parameters. The model reduction goal in this setting is to approximate the whole family of models for all values of parameters. The main motivation for such a model reduction setting is design of a model with an appropriate set of parameters. In order to make a good choice of parameters, the models need to be simulated for a large set of parameters. After inspecting the simulation results a model can be picked with suitable frequency or step responses. Parameterized model reduction significantly simplifies this procedure. The proposed algorithm for parameterized model reduction is a straightforward extension of the one described above. The proposed algorithm is applicable to linear parameter-varying systems modeling as well. Finally, the third topic is modeling interconnections of systems. In this thesis an interconnection is a collection of systems (or subsystems) connected in a typical block-diagram. In order to avoid confusion, throughout the thesis the entire model is called a supersystem, as opposed to subsystems, which a supersystem consists of. One of the specific cases of structured model reduction is controller reduction. In this problem there are two subsystems: the plant and the controller. Two directions of model reduction of interconnected systems are considered: model reduction in the nu-gap metric and structured model reduction. To some extent, using the nu-gap metric makes it possible to model subsystems without considering the supersystem at all. This property can be exploited for extremely large supersystems for which some forms of analysis (evaluating stability, computing step response, etc.) are intractable. However, a more systematic way of modeling is structured model reduction. There, the objective is to approximate certain subsystems in such a way that crucial characteristics of the given supersystem, such as stability, structure of interconnections, frequency response, are preserved. In structured model reduction all subsystems are taken into account, not only the approximated ones. In order to address structured model reduction, the supersystem is represented in a coprime factor form, where its structure also appears in coprime factors. Using this representation the problem is reduced to H infinity model reduction, which is addressed by the presented framework. All the presented methods are validated on academic or known benchmark problems. Since all the methods are based on semidefinite programming, adding new constraints is a matter of formulating a constraint as a semidefinite one. A number of extensions are presented, which illustrate the power of the approach. Properties of the methods are discussed throughout the thesis while some remaining problems conclude the manuscript. (Less)

[1]  Pierre Apkarian,et al.  Nonsmooth H∞ synthesis , 2005, IEEE Trans. Autom. Control..

[2]  Z. Bai,et al.  Parameterized model order reduction via a two-directional Arnoldi process , 2007, 2007 IEEE/ACM International Conference on Computer-Aided Design.

[3]  Jacob K. White,et al.  Automatic generation of geometrically parameterized reduced order models for integrated spiral RF-inductors , 2003, Proceedings of the 2003 IEEE International Workshop on Behavioral Modeling and Simulation.

[4]  Lawrence T. Pileggi,et al.  Parameterized interconnect order reduction with explicit-and-implicit multi-parameter moment matching for inter/intra-die variations , 2005, ICCAD-2005. IEEE/ACM International Conference on Computer-Aided Design, 2005..

[5]  G. Vinnicombe Frequency domain uncertainty and the graph topology , 1993, IEEE Trans. Autom. Control..

[6]  Jacob K. White,et al.  Algorithms in FastImp: a fast and wideband impedance extraction program for complicated 3-D geometries , 2003, Proceedings 2003. Design Automation Conference (IEEE Cat. No.03CH37451).

[7]  Johan Karlsson,et al.  Stability-Preserving Rational Approximation Subject to Interpolation Constraints , 2008, IEEE Transactions on Automatic Control.

[8]  Athanasios C. Antoulas,et al.  Approximation of Large-Scale Dynamical Systems (Advances in Design and Control) (Advances in Design and Control) , 2005 .

[9]  G. Buskes,et al.  A step-wise procedure for reduced order approximation in the ν-gap metric , 2008, 2008 47th IEEE Conference on Decision and Control.

[10]  Richard M. Murray,et al.  Feedback Systems An Introduction for Scientists and Engineers , 2007 .

[11]  Li Li,et al.  Structured coprime factor model reduction based on LMIs , 2005, Autom..

[12]  B. Moore Principal component analysis in linear systems: Controllability, observability, and model reduction , 1981 .

[13]  G. E. Colling,et al.  New Results in 2-D Systems Theory, Part II: 2-D State-Space Models-Realization and the Notions of Controllability, Observability, and Minimality , 1977 .

[14]  Pontus Giselsson Modeling and Control of a 1.45 m deformable mirror , 2006 .

[15]  Jacob K. White,et al.  Geometrically parameterized interconnect performance models for interconnect synthesis , 2002, ISPD '02.

[16]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[17]  Timo Reis,et al.  PABTEC: Passivity-Preserving Balanced Truncation for Electrical Circuits , 2010, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[18]  Hugo J. Woerdeman,et al.  Outer factorizations in one and several variables , 2004 .

[19]  Johan Löfberg,et al.  Optimization based LPV-approximation of multi-model systems , 2009, 2009 European Control Conference (ECC).

[20]  Michael Cantoni,et al.  Reduced order approximation in the ν-gap metric , 2007, 2007 46th IEEE Conference on Decision and Control.

[21]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[22]  Henrik Sandberg,et al.  Model Reduction of Interconnected Linear Systems Using Structured Gramians , 2008 .

[23]  Roland Tóth,et al.  Asymptotically optimal orthonormal basis functions for LPV system identification , 2009, Autom..

[24]  Alexandre Megretski,et al.  Convex optimization in identification of stable non-linear state space models , 2010, 49th IEEE Conference on Decision and Control (CDC).

[25]  Martine Olivi,et al.  Matrix Rational H 2 Approximation: A Gradient Algorithm Based on Schur Analysis , 1995 .

[26]  Peter S. C. Heuberger,et al.  Discrete normalized coprime factorization , 1990 .

[27]  D. Enns Model reduction with balanced realizations: An error bound and a frequency weighted generalization , 1984, The 23rd IEEE Conference on Decision and Control.

[28]  Alexandre Megretski,et al.  A Quasi-Convex Optimization Approach to Parameterized Model Order Reduction , 2005, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[29]  Alexandre Megretski,et al.  A convex parameterization of robustly stabilizing controllers , 1994, IEEE Trans. Autom. Control..

[30]  Ming-Jun Lai,et al.  Factorization of multivariate positive Laurent polynomials , 2006, J. Approx. Theory.

[31]  Sanda Lefteriu,et al.  Generating parametric models from tabulated data , 2010, Design Automation Conference.

[32]  Jan G. Korvink,et al.  Parametric model order reduction accelerated by subspace recycling , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[33]  Athanasios C. Antoulas,et al.  An overview of model reduction methods and a new result , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[34]  D. Sorensen,et al.  A Survey of Model Reduction Methods for Large-Scale Systems , 2000 .

[35]  A. Megretski H-infinity model reduction with guaranteed suboptimality bound , 2006, 2006 American Control Conference.

[36]  Olof Garpinger,et al.  Design of Robust PID Controllers with Constrained Control Signal Activity , 2009 .

[37]  Luca Daniel,et al.  Parameterized model order reduction of nonlinear dynamical systems , 2005, ICCAD-2005. IEEE/ACM International Conference on Computer-Aided Design, 2005..

[38]  Anders Rantzer,et al.  A singular value decomposition based closed loop stability preserving controller reduction method , 2010, Proceedings of the 2010 American Control Conference.

[39]  Kin Cheong Sou,et al.  Convex optimization methods for model reduction , 2008 .

[40]  Athanasios C. Antoulas,et al.  A New Approach to Modeling Multiport Systems From Frequency-Domain Data , 2010, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[41]  Boris Polyak,et al.  Mixed LMI/randomized methods for static output feedback control design , 2010, Proceedings of the 2010 American Control Conference.

[42]  M. Vidyasagar The graph metric for unstable plants and robustness estimates for feedback stability , 1982, 1982 21st IEEE Conference on Decision and Control.

[43]  T. Ting Robustness in Feedback Systems. , 1987 .

[44]  B. Wahlberg,et al.  Modelling and Identification with Rational Orthogonal Basis Functions , 2000 .

[45]  M. Ekstrom,et al.  Two-dimensional spectral factorization with applications in recursive digital filtering , 1976 .

[46]  Carolyn L. Beck,et al.  Model reduction of multidimensional and uncertain systems , 1994, IEEE Trans. Autom. Control..

[47]  Keith Glover,et al.  Robust control design using normal-ized coprime factor plant descriptions , 1989 .

[48]  K. Zhou Frequency-weighted L_∞ nomn and optimal Hankel norm model reduction , 1995 .

[49]  Anders Rantzer,et al.  Controller reduction with closed loop performance guarantee , 2010, 49th IEEE Conference on Decision and Control (CDC).

[50]  C. J. Zarowski,et al.  A state-space approach to discrete-time spectral factorization , 1992 .

[51]  Adrian S. Lewis,et al.  HIFOO - A MATLAB package for fixed-order controller design and H ∞ optimization , 2006 .

[52]  Mi-Ching Tsai,et al.  Robust and Optimal Control , 2014 .

[53]  B. Dumitrescu Positive Trigonometric Polynomials and Signal Processing Applications , 2007 .

[54]  Kin Cheong Sou,et al.  Frequency domain model reduction method for parameter-dependent systems , 2010, Proceedings of the 2010 American Control Conference.

[55]  G. Vinnicombe Uncertainty and Feedback: 8 loop-shaping and the-gap metric , 2000 .

[56]  Jacob K. White,et al.  A multiparameter moment-matching model-reduction approach for generating geometrically parameterized interconnect performance models , 2004, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[57]  T. Moselhy,et al.  pFFT in FastMaxwell: A Fast Impedance Extraction Solver for 3D Conductor Structures over Substrate , 2007, 2007 Design, Automation & Test in Europe Conference & Exhibition.

[58]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[60]  Michael Sebek,et al.  Positive polynomials and robust stabilization with fixed-order controllers , 2003, IEEE Trans. Autom. Control..

[61]  FastPep: a fast parasitic extraction program for complex three-dimensional geometries , 1997, 1997 Proceedings of IEEE International Conference on Computer Aided Design (ICCAD).

[62]  E. Jury Stability of multidimensional scalar and matrix polynomials , 1978, Proceedings of the IEEE.

[63]  James Lam,et al.  Hankel-type model reduction for linear repetitive processes: differential and discrete cases , 2008, Multidimens. Syst. Signal Process..

[64]  M. Morf,et al.  New results in 2-D systems theory, part II: 2-D state-space models—Realization and the notions of controllability, observability, and minimality , 1977, Proceedings of the IEEE.

[65]  Kim-Chuan Toh,et al.  SDPT3 — a Matlab software package for semidefinite-quadratic-linear programming, version 3.0 , 2001 .

[66]  V. Kučera Factorization of rational spectral matrices: a survey of methods , 1991 .

[67]  R. Freund Model reduction methods based on Krylov subspaces , 2003, Acta Numerica.

[68]  R.M. Murray,et al.  Frequency-Weighted Model Reduction with Applications to Structured Models , 2007, 2007 American Control Conference.

[69]  Athanasios C. Antoulas,et al.  On the Scalar Rational Interpolation Problem , 1986 .

[70]  Dimitri Peaucelle-Didier Henrion-Yann Labit-Krysten Taitz User ’ s Guide for SEDUMI INTERFACE 1 . 04 , 2002 .

[71]  J. Korvink,et al.  Parameter Preserving Model Reduction for MEMS System-level Simulation and Design , 2005 .

[72]  J. Willems Least squares stationary optimal control and the algebraic Riccati equation , 1971 .

[73]  Fuwen Yang,et al.  Fixed-Order Robust $H_{\infty}$ Controller Design With Regional Pole Assignment , 2007, IEEE Transactions on Automatic Control.

[74]  K. Glover All optimal Hankel-norm approximations of linear multivariable systems and their L, ∞ -error bounds† , 1984 .

[75]  Paul Van Dooren,et al.  A collection of benchmark examples for model reduction of linear time invariant dynamical systems. , 2002 .

[76]  Michael Cantoni On model reduction in the /spl nu/-gap metric , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[77]  Sani R. Nassif,et al.  Modeling interconnect variability using efficient parametric model order reduction , 2005, Design, Automation and Test in Europe.