A trajectory piecewise-linear approach to model order reduction of nonlinear dynamical systems

In this study we discuss the problem of Model Order Reduction (MOR) for a class of nonlinear dynamical systems. In particular, we consider reduction schemes based on projection of the original state-space to a lower-dimensional space e.g. by using Krylov methods. In the nonlinear case, however, applying a projection-based MOR scheme does not immediately yield computationally efficient macromodels. In order to overcome this fundamental problem, we propose to first approximate the original nonlinear system with a weighted combination of a small set of linearized models of this system, and then reduce each of the models with an appropriate projection method. The linearized models are generated about a state trajectory of the nonlinear system corresponding to a certain ‘training’ input. As demonstrated by results of numerical tests, the obtained trajectory quasi-piecewise-linear reduced order models are very cost-efficient, while providing superior accuracy as compared to existing MOR schemes, based on single-state Taylor’s expansions. In this dissertation, the proposed MOR approach is tested for a number of examples of nonlinear dynamical systems, including micromachined devices, analog circuits (discrete transmission line models, operational amplifiers), and fluid flow problems. The tests validate the extracted models and indicate that the proposed approach can be effectively used to obtain system-level models for strongly nonlinear devices. This dissertation also shows an inexpensive method of generating trajectory piecewise-linear (TPWL) models based on constructing the reduced models ‘on-the-fly’, which accelerates simulation of the system response. Moreover, we propose a procedure for estimating simulation errors, which can be used to determine accuracy of the extracted trajectory piecewise-linear reduced order models. Finally, we present projection schemes which result in improved accuracy of the reduced order TPWL models, as well as discuss approaches leading to guaranteed stable and passive TPWL reduced-order models. Thesis Supervisor: Jacob K. White Title: Professor of Electrical Engineering and Computer Science

[1]  Zhaojun Bai,et al.  Error bound for reduced system model by Pade approximation via the Lanczos process , 1999, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[2]  L. Sirovich.  Turbulence and the dynamics of coherent structures. I. Coherent structures , 1987 .

[3]  Janet Roveda,et al.  Coupled noise estimation for distributed RC interconnect model , 1999, Design, Automation and Test in Europe Conference and Exhibition, 1999. Proceedings (Cat. No. PR00078).

[4]  Eric James Grimme,et al.  Krylov Projection Methods for Model Reduction , 1997 .

[5]  Sani R. Nassif,et al.  A linear-centric simulation framework for parametric fluctuations , 2002, Proceedings 2002 Design, Automation and Test in Europe Conference and Exhibition.

[6]  N. Marques,et al.  Generating reduced order models via PEEC for capturing skin and proximity effects , 1997, Electrical Performance of Electronic Packaging.

[7]  Sung-Mo Kang,et al.  An algorithm for automatic model-order reduction of nonlinear MEMS devices , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[8]  Ernest S. Kuh,et al.  Passive multipoint moment matching model order reduction algorithm on multiport distributed interconnect networks , 1999 .

[9]  M. Vlach,et al.  Modeling and simulation with Saber , 1990, Third Annual IEEE Proceedings on ASIC Seminar and Exhibit.

[10]  Sung-Mo Kang,et al.  Model-order reduction of nonlinear MEMS devices through arclength-based Karhunen-Loeve decomposition , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[11]  Joel R. Phillips.  Automated extraction of nonlinear circuit macromodels , 2000, Proceedings of the IEEE 2000 Custom Integrated Circuits Conference (Cat. No.00CH37044).

[12]  Jaijeet S. Roychowdhury.  Reduced-order modelling of time-varying systems , 1999, Proceedings of the ASP-DAC '99 Asia and South Pacific Design Automation Conference 1999 (Cat. No.99EX198).

[13]  Jian-Ming Jin,et al.  Karhunen-Loeve based model order reduction of nonlinear systems , 2002, IEEE Antennas and Propagation Society International Symposium (IEEE Cat. No.02CH37313).

[14]  K. Glover.  All optimal Hankel-norm approximations of linear multivariable systems and their L, ∞ -error bounds† , 1984 .

[15]  Yong P. Chen,et al.  A Quadratic Method for Nonlinear Model Order Reduction , 2000 .

[16]  I. Balk.  On a passivity of the Arnoldi based model order reduction for full-wave electromagnetic modeling , 2001 .

[17]  Earl H. Dowell,et al.  Reduced-order modelling of unsteady small-disturbance flows using a frequency-domain proper orthogonal decomposition technique , 1999 .

[18]  Yong Chen.  Model order reduction for nonlinear systems , 1999 .

[19]  Michael A. Henson,et al.  Nonlinear model reduction for dynamic analysis of cell population models , 2003 .

[20]  B. Moore.  Principal component analysis in linear systems: Controllability, observability, and model reduction , 1981 .

[21]  Jacob K. White,et al.  A TBR-based trajectory piecewise-linear algorithm for generating accurate low-order models for nonlinear analog circuits and MEMS , 2003, Proceedings 2003. Design Automation Conference (IEEE Cat. No.03CH37451).

[22]  Massoud Pedram,et al.  Model reduction of variable-geometry interconnects using variational spectrally-weighted balanced truncation , 2001, IEEE/ACM International Conference on Computer Aided Design. ICCAD 2001. IEEE/ACM Digest of Technical Papers (Cat. No.01CH37281).

[23]  E. Grimme,et al.  Pade approximation of large-scale dynamic systems with Lanczos methods , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[24]  Jacob K. White,et al.  Efficient reduced-order modeling for the transient simulation of three-dimensional interconnect , 1995, Proceedings of IEEE International Conference on Computer Aided Design (ICCAD).

[25]  Roland W. Freund,et al.  Reduced-order modeling of large passive linear circuits by means of the SYPVL algorithm , 1996, ICCAD 1996.

[26]  Z. Bai.  Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems , 2002 .

[27]  R. D. Slone.  Removing the frequency restriction on Pade Via Lanczos with an error bound , 1998, 1998 IEEE EMC Symposium. International Symposium on Electromagnetic Compatibility. Symposium Record (Cat. No.98CH36253).

[28]  Andreas C. Cangellaris,et al.  Rapid FDTD simulation without time stepping , 1999 .

[29]  R. B. Vinter,et al.  Trajectory-specific model reduction , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[30]  Jing-Rebecca Li.  Model reduction of large linear systems via low rank system gramians , 2000 .

[31]  Joel R. Phillips,et al.  Projection-based approaches for model reduction of weakly nonlinear, time-varying systems , 2003, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[32]  Jacob K. White,et al.  An Arnoldi approach for generation of reduced-order models for turbomachinery , 2000 .

[33]  Lawrence T. Pileggi,et al.  PRIMA: passive reduced-order interconnect macromodeling algorithm , 1997, ICCAD 1997.

[34]  K. Lee,et al.  A control-relevant model reduction technique for nonlinear systems , 2000 .

[35]  M. A. Tan,et al.  Piecewise linear asymptotic waveform evaluation for transient simulation of electronic circuits , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[36]  Jacob K. White,et al.  Emerging simulation approaches for micromachined devices , 2000, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[37]  Donald M. Chiarulli,et al.  System simulation of mixed-signal multi-domain microsystems with piecewise linear models , 2003, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[38]  K. S. Kundert.  Introduction to RF simulation and its application , 1999 .

[39]  Karolos M. Grigoriadis,et al.  Efficient model reduction of large scale systems using Krylov-subspace iterative methods , 2003 .

[40]  Roland W. Freund,et al.  Efficient linear circuit analysis by Pade´ approximation via the Lanczos process , 1994, EURO-DAC '94.

[41]  Jeff S. Shamma,et al.  Analysis and design of gain scheduled control systems , 1988 .

[42]  William Leithead,et al.  Analysis of gain-scheduled and nonlinear systems by velocity-based linearisation families , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[43]  J.A. De Abreu-Garcia,et al.  On the computation of reduced order models of nonlinear systems using balancing technique , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[44]  P. Holmes,et al.  The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows , 1993 .

[45]  Ying Liu,et al.  Model order-reduction of RC(L) interconnect including variational analysis , 1999, DAC '99.

[46]  Siak Piang Lim,et al.  A neural-network-based method of model reduction for the dynamic simulation of MEMS , 2001 .

[47]  Michel S. Nakhla,et al.  Passive model order reduction of multiport distributed interconnects , 2000, Proceedings 37th Design Automation Conference.

[48]  Wei Cai,et al.  An efficient balanced truncation realization algorithm for interconnect model order reduction , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[49]  P. Dooren,et al.  Asymptotic Waveform Evaluation via a Lanczos Method , 1994 .

[50]  Jacob K. White,et al.  A trajectory piecewise-linear approach to model order reduction and fast simulation of nonlinear circuits and micromachined devices , 2001, IEEE/ACM International Conference on Computer Aided Design. ICCAD 2001. IEEE/ACM Digest of Technical Papers (Cat. No.01CH37281).

[51]  Bernard N. Sheehan.  ENOR: model order reduction of RLC circuits using nodal equations for efficient factorization , 1999, DAC '99.

[52]  Jacob K. White,et al.  Efficient model reduction of interconnect via approximate system gramians , 1999, 1999 IEEE/ACM International Conference on Computer-Aided Design. Digest of Technical Papers (Cat. No.99CH37051).

[53]  L. Silverman,et al.  Model reduction via balanced state space representations , 1982 .

[54]  M. Vidyasagar,et al.  Nonlinear systems analysis (2nd ed.) , 1993 .

[55]  Karen Willcox,et al.  Reduced-order aerodynamic models for aeroelastic control of turbomachines , 1999 .

[56]  Alberto L. Sangiovanni-Vincentelli,et al.  Techniques for including dielectrics when extracting passive low-order models of high speed interconnect , 2001, IEEE/ACM International Conference on Computer Aided Design. ICCAD 2001. IEEE/ACM Digest of Technical Papers (Cat. No.01CH37281).

[57]  Jacob K. White,et al.  Geometrically parameterized interconnect performance models for interconnect synthesis , 2002, ISPD '02.

[58]  J. Peraire,et al.  Balanced Model Reduction via the Proper Orthogonal Decomposition , 2002 .

[59]  C. Hirsch,et al.  Numerical Computation of Internal and External Flows. By C. HIRSCH. Wiley. Vol. 1, Fundamentals of Numerical Discretization. 1988. 515 pp. £60. Vol. 2, Computational Methods for Inviscid and Viscous Flows. 1990, 691 pp. £65. , 1991, Journal of Fluid Mechanics.

[60]  Kenneth S. Kundert,et al.  Design of mixed-signal systems-on-a-chip , 2000, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[61]  Jacob K. White,et al.  Automatic generation of accurate circuit models of 3-D interconnect , 1998 .

[62]  K. Greiner,et al.  Modeling gas damping and spring phenomena in MEMS with frequency dependent macro-models , 2001, Technical Digest. MEMS 2001. 14th IEEE International Conference on Micro Electro Mechanical Systems (Cat. No.01CH37090).

[63]  Alberto Sangiovanni-Vincentelli,et al.  A mixed frequency-time approach for distortion analysis of switching filter circuits , 1989 .

[64]  J. Phillips,et al.  Model reduction of time-varying linear systems using approximate multipoint Krylov-subspace projectors , 1998, 1998 IEEE/ACM International Conference on Computer-Aided Design. Digest of Technical Papers (IEEE Cat. No.98CB36287).

[65]  Danny C. Sorensen,et al.  The Sylvester equation and approximate balanced reduction , 2002 .

[66]  Ernest S. Kuh,et al.  On projection-based algorithms for model-order reduction of interconnects , 2002 .

[67]  Z. Cendes,et al.  S-domain methods for simultaneous time and frequency characterization of electromagnetic devices , 1998 .

[68]  F. Karray,et al.  On the nonlinear system identification of a class of bilinear dynamical models , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[69]  Hugo De Man,et al.  An analytic Volterra-series-based model for a MEMS variable capacitor , 2003, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[70]  Jacob K. White,et al.  A coordinate-transformed Arnoldi algorithm for generating guaranteed stable reduced-order models of RLC circuits , 1996, ICCAD 1996.

[71]  Yousef Saad,et al.  Efficient Solution of Parabolic Equations by Krylov Approximation Methods , 1992, SIAM J. Sci. Comput..

[72]  Wilson J. Rugh,et al.  Interpolation methods for gain scheduling , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[73]  Eric Michielssen,et al.  Analysis of frequency selective surfaces using two-parameter generalized rational Krylov model-order reduction , 2001 .

[74]  Massoud Pedram,et al.  Model order reduction of large circuits using balanced truncation , 1999, Proceedings of the ASP-DAC '99 Asia and South Pacific Design Automation Conference 1999 (Cat. No.99EX198).

[75]  J. Schutt-Ainé,et al.  Krylov subspace-based model-order reduction techniques for circuit simulations , 1996, Proceedings of the 39th Midwest Symposium on Circuits and Systems.

[76]  Taehyoun Kim,et al.  Frequency-Domain Karhunen -Loeve Method and Its Application to Linear Dynamic Systems , 1998 .

[77]  H. Aling,et al.  Nonlinear model reduction with application to rapid thermal processing , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[78]  P. M. van den Berg,et al.  A modified Lanczos algorithm for the computation of transient electromagnetic wavefields , 1997 .

[79]  J. M. A. Scherpen,et al.  Balancing for nonlinear systems , 1993 .

[80]  Ibrahim M. Elfadel,et al.  Zeros and passivity of Arnoldi-reduced-order models for interconnect networks , 1997, DAC.

[81]  George C. Verghese,et al.  Modeling and simulation of power electronic converters , 2001, Proc. IEEE.

[82]  Yao-Joe Yang,et al.  Low-order models for fast dynamical simulation of MEMS microstructures , 1997, Proceedings of International Solid State Sensors and Actuators Conference (Transducers '97).

[83]  Joel R. Phillips,et al.  Model order reduction for strictly passive and causal distributed systems , 2002, DAC '02.

[84]  Luís Miguel Silveira,et al.  Guaranteed passive balancing transformations for model order reduction , 2002, DAC '02.

[85]  Jacob K. White,et al.  SIMLAB user's guide , 1994 .

[86]  Andreas C. Cangellaris,et al.  Simulation of multiconductor transmission lines using Krylov subspace order-reduction techniques , 1997, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[87]  Pablo A. Parrilo,et al.  Model reduction for analysis of cascading failures in power systems , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[88]  A. Sangiovanni-Vincentelli,et al.  A mixed frequency-time approach for finding the steady-state solution of clocked analog circuits , 1988, Proceedings of the IEEE 1988 Custom Integrated Circuits Conference.

[89]  Yoram Halevi,et al.  Frequency weighted model reduction via optimal projection , 1992 .

[90]  Jin-Fa Lee,et al.  Multipoint Galerkin asymptotic waveform evaluation for model order reduction of frequency domain FEM electromagnetic radiation problems , 2001 .

[91]  Mark Horowitz,et al.  Timing analysis for piecewise linear Rsim , 1994, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[92]  I. Balk.  Arnoldy based passive model order reduction algorithm , 2000, IEEE 9th Topical Meeting on Electrical Performance of Electronic Packaging (Cat. No.00TH8524).

[93]  P. Brehonnet,et al.  A new discrete impulse response Gramian and its application to model reduction , 2000, IEEE Trans. Autom. Control..

[94]  J.A. De Abreu-Garcia,et al.  A transformation approach for model order reduction of nonlinear systems , 1990, [Proceedings] IECON '90: 16th Annual Conference of IEEE Industrial Electronics Society.

[95]  Lawrence T. Pileggi,et al.  Practical considerations for passive reduction of RLC circuits , 1999, 1999 IEEE/ACM International Conference on Computer-Aided Design. Digest of Technical Papers (Cat. No.99CH37051).

[96]  Guillaume Lassaux,et al.  High-fidelity reduced-order aerodynamic models : application to active control of engine inlets , 2002 .

[97]  Bernard N. Sheehan.  Projective convolution: RLC model-order reduction using the impulse response , 1999, DATE '99.

[98]  L. Kulas,et al.  Reduced-order models in FDTD , 2001, IEEE Microwave and Wireless Components Letters.

[99]  Mattan Kamon,et al.  Efficient reduced-order modeling of frequency-dependent coupling inductances associated with 3-D interconnect structures , 1995, Proceedings the European Design and Test Conference. ED&TC 1995.

[100]  Jerrold E. Marsden,et al.  Empirical model reduction of controlled nonlinear systems , 1999, IFAC Proceedings Volumes.

[101]  S. D. Senturia,et al.  Generating efficient dynamical models for microelectromechanical systems from a few finite-element simulation runs , 1999 .

[102]  Linda R. Petzold,et al.  An iterative method for simulation of large scale modular systems using reduced order models , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[103]  J. Hale,et al.  Ordinary Differential Equations , 2019, Fundamentals of Numerical Mathematics for Physicists and Engineers.

[104]  S.D. Senturia,et al.  Computer-aided generation of nonlinear reduced-order dynamic macromodels. I. Non-stress-stiffened case , 2000, Journal of Microelectromechanical Systems.

[105]  Paul Van Dooren,et al.  Model reduction of state space systems via an implicitly restarted Lanczos method , 1996, Numerical Algorithms.

[106]  Jacob K. White,et al.  Relaxation Techniques for the Simulation of VLSI Circuits , 1986 .