Contributions to the solution of large nonlinear systems via model-order reduction and interval constraint solving techniques

Many engineering problems boil down to solving partial differential equations (PDEs) that describe real-life phenomena. Nevertheless, efficiently and reliably solving such problems constitutes a major challenge in computational sciences and in engineering in general. PDE-based systems can reach sizes so large after they are discretized. The large size in these problems generate several issues, among them we can mention: large space of storing, computing time, and the most important, lost of accuracy. A popular approach to solving such problems is assume that the PDE’s solution is in a subspace, and the solution is sought there. This assumption and later searching is named Model-Order Reduction (MOR). As we have mentioned before, MOR aims at reducing the size of the original large problem by projecting it onto a subspace. The quality of MOR is highly dependent on the right choice of the projection. Assuming that the projection is relevant, i.e. the behavior of the projected system reproduces that of the original system, the projected smaller system is solved much more easily and its solution is “uncompressed” into the solution of the original system. Identifying effective projections is still an open problem. Among existing popular approaches are Krylov methods, Proper Orthogonal Decomposition (POD), and Wavelets. None of these methods is perfect, each with has pros and cons. Once the original problem is reduced, challenges still exist: nonlinear problems, solving it require going back and forth between compressed and original problems in order to solve them, which is time and space consuming. So there is a need for clever approaches to optimization that allow avoiding these pitfalls. In any case, we can consider the following added challenges: (1) No current popular technique is global, which means that there is no evidence that the solutions we obtain are the best. (2) None of these techniques take into account additional constraints, such as contact constraints, that should be satisfied by resulting solutions. (3) Uncertainty is not taken into account and thus the solution that are obtained may not be robust enough to

[1]  M. Stadtherr,et al.  Validated solutions of initial value problems for parametric ODEs , 2007 .

[2]  Fergyanto E. Gunawan,et al.  Levenberg-Marquardt iterative regularization for the pulse-type impact-force reconstruction , 2012 .

[3]  I. Elfadel,et al.  Zeros And Passivity Of Arnoldi-reduced-order Models For Interconnect Networks , 1997, Proceedings of the 34th Design Automation Conference.

[4]  H. Aling,et al.  Nonlinear model reduction with application to rapid thermal processing , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[5]  Z. Bai.  Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems , 2002 .

[6]  Paul Van Dooren,et al.  Model reduction of state space systems via an implicitly restarted Lanczos method , 1996, Numerical Algorithms.

[7]  Min Ma,et al.  Model Order Reduction with Load Constraints , 2006, 2006 IEEE Electrical Performane of Electronic Packaging.

[8]  Jerrold E. Marsden,et al.  Empirical model reduction of controlled nonlinear systems , 1999, IFAC Proceedings Volumes.

[9]  Sung-Mo Kang,et al.  An algorithm for automatic model-order reduction of nonlinear MEMS devices , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[10]  Linda R. Petzold,et al.  Using Krylov Methods in the Solution of Large-Scale Differential-Algebraic Systems , 1994, SIAM J. Sci. Comput..

[11]  Jacob K. White,et al.  An Arnoldi approach for generation of reduced-order models for turbomachinery , 2000 .

[12]  Roland W. Freund,et al.  Reduced-order modeling of large passive linear circuits by means of the SYPVL algorithm , 1996, ICCAD 1996.

[13]  Linda R. Petzold,et al.  An iterative method for simulation of large scale modular systems using reduced order models , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[14]  Angus E. Taylor.  Introduction to functional analysis , 1959 .

[15]  Joel R. Phillips,et al.  Projection-based approaches for model reduction of weakly nonlinear, time-varying systems , 2003, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[16]  James G. Nagy,et al.  An Efficient Iterative Approach for Large-Scale Separable Nonlinear Inverse Problems , 2009, SIAM J. Sci. Comput..

[17]  M. Saunders,et al.  Solution of Sparse Indefinite Systems of Linear Equations , 1975 .

[18]  Jacob K. White,et al.  A trajectory piecewise-linear approach to model order reduction and fast simulation of nonlinear circuits and micromachined devices , 2001, IEEE/ACM International Conference on Computer Aided Design. ICCAD 2001. IEEE/ACM Digest of Technical Papers (Cat. No.01CH37281).

[19]  Jim Hefferon,et al.  Linear Algebra , 2012 .

[20]  Åke Björck,et al.  Numerical methods for least square problems , 1996 .

[21]  R. Baker Kearfott,et al.  Introduction to Interval Analysis , 2009 .

[22]  Muruhan Rathinam,et al.  A New Look at Proper Orthogonal Decomposition , 2003, SIAM J. Numer. Anal..

[23]  Michel S. Nakhla,et al.  Passive model order reduction of multiport distributed interconnects , 2000, Proceedings 37th Design Automation Conference.

[24]  Stefan Görtz,et al.  Reduced order modeling of steady flows subject to aerodynamic constraints , 2014 .

[25]  Nedialko S. Nedialkov,et al.  Validated solutions of initial value problems for ordinary differential equations , 1999, Appl. Math. Comput..

[26]  S. Senturia,et al.  Computer-aided generation of nonlinear reduced-order dynamic macromodels. II. Stress-stiffened case , 2000, Journal of Microelectromechanical Systems.

[27]  Miguel Hernandez,et al.  Reduced-order modeling using orthogonal and bi-orthogonal wavelet transforms , 2013 .

[28]  P. Brown.  A local convergence theory for combined inexact-Newton/finite-difference projection methods , 1987 .

[29]  Peter Benner,et al.  Model Order Reduction for Linear and Nonlinear Systems: A System-Theoretic Perspective , 2014, Archives of Computational Methods in Engineering.

[30]  J. Peraire,et al.  Balanced Model Reduction via the Proper Orthogonal Decomposition , 2002 .

[31]  Bernard N. Sheehan.  Projective convolution: RLC model-order reduction using the impulse response , 1999, DATE '99.

[32]  Jaijeet S. Roychowdhury.  Reduced-order modelling of time-varying systems , 1999, Proceedings of the ASP-DAC '99 Asia and South Pacific Design Automation Conference 1999 (Cat. No.99EX198).

[33]  Michael B. Wakin.  Sparse Image and Signal Processing: Wavelets, Curvelets, Morphological Diversity (Starck, J.-L., et al; 2010) [Book Reviews] , 2011, IEEE Signal Processing Magazine.

[34]  J. Schutt-Ainé,et al.  Krylov subspace-based model-order reduction techniques for circuit simulations , 1996, Proceedings of the 39th Midwest Symposium on Circuits and Systems.

[35]  Michael A. Henson,et al.  Nonlinear model reduction for dynamic analysis of cell population models , 2003 .

[36]  Robert Skelton,et al.  Model reductions using a projection formulation , 1987, 26th IEEE Conference on Decision and Control.

[37]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[38]  Ralph E. White,et al.  Reduction of Model Order Based on Proper Orthogonal Decomposition for Lithium-Ion Battery Simulations , 2009 .

[39]  J.A. De Abreu-Garcia,et al.  On the computation of reduced order models of nonlinear systems using balancing technique , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[40]  Varsha Hemant Patil,et al.  Color Image Compression Based On Wavelet Packet Best Tree , 2010, ArXiv.

[41]  Jian-Ming Jin,et al.  Karhunen-Loeve based model order reduction of nonlinear systems , 2002, IEEE Antennas and Propagation Society International Symposium (IEEE Cat. No.02CH37313).

[42]  Peng Li,et al.  NORM: compact model order reduction of weakly nonlinear systems , 2003, Proceedings 2003. Design Automation Conference (IEEE Cat. No.03CH37451).

[43]  Michal Rewienski,et al.  A trajectory piecewise-linear approach to model order reduction of nonlinear dynamical systems , 2003 .

[44]  K. Yamamura,et al.  Interval solution of nonlinear equations using linear programming , 1998 .

[45]  P. Holmes,et al.  The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows , 1993 .

[46]  Jing-Rebecca Li.  Model reduction of large linear systems via low rank system gramians , 2000 .

[47]  Darci Odloak,et al.  Model reduction using proper orthogonal decomposition and predictive control of distributed reactor system , 2013 .

[48]  Frédéric Benhamou,et al.  Algorithm 852: RealPaver: an interval solver using constraint satisfaction techniques , 2006, TOMS.

[49]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[50]  Joel P. Conte,et al.  Handling of Constraints in Finite-Element Response Sensitivity Analysis , 2009 .

[51]  I. Balk.  Arnoldy based passive model order reduction algorithm , 2000, IEEE 9th Topical Meeting on Electrical Performance of Electronic Packaging (Cat. No.00TH8524).

[52]  Karolos M. Grigoriadis,et al.  Efficient model reduction of large scale systems using Krylov-subspace iterative methods , 2003 .

[53]  B. Sheehan,et al.  ENOR: model order reduction of RLC circuits using nodal equations for efficient factorization , 1999, Proceedings 1999 Design Automation Conference (Cat. No. 99CH36361).

[54]  D. Sorensen.  IMPLICITLY RESTARTED ARNOLDI/LANCZOS METHODS FOR LARGE SCALE EIGENVALUE CALCULATIONS , 1996 .

[55]  A. Chatterjee.  An introduction to the proper orthogonal decomposition , 2000 .

[56]  Guillaume Lassaux,et al.  High-fidelity reduced-order aerodynamic models : application to active control of engine inlets , 2002 .

[57]  W. Marsden.  I and J , 2012 .

[58]  Plamen Koev,et al.  Accurate SVDs of polynomial Vandermonde matrices involving orthonormal polynomials , 2006 .

[59]  Y. Saad.  Numerical Methods for Large Eigenvalue Problems , 2011 .

[60]  Danny C. Sorensen,et al.  Implicit Application of Polynomial Filters in a k-Step Arnoldi Method , 1992, SIAM J. Matrix Anal. Appl..

[61]  J. Phillips,et al.  Model order reduction for strictly passive and causal distributed systems , 2002, Proceedings 2002 Design Automation Conference (IEEE Cat. No.02CH37324).

[62]  J. Phillips,et al.  Model reduction of time-varying linear systems using approximate multipoint Krylov-subspace projectors , 1998, 1998 IEEE/ACM International Conference on Computer-Aided Design. Digest of Technical Papers (IEEE Cat. No.98CB36287).

[63]  Ying Liu,et al.  Model order-reduction of RC(L) interconnect including variational analysis , 1999, DAC '99.

[64]  Mattan Kamon,et al.  A coordinate-transformed Arnoldi algorithm for generating guaranteed stable reduced-order models of RLC circuits , 1999 .

[65]  Ilse C. F. Ipsen,et al.  THE IDEA BEHIND KRYLOV METHODS , 1998 .