Scalable analysis of nonlinear systems using convex optimization

In this thesis, we investigate how convex optimization can be used to analyze different classes of nonlinear systems at various scales algorithmically. The methodology is based on the construction of appropriate Lyapunov-type certificates using sum of squares techniques. After a brief introduction on the mathematical tools that we will be using, we turn our attention to robust stability and performance analysis of systems described by Ordinary Differential Equations. A general framework for constrained systems analysis is developed, under which stability of systems with polynomial, non polynomial vector fields and switching systems, as well as estimating the region of attraction and the L2 gain can be treated in a unified manner. Examples from biology and aerospace illustrate our methodology. We then consider systems described by Functional Differential Equations (FDEs), i.e., time-delay systems. Their main characteristic is that they are infinite dimensional, which complicates their analysis. We first show how the complete Lyapunov-Krasovskii functional can be constructed algorithmically for linear time delay systems. Then, we concentrate on delay-independent and delay-dependent stability analysis of nonlinear FDEs using sum of squares techniques. An example from ecology is given. The scalable stability analysis of congestion control algorithms for the Internet is investigated next. The models we use result in an arbitrary interconnection of FDE subsystems, for which we require that stability holds for arbitrary delays, network topologies and link capacities. Through a constructive proof, we develop a Lyapunov functional for FAST - a recently developed network congestion control scheme - so that the Lyapunov stability properties scale with the system size. We also show how other network congestion control schemes can be analyzed in the same way. Finally, we concentrate on systems described by Partial Differential Equations. We show that axially constant perturbations of the Navier-Stokes equations for Hagen-Poiseuille flow are globally stable, even though the background noise is amplified as R3 where R is the Reynolds number, giving a 'robust yet fragile' interpretation. We also propose a sum of squares methodology for the analysis of systems described by parabolic PDEs. We conclude this work with an account for future research.

[1]  O. Reynolds III. An experimental investigation of the circumstances which determine whether the motion of water shall be direct or sinuous, and of the law of resistance in parallel channels , 1883, Proceedings of the Royal Society of London.

[2]  E. M. Wright A non-linear difference-differential equation. , 1946 .

[3]  Peter J. Wangersky,et al.  Time Lag in Prey‐Predator Population Models , 1957 .

[4]  N. Rashevsky,et al.  Mathematical biology , 1961, Connecticut medicine.

[5]  V. Zubov Methods of A.M. Lyapunov and their application , 1965 .

[6]  Iu M Repin Quadratic liapunov functionals for systems with delay , 1965 .

[7]  Wolfgang Hahn,et al.  Stability of Motion , 1967 .

[8]  John L. Lumley,et al.  Drag Reduction by Additives , 1969 .

[9]  D. D. Perlmutter,et al.  Stability of time‐delay systems , 1972 .

[10]  J. Craggs Applied Mathematical Sciences , 1973 .

[11]  C. Desoer,et al.  Feedback Systems: Input-Output Properties , 1975 .

[12]  William McMurray Modeling, analysis, and simulation , 1976, 1970 IEEE Power Electronics Specialists Conference.

[13]  R. Bird Dynamics of Polymeric Liquids , 1977 .

[14]  G. Toulouse,et al.  On the connection between spin glasses and gauge field theories , 1980 .

[15]  F. Fairman Introduction to dynamic systems: Theory, models and applications , 1979, Proceedings of the IEEE.

[16]  Stephen P. Banks State-Space and Frequency Domain Methods in the Control of Distributed Parameter Systems , 1983 .

[17]  Robert C. Armstrong,et al.  Dynamics of polymeric liquids. Vol. 1, 2nd Ed. : Fluid mechanics , 1987 .

[18]  Katta G. Murty,et al.  Some NP-complete problems in quadratic and nonlinear programming , 1987, Math. Program..

[19]  N. Z. Shor Class of global minimum bounds of polynomial functions , 1987 .

[20]  E. Voit,et al.  Recasting nonlinear differential equations as S-systems: a canonical nonlinear form , 1987 .

[21]  T. McLeish Dynamics of polymeric liquids, Vol. 2: kinetic theory, 2nd ed. by R.B. Bird, C.F. Curtiss, R.C. Armstrong and O. Hassager, John Wiley and Sons, New York, NY, 1987, ISBN 0-471-01596-2, 437 pp., $65.00. , 1989 .

[22]  L. Dai,et al.  Singular Control Systems , 1989, Lecture Notes in Control and Information Sciences.

[23]  Daniel B. Henry Geometric Theory of Semilinear Parabolic Equations , 1989 .

[24]  Michael Athans,et al.  Analysis of gain scheduled control for nonlinear plants , 1990 .

[25]  Marie-Françoise Roy,et al.  Real algebraic geometry , 1992 .

[26]  Dale F. Enns,et al.  Nonlinear control law with application to high angle-of-attack flight , 1992 .

[27]  Anne E. Trefethen,et al.  Hydrodynamic Stability Without Eigenvalues , 1993, Science.

[28]  P. Ioannou,et al.  Stochastic forcing of the linearized Navier–Stokes equations , 1993 .

[29]  Jack K. Hale,et al.  Introduction to Functional Differential Equations , 1993, Applied Mathematical Sciences.

[30]  M. Morari,et al.  Computational complexity of μ calculation , 1993 .

[31]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[32]  M. Morari,et al.  Computational complexity of μ calculation , 1994, IEEE Trans. Autom. Control..

[33]  A. Packard Gain scheduling via linear fractional transformations , 1994 .

[34]  P. Schmid,et al.  Optimal energy density growth in Hagen–Poiseuille flow , 1994, Journal of Fluid Mechanics.

[35]  Dan Bugajski,et al.  Dynamic inversion: an evolving methodology for flight control design , 1994 .

[36]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[37]  V. Jacobson Congestion avoidance and control , 1988, CCRV.

[38]  B. Reznick,et al.  Sums of squares of real polynomials , 1995 .

[39]  S. Poljak,et al.  On a positive semidefinite relaxation of the cut polytope , 1995 .

[40]  Hans Zwart,et al.  An Introduction to Infinite-Dimensional Linear Systems Theory , 1995, Texts in Applied Mathematics.

[41]  David P. Williamson,et al.  Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming , 1995, JACM.

[42]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[43]  Olga Taussky-Todd SOME CONCRETE ASPECTS OF HILBERT'S 17TH PROBLEM , 1996 .

[44]  E. Feron,et al.  Analysis and synthesis of robust control systems via parameter-dependent Lyapunov functions , 1996, IEEE Trans. Autom. Control..

[45]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[46]  Matthew Mathis,et al.  The macroscopic behavior of the TCP congestion avoidance algorithm , 1997, CCRV.

[47]  S. Pettersson,et al.  LMI for stability and robustness of hybrid systems , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[48]  Anders Rantzer,et al.  Computation of piecewise quadratic Lyapunov functions for hybrid systems , 1997, 1997 European Control Conference (ECC).

[49]  A. Rantzer,et al.  System analysis via integral quadratic constraints , 1997, IEEE Trans. Autom. Control..

[50]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[51]  Stephen P. Boyd,et al.  Quadratic stabilization and control of piecewise-linear systems , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[52]  A. Teel Connections between Razumikhin-type theorems and the ISS nonlinear small gain theorem , 1998, IEEE Trans. Autom. Control..

[53]  V. Powers,et al.  An algorithm for sums of squares of real polynomials , 1998 .

[54]  B. Bequette Process Dynamics: Modeling, Analysis and Simulation , 1998 .

[55]  Donald F. Towsley,et al.  Modeling TCP throughput: a simple model and its empirical validation , 1998, SIGCOMM '98.

[56]  E. Yaz Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[57]  M. Branicky Multiple Lyapunov functions and other analysis tools for switched and hybrid systems , 1998, IEEE Trans. Autom. Control..

[58]  Steven H. Low,et al.  Optimization flow control—I: basic algorithm and convergence , 1999, TNET.

[59]  V. Kolmanovskii,et al.  On the Liapunov-Krasovskii functionals for stability analysis of linear delay systems , 1999 .

[60]  W. Ames Mathematics in Science and Engineering , 1999 .

[61]  PooGyeon Park,et al.  A delay-dependent stability criterion for systems with uncertain time-invariant delays , 1999, IEEE Trans. Autom. Control..

[62]  Kolmanovskii,et al.  Introduction to the Theory and Applications of Functional Differential Equations , 1999 .

[63]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[64]  R. Decarlo,et al.  Perspectives and results on the stability and stabilizability of hybrid systems , 2000, Proceedings of the IEEE.

[65]  P. Parrilo,et al.  On convexity in stabilization of nonlinear systems , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[66]  P. Parrilo Structured semidefinite programs and semialgebraic geometry methods in robustness and optimization , 2000 .

[67]  P. Schmid,et al.  Stability and Transition in Shear Flows. By P. J. SCHMID & D. S. HENNINGSON. Springer, 2001. 556 pp. ISBN 0-387-98985-4. £ 59.50 or $79.95 , 2000, Journal of Fluid Mechanics.

[68]  Pablo A. Parrilo,et al.  Minimizing Polynomial Functions , 2001, Algorithmic and Quantitative Aspects of Real Algebraic Geometry in Mathematics and Computer Science.

[69]  Kim-Chuan Toh,et al.  SDPT3 — a Matlab software package for semidefinite-quadratic-linear programming, version 3.0 , 2001 .

[70]  Fernando Paganini,et al.  Scalable laws for stable network congestion control , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[71]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[72]  Ramesh Johari,et al.  End-to-end congestion control for the internet: delays and stability , 2001, TNET.

[73]  M. Dahleh,et al.  Energy amplification in channel flows with stochastic excitation , 2001 .

[74]  Kevin Wise Control in an Information Rich World , 2001 .

[75]  Frédéric Mazenc,et al.  Lyapunov stability analysis for nonlinear delay systems , 2001 .

[76]  Glenn Vinnicombe,et al.  On the stability of end-to-end congestion control for the internet , 2001 .

[77]  J. Doyle,et al.  Highly optimized transitions to turbulence , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[78]  P. Parrilo An explicit construction of distinguished representations of polynomials nonnegative over finite sets , 2002 .

[79]  F. Paganini,et al.  Global stability with time-delay in network congestion control , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[80]  Pierre-Alexandre Bliman,et al.  Stability of non-linear delay systems: Delay-independent small gain theorem and frequency domain interpretation of the Lyapunov-Krasovskii method , 2002 .

[81]  Glenn Vinnicombe,et al.  ON THE STABILITY OF NETWORKS OPERATING TCP-LIKE CONGESTION CONTROL , 2002 .

[82]  Fernando Paganini,et al.  A global stability result in network flow control , 2002, Syst. Control. Lett..

[83]  A. Papachristodoulou,et al.  On the construction of Lyapunov functions using the sum of squares decomposition , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[84]  Danielle C. Tarraf,et al.  On the nature and stability of differential-algebraic systems , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[85]  Pierre-Alexandre Bliman,et al.  Lyapunov equation for the stability of linear delay systems of retarded and neutral type , 2002, IEEE Trans. Autom. Control..

[86]  R. Srikant,et al.  How good are deterministic fluid models of Internet congestion control? , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[87]  Anthony T. Patera,et al.  A General Lagrangian Formulation for the Computation of A Posteriori Finite Element Bounds , 2003 .

[88]  Pablo A. Parrilo,et al.  Semidefinite programming relaxations for semialgebraic problems , 2003, Math. Program..

[89]  Fernando Paganini,et al.  Global stability with time-delay of a primal-dual congestion control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[90]  A. Papachristodoulou,et al.  Analysis of switched and hybrid systems - beyond piecewise quadratic methods , 2003, Proceedings of the 2003 American Control Conference, 2003..

[91]  John T. Wen,et al.  A unifying passivity framework for network flow control , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[92]  Fernando Paganini,et al.  A new TCP/AQM for stable operation in fast networks , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[93]  C. Papageorgiou Robustness analysis of nonlinear dynamic inversion control laws for flight control applications , 2003 .

[94]  Rayadurgam Srikant,et al.  The Mathematics of Internet Congestion Control , 2003 .

[95]  乔花玲,et al.  关于Semigroups of Linear Operators and Applications to Partial Differential Equations的两个注解 , 2003 .

[96]  F. Mazenc,et al.  Remarks on the stability of a class of TCP-like congestion control models , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[97]  R. Srikant,et al.  Global stability of congestion controllers for the Internet , 2003, IEEE Trans. Autom. Control..

[98]  M. Khammash,et al.  Model validation and robust stability analysis of the bacterial heat shock response using SOSTOOLS , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[99]  Jean-Pierre Richard,et al.  Time-delay systems: an overview of some recent advances and open problems , 2003, Autom..

[100]  P. Parrilo,et al.  Symmetry groups, semidefinite programs, and sums of squares , 2002, math/0211450.

[101]  A. Papachristodoulou,et al.  Nonlinear control synthesis by sum of squares optimization: a Lyapunov-based approach , 2004, 2004 5th Asian Control Conference (IEEE Cat. No.04EX904).

[102]  C.J.H. Mann,et al.  Control in an Information Rich World , 2004 .

[103]  Lun Li,et al.  Methodological frameworks for large-scale network analysis and design , 2004, CCRV.

[104]  G. Dullerud,et al.  Global stability of Internet congestion controllers with heterogeneous delays , 2004 .

[105]  A. Papachristodoulou Analysis of nonlinear time-delay systems using the sum of squares decomposition , 2004, Proceedings of the 2004 American Control Conference.

[106]  Antonis Papachristodoulou,et al.  Global stability analysis of a TCP/AQM protocol for arbitrary networks with delay , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[107]  John Doyle,et al.  Analysis of nonlinear delay differential equation models of TCP/AQM protocols using sums of squares , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[108]  A. Papachristodoulou,et al.  Analysis of Non-polynomial Systems using the Sum of Squares Decomposition , 2005 .