Structured semidefinite programs and semialgebraic geometry methods in robustness and optimization

In the first part of this thesis, we introduce a specific class of Linear Matrix Inequalities (LMI) whose optimal solution can be characterized exactly. This family corresponds to the case where the associated linear operator maps the cone of positive semidefinite matrices onto itself. In this case, the optimal value equals the spectral radius of the operator. It is shown that some rank minimization problems, as well as generalizations of the structured singular value ($mu$) LMIs, have exactly this property. In the same spirit of exploiting structure to achieve computational efficiency, an algorithm for the numerical solution of a special class of frequency-dependent LMIs is presented. These optimization problems arise from robustness analysis questions, via the Kalman-Yakubovich-Popov lemma. The procedure is an outer approximation method based on the algorithms used in the computation of hinf norms for linear, time invariant systems. The result is especially useful for systems with large state dimension. The other main contribution in this thesis is the formulation of a convex optimization framework for semialgebraic problems, i.e., those that can be expressed by polynomial equalities and inequalities. The key element is the interaction of concepts in real algebraic geometry (Positivstellensatz) and semidefinite programming. To this end, an LMI formulation for the sums of squares decomposition for multivariable polynomials is presented. Based on this, it is shown how to construct sufficient Positivstellensatz-based convex tests to prove that certain sets are empty. Among other applications, this leads to a nonlinear extension of many LMI based results in uncertain linear system analysis. Within the same framework, we develop stronger criteria for matrix copositivity, and generalizations of the well-known standard semidefinite relaxations for quadratic programming. Some applications to new and previously studied problems are presented. A few examples are Lyapunov function computation, robust bifurcation analysis, structured singular values, etc. It is shown that the proposed methods allow for improved solutions for very diverse questions in continuous and combinatorial optimization.

[1]  W. C. Mcginnis Ideals , 1925, Free Speech.

[2]  R. Tennant Algebra , 1941, Nature.

[3]  M. Kreĭn,et al.  Linear operators leaving invariant a cone in a Banach space , 1950 .

[4]  J. Davenport Editor , 1960 .

[5]  P. H. Diananda On non-negative forms in real variables some or all of which are non-negative , 1962, Mathematical Proceedings of the Cambridge Philosophical Society.

[6]  M. Hall,et al.  Copositive and completely positive quadratic forms , 1963, Mathematical Proceedings of the Cambridge Philosophical Society.

[7]  G. Birkhoff Linear Transformations with Invariant Cones , 1967 .

[8]  N. Bose,et al.  A quadratic form representation of polynomials of several variables and its applications , 1968 .

[9]  N. Akhiezer,et al.  The Classical Moment Problem. , 1968 .

[10]  V. Baston Extreme copositive quadratic forms , 1969 .

[11]  R. A. Silverman,et al.  Introductory Real Analysis , 1972 .

[12]  J. Willems Least squares stationary optimal control and the algebraic Riccati equation , 1971 .

[13]  G. Stengle A nullstellensatz and a positivstellensatz in semialgebraic geometry , 1974 .

[14]  B. Anderson,et al.  Output feedback stabilization and related problems-solution via decision methods , 1975 .

[15]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[16]  B. Reznick Extremal PSD forms with few terms , 1978 .

[17]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[18]  N. Bose Applied multidimensional systems theory , 1982 .

[19]  P. J. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[20]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[21]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[22]  A. Isidori Nonlinear Control Systems , 1985 .

[23]  H. Väliaho Criteria for copositive matrices , 1986 .

[24]  W. Brownawell Bounds for the degrees in the Nullstellensatz , 1987 .

[25]  Katta G. Murty,et al.  Some NP-complete problems in quadratic and nonlinear programming , 1987, Math. Program..

[26]  N. Z. Shor Class of global minimum bounds of polynomial functions , 1987 .

[27]  C. Berg The multidimensional moment problem and semi-groups , 1987 .

[28]  J. Kollár Sharp effective Nullstellensatz , 1988 .

[29]  S. Wiggins Introduction to Applied Nonlinear Dynamical Systems and Chaos , 1989 .

[30]  Stephen P. Boyd,et al.  A bisection method for computing the H∞ norm of a transfer matrix and related problems , 1989, Math. Control. Signals Syst..

[31]  S. Boyd,et al.  A regularity result for the singular values of a transfer matrix and a quadratically convergent algorithm for computing its L ∞ -norm , 1990 .

[32]  Warren P. Adams,et al.  A hierarchy of relaxation between the continuous and convex hull representations , 1990 .

[33]  M. Steinbuch,et al.  A fast algorithm to computer the H ∞ -norm of a transfer function matrix , 1990 .

[34]  Hanif D. Sherali,et al.  A Hierarchy of Relaxations Between the Continuous and Convex Hull Representations for Zero-One Programming Problems , 1990, SIAM J. Discret. Math..

[35]  C. Berenstein,et al.  Recent improvements in the complexity of the effective Nullstellensatz , 1991 .

[36]  Alexander Schrijver,et al.  Cones of Matrices and Set-Functions and 0-1 Optimization , 1991, SIAM J. Optim..

[37]  Richard W. Cottle,et al.  Linear Complementarity Problem. , 1992 .

[38]  Marie-Françoise Roy,et al.  Real algebraic geometry , 1992 .

[39]  Bud Mishra,et al.  Algorithmic Algebra , 1993, Texts and Monographs in Computer Science.

[40]  I. Dobson Computing a closest bifurcation instability in multidimensional parameter space , 1993 .

[41]  Andrew Packard,et al.  The complex structured singular value , 1993, Autom..

[42]  Derek Allan Holton,et al.  The Petersen graph , 1993, Australian mathematical society lecture series.

[43]  Vincent D. Blondel,et al.  Simultaneous stabilizability of three linear systems is rationally undecidable , 1993, Math. Control. Signals Syst..

[44]  A. Rantzer,et al.  System analysis via integral quadratic constraints , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[45]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[46]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[47]  F. Alvarado,et al.  Computation of closest bifurcations in power systems , 1994 .

[48]  P. Gahinet,et al.  A linear matrix inequality approach to H∞ control , 1994 .

[49]  Alan J. Laub,et al.  The LMI control toolbox , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[50]  László Lovász,et al.  Stable sets and polynomials , 1994, Discret. Math..

[51]  B. Reznick,et al.  Sums of squares of real polynomials , 1995 .

[52]  B. Reznick Uniform denominators in Hilbert's seventeenth problem , 1995 .

[53]  David P. Williamson,et al.  Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming , 1995, JACM.

[54]  D. Mayne Nonlinear and Adaptive Control Design [Book Review] , 1996, IEEE Transactions on Automatic Control.

[55]  A. Rantzer On the Kalman-Yakubovich-Popov lemma , 1996 .

[56]  M. A. Hasan,et al.  A procedure for the positive definiteness of forms of even order , 1996, IEEE Trans. Autom. Control..

[57]  Jesús A. De Loera,et al.  An effective version of Pólya's theorem on positive definite forms , 1996 .

[58]  Samuel R. Buss,et al.  Good degree bounds on Nullstellensatz refutations of the induction principle , 1996, Proceedings of Computational Complexity (Formerly Structure in Complexity Theory).

[59]  Olga Taussky-Todd SOME CONCRETE ASPECTS OF HILBERT'S 17TH PROBLEM , 1996 .

[60]  Anders Rantzer,et al.  Duality Bounds in Robustness Analysis , 1996 .

[61]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[62]  Dorit S. Hochbaum,et al.  Approximation Algorithms for NP-Hard Problems , 1996 .

[63]  Alberto Tesi,et al.  On the stability domain estimation via a quadratic Lyapunov function: convexity and optimality properties for polynomial systems , 1996, IEEE Trans. Autom. Control..

[64]  Marko Petkovšek,et al.  A=B : 等式証明とコンピュータ , 1997 .

[65]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[66]  Minyue Fu,et al.  The real structured singular value is hardly approximable , 1997, IEEE Trans. Autom. Control..

[67]  Mart'in Sombra A Sparse Effective Nullstellensatz , 1997 .

[68]  Donal O'Shea,et al.  Ideals, varieties, and algorithms - an introduction to computational algebraic geometry and commutative algebra (2. ed.) , 1997, Undergraduate texts in mathematics.

[69]  Wei Yang,et al.  Robust Multi-Objective Feedback Design by Quantifier Elimination , 1997, J. Symb. Comput..

[70]  Ulf T. Jönsson,et al.  Duality Bounds in Robustness Analysis, , 1997, Autom..

[71]  Mats Jirstrand,et al.  Nonlinear Control System Design by Quantifier Elimination , 1997, J. Symb. Comput..

[72]  G. Papavassilopoulos,et al.  On the rank minimization problem over a positive semidefinite linear matrix inequality , 1997, IEEE Trans. Autom. Control..

[73]  Anders Rantzer,et al.  Computation of piecewise quadratic Lyapunov functions for hybrid systems , 1997, 1997 European Control Conference (ECC).

[74]  A. Rantzer,et al.  System analysis via integral quadratic constraints , 1997, IEEE Trans. Autom. Control..

[75]  A. J. Quist,et al.  Copositive realxation for genera quadratic programming , 1998 .

[76]  M. Fu Comments on "A procedure for the positive definiteness of forms of even order" , 1998, IEEE Trans. Autom. Control..

[77]  Renato D. C. Monteiro,et al.  An Efficient Algorithm for Solving the MAXCUT SDP Relaxation , 1998 .

[78]  Chung-Yao Kao,et al.  A Guide To IQCbeta: Software For Robustness Analysis , 1998 .

[79]  V. Powers,et al.  An algorithm for sums of squares of real polynomials , 1998 .

[80]  A. J. Quist,et al.  Copositive relaxation for general quadratic programming. , 1998 .

[81]  E. Yaz Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[82]  Computation of piecewise quadratic Lyapunov functions for hybrid systems , 1998, IEEE Trans. Autom. Control..

[83]  B. Sturmfels Polynomial Equations and Convex Polytopes , 1998 .

[84]  M. Mesbahi On the rank minimization problem and its control applications , 1998 .

[85]  Stephen P. Boyd,et al.  sdpsol: a parse/solver for semidefinite programs with matrix structure , 1999 .

[86]  H. Wolkowicz,et al.  A STRENGTHENED SDP RELAXATION via a SECOND LIFTING for the MAX-CUT PROBLEM , 1999 .

[87]  Yun Huang,et al.  Nonlinear optimal control: an enhanced quasi-LPV approach , 1999 .

[88]  Yurii Nesterov,et al.  Squared Functional Systems and Optimization Problems , 2000 .

[89]  Onur Toker On the algorithmic unsolvability of some stability problems for hybrid systems , 2000, IEEE Trans. Autom. Control..

[90]  B. Reznick,et al.  A new bound for Pólya's Theorem with applications to polynomials positive on polyhedra , 2001 .

[91]  AN EfiECTIVE VERSION OF P? OLYA''S THEOREM ON POSITIVE DE?NITE FORMS , 2001 .