Stability Optimization for Polynomials and Matrices

Suppose that the coefficients of a monic polynomial or entries of a square matrix depend affinely on parameters, and consider the problem of minimizing the root radius (maximum of the moduli of the roots) or root abscissa (maximum of their real parts) in the polynomial case and the spectral radius or spectral abscissa in the matrix case. These functions are not convex and they are typically not locally Lipschitz near minimizers. We first address polynomials, for which some remarkable analytical results are available in one special case, and then consider the more general case of matrices, focusing on the static output feedback problem arising in control of linear dynamical systems. We also briefly discuss some spectral radius optimization problems arising in the analysis of the transient behavior of a Markov chain and the design of smooth surfaces using subdivision algorithms. 1 Optimization of Roots of Polynomials Optimization of roots of polynomials can arise in many contexts, but perhaps the most important application area is feedback control in the frequency domain [Dor99]. Consider the problem min p∈P max λ∈C {Re λ | p(λ) = 0} where P = {(λ + 2λ)(x0 + x1λ+ λ ) + y0 + y1λ+ y2λ 2 | x0, x1, y0, y1, y2 ∈ R}. This arises in maximizing, over all linear feedback controllers of order two, the asymptotic decay rate for a two-mass-spring dynamical system with one input (an actuator positioning the first mass) and one output (the measured position of the second mass) [HO06]. The polynomials in P are those that are admissible as the denominators of the relevant rational closed-loop system transfer function, and their roots must be in the left half of the complex plane for the system to be stable. Note that P is a set of monic polynomials with degree 6 whose coefficients depend affinely on 5 parameters. A construction was given in [HO06] of a polynomial in P of the form (λ−λ0) 6, with just one distinct negative real root λ0 of multiplicity 6, and its local optimality (the property that no nearby polynomial in P has all its roots to the left of λ0) was established. It was subsequently discovered that the solution constructed in [HO06] is globally optimal (no polynomial ∗Courant Institute of Mathematical Sciences, New York University, 251 Mercer Street, New York, NY 10012, USA. Supported in part by the U.S. National Science Foundation Grant DMS-1016325. 1 in P has all its roots to the left of λ0). This fact is a special case of a remarkable general theory that we summarize below, extracting the main results from a recent paper by Blondel, Gürbüzbalaban, Megretski and the author [BGMO12]. As noted there, it turns out that part of this general theory was first given in a little-known 1979 Ph.D. thesis of Raymond Chen [Che79b]. 1.1 Root Optimization over a Polynomial Family with a Single Affine Constraint Every monic polynomial of degree n may be represented by a point in Cn, representing the coefficients of the monomials λn−1, . . . , λ, 1. Let r denote the root radius of such a polynomial: r(p) = max {|λ| : p(λ) = 0, λ ∈ C} . The polynomial p is said to be Schur stable if r(p) < 1. Let a denote the root abscissa: a(p) = max {Re(λ) : p(λ) = 0, λ ∈ C} . The polynomial p is said to be Hurwitz stable if a(p) < 0. As functions of the polynomial coefficients, the radius r and abscissa a are not convex. They are continuous, but not Lipschitz continuous near a polynomial p with a multiple root whose modulus or real part respectively equals r(p) or a(p). So, in general, global minimization of the radius or abscissa over an affine family of monic polynomials, pushing the roots as far as possible towards the origin or left in the complex plane, seems hard. Indeed, variations on the question of whether a given polynomial family contains one that is stable (has roots inside the unit circle or in the lefthalf plane) have been studied for decades [BGL95]. But if an affine family of monic polynomials of degree n has n− 1 free parameters, this question can be answered efficiently. Equivalently, there is a single affine constraint on the coefficients. 1.2 The Root Radius We begin with optimizing the root radius over real coefficients. Informally, we want to push all the roots as close to zero as possible. By compactness, an optimal polynomial must exist; the following result states an explicit form for the solution. Theorem RRR. [BGMO12, Theorem 1] Let b0, b1, . . . , bn be real scalars (with b1, . . . , bn not all zero) and consider the affine family P = {λ + a1λ n−1 + . . .+ an−1λ+ an : b0 + n

[1]  Adrian Lewis,et al.  The mathematics of eigenvalue optimization , 2003, Math. Program..

[2]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[3]  J. Willems Generic Eigenvalue Assignability by Real Memoryless Output Feedback Made Simple , 1997 .

[4]  Michael L. Overton,et al.  Optimizing the asymptotic convergence rate of the Diaconis-Holmes-Neal sampler , 2007, Adv. Appl. Math..

[5]  Adrian S. Lewis,et al.  Variational analysis of functions of the roots of polynomials , 2005, Math. Program..

[6]  Sara Grundel,et al.  Variational Analysis of the Spectral Abscissa at a Matrix with a Nongeneric Multiple Eigenvalue , 2014 .

[7]  Michael L. Overton,et al.  Variational Analysis of the Abscissa Mapping for Polynomials , 2000, SIAM J. Control. Optim..

[8]  Biao Huang,et al.  Implementation of FIR control for H∞ output feedback stabilization of linear systems , 2009, 2009 American Control Conference.

[9]  Hidenori Kimura,et al.  Pole assignment by output feedback: a longstanding open problem , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[10]  M. Overton,et al.  Maximizing the Closed Loop Asymptotic Decay Rate for the Two-Mass-Spring Control Problem , 2006, math/0603681.

[11]  M. Overton,et al.  Algorithms for the computation of the pseudospectral radius and the numerical radius of a matrix , 2005 .

[12]  A. Lewis,et al.  Robust stability and a criss‐cross algorithm for pseudospectra , 2003 .

[13]  R. Hermann,et al.  Applications of algebraic geometry to systems theory--Part I , 1977 .

[14]  M. Marden Geometry of Polynomials , 1970 .

[15]  R. Rockafellar Convex Analysis: (pms-28) , 1970 .

[16]  Adrian S. Lewis,et al.  HIFOO - A MATLAB package for fixed-order controller design and H ∞ optimization , 2006 .

[17]  Mert Gürbüzbalaban,et al.  On Nesterov's Nonsmooth Chebyshev-Rosenbrock Functions , 2012 .

[18]  F. Clarke Optimization And Nonsmooth Analysis , 1983 .

[19]  A. Rantzer Equivalence between stability of partial realizations and feedback stabilization— applications to reduced order stabilization , 1989 .

[20]  J. Borwein,et al.  Convex Analysis And Nonlinear Optimization , 2000 .

[21]  Vincent D. Blondel,et al.  Explicit Solutions for Root Optimization of a Polynomial Family With One Affine Constraint , 2012, IEEE Transactions on Automatic Control.

[22]  L. Trefethen,et al.  Spectra and Pseudospectra , 2020 .

[23]  Adrian S. Lewis,et al.  A Robust Gradient Sampling Algorithm for Nonsmooth, Nonconvex Optimization , 2005, SIAM J. Optim..

[24]  A. Lewis,et al.  A Nonsmooth, Nonconvex Optimization Approach to Robust Stabilization by Static Output Feedback and Low-Order Controllers , 2003 .

[25]  V. Arnold ON MATRICES DEPENDING ON PARAMETERS , 1971 .

[26]  Michael L. Overton,et al.  Digital Object Identifier (DOI) 10.1007/s101070100225 , 2022 .

[27]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[28]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[29]  Adrian S. Lewis,et al.  Stabilization via Nonsmooth, Nonconvex Optimization , 2006, IEEE Transactions on Automatic Control.

[30]  A. Lewis,et al.  Optimizing Matrix Stability , 1999 .

[31]  Radford M. Neal,et al.  ANALYSIS OF A NONREVERSIBLE MARKOV CHAIN SAMPLER , 2000 .

[32]  Vincent D. Blondel,et al.  Survey on the State of Systems and Control , 1995, Eur. J. Control.

[33]  Adrian S. Lewis,et al.  Variational Analysis of Pseudospectra , 2008, SIAM J. Optim..

[34]  J. Burke,et al.  On the Subdifferential Regularity of Max Root Functions for Polynomials , 2012 .

[35]  Bernd Weissmuller,et al.  Analytic Feedback System Design An Interpolation Approach , 2016 .

[36]  Xiaochang A. Wang Grassmannian, central projection, and output feedback pole assignment of linear systems , 1996, IEEE Trans. Autom. Control..

[37]  A. Lewis,et al.  Two numerical methods for optimizing matrix stability , 2002 .

[38]  Ying Xiong Nonlinear Optimization , 2014 .

[39]  J. Pearson Linear multivariable control, a geometric approach , 1977 .