Solving Rank-Constrained Semidefinite Programs in Exact Arithmetic

Abstract We consider the problem of minimizing a linear function over an affine section of the cone of positive semidefinite matrices, with the additional constraint that the feasible matrix has prescribed rank. When the rank constraint is active, this is a non-convex optimization problem, otherwise it is a semidefinite program. Both find numerous applications especially in systems control theory and combinatorial optimization, but even in more general contexts such as polynomial optimization or real algebra. While numerical algorithms exist for solving this problem, such as interior-point or Newton-like algorithms, in this paper we propose an approach based on symbolic computation. We design an exact algorithm for solving rank-constrained semidefinite programs, whose complexity is essentially quadratic on natural degree bounds associated to the given optimization problem: for subfamilies of the problem where the size of the feasible matrix, or the dimension of the affine section, is fixed, the algorithm is polynomial time. The algorithm works under assumptions on the input data: we prove that these assumptions are generically satisfied. We implement it in Maple and discuss practical experiments.

[1]  David A. Cox,et al.  Ideals, Varieties, and Algorithms: An Introduction to Computational Algebraic Geometry and Commutative Algebra, 3/e (Undergraduate Texts in Mathematics) , 2007 .

[2]  David P. Williamson,et al.  Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming , 1995, JACM.

[3]  Fabrice Rouillier,et al.  Solving Zero-Dimensional Systems Through the Rational Univariate Representation , 1999, Applicable Algebra in Engineering, Communication and Computing.

[4]  V. Powers,et al.  An algorithm for sums of squares of real polynomials , 1998 .

[5]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[6]  Simone Naldi Solving Rank-Constrained Semidefinite Programs in Exact Arithmetic , 2016, ISSAC.

[7]  Ariel Waissbein,et al.  Deformation Techniques for Sparse Systems , 2006, Found. Comput. Math..

[8]  Mohab Safey El Din,et al.  SPECTRA – a Maple library for solving linear matrix inequalities in exact arithmetic , 2016, Optim. Methods Softw..

[9]  Leonid Khachiyan,et al.  On the Complexity of Semidefinite Programs , 1997, J. Glob. Optim..

[10]  Victor Y. Pan,et al.  Nearly optimal refinement of real roots of a univariate polynomial , 2016, J. Symb. Comput..

[11]  Bernd Sturmfels,et al.  The algebraic degree of semidefinite programming , 2010, Math. Program..

[12]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[13]  M. Laurent,et al.  Complexity of the positive semidefinite matrix completion problem with a rank constraint , 2012, 1203.6602.

[14]  John B. Moore,et al.  A Newton-like method for solving rank constrained linear matrix inequalities , 2006, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[15]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[16]  I. Shafarevich Basic algebraic geometry , 1974 .

[17]  L. Lovász,et al.  Geometric Algorithms and Combinatorial Optimization , 1981 .

[18]  Pablo A. Parrilo,et al.  Semidefinite programming relaxations for semialgebraic problems , 2003, Math. Program..

[19]  Jean-Charles Faugère,et al.  Computing loci of rank defects of linear matrices using Gröbner bases and applications to cryptology , 2010, ISSAC.

[20]  Chenqi Mou,et al.  Fast algorithm for change of ordering of zero-dimensional Gröbner bases with sparse multiplication matrices , 2011, ISSAC '11.

[21]  Arkadi Nemirovski,et al.  Lectures on modern convex optimization - analysis, algorithms, and engineering applications , 2001, MPS-SIAM series on optimization.

[22]  Mohab Safey El Din,et al.  Real root finding for determinants of linear matrices , 2014, J. Symb. Comput..

[23]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[24]  Mohab Safey El Din,et al.  Real root finding for low rank linear matrices , 2015, Applicable Algebra in Engineering, Communication and Computing.

[25]  Lynn Chua,et al.  Gram Spectrahedra. , 2016, 1608.00234.

[26]  Éric Schost,et al.  A Nearly Optimal Algorithm for Deciding Connectivity Queries in Smooth and Bounded Real Algebraic Sets , 2013, J. ACM.

[27]  Mohab Safey El Din,et al.  Exact algorithms for linear matrix inequalities , 2015, SIAM J. Optim..

[28]  Mohab Safey El Din,et al.  Real Root Finding for Rank Defects in Linear Hankel Matrices , 2015, ISSAC.

[29]  Grigoriy Blekherman,et al.  LOW-RANK SUM-OF-SQUARES REPRESENTATIONS ON VARIETIES OF MINIMAL DEGREE , 2016, 1606.04387.

[30]  D. Eisenbud Commutative Algebra: with a View Toward Algebraic Geometry , 1995 .

[31]  Joris van der Hoeven,et al.  Mathematical Software - ICMS 2010, Third International Congress on Mathematical Software, Kobe, Japan, September 13-17, 2010. Proceedings , 2010, ICMS.

[32]  Mohab Safey El Din,et al.  Probabilistic Algorithm for Polynomial Optimization over a Real Algebraic Set , 2013, SIAM J. Optim..

[33]  Jiawang Nie,et al.  Optimality conditions and finite convergence of Lasserre’s hierarchy , 2012, Math. Program..

[34]  John B. Moore,et al.  Brief paper A Newton-like method for solving rank constrained linear matrix inequalities , 2006 .

[35]  J. Lasserre,et al.  Handbook on Semidefinite, Conic and Polynomial Optimization , 2012 .

[36]  Jean-Charles Faugère,et al.  FGb: A Library for Computing Gröbner Bases , 2010, ICMS.