Intersection Cuts for Polynomial Optimization

We consider dynamically generating linear constraints (cutting planes) to tighten relaxations for polynomial optimization problems. Many optimization problems have feasible set of the form \(S \cap P\), where S is a closed set and P is a polyhedron. Integer programs are in this class and one can construct intersection cuts using convex “forbidden” regions, or S-free sets. Here, we observe that polynomial optimization problems can also be represented as a problem with linear objective function over such a feasible set, where S is the set of real, symmetric matrices representable as outer-products of the form \(xx^T\). Accordingly, we study outer-product-free sets and develop a thorough characterization of several (inclusion-wise) maximal intersection cut families. In addition, we present a cutting plane approach that guarantees polynomial-time separation of an extreme point in \(P\setminus S\) using our outer-product-free sets. Computational experiments demonstrate the promise of our approach from the point of view of strength and speed.

[1]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[2]  Christodoulos A. Floudas,et al.  Global optimization of mixed-integer quadratically-constrained quadratic programs (MIQCQP) through piecewise-linear and edge-concave relaxations , 2012, Mathematical Programming.

[3]  Achiya Dax,et al.  Low-Rank Positive Approximants of Symmetric Matrices , 2014 .

[4]  Matteo Fischetti,et al.  A New General-Purpose Algorithm for Mixed-Integer Bilevel Linear Programs , 2017, Oper. Res..

[5]  Daniel Bienstock,et al.  Outer-product-free sets for polynomial optimization and oracle-based cuts , 2016, Math. Program..

[6]  L. Mirsky SYMMETRIC GAUGE FUNCTIONS AND UNITARILY INVARIANT NORMS , 1960 .

[7]  Laurence A. Wolsey,et al.  Sufficiency of cut-generating functions , 2015, Math. Program..

[8]  John E. Mitchell,et al.  A unifying framework for several cutting plane methods for semidefinite programming , 2006, Optim. Methods Softw..

[9]  James R. Luedtke,et al.  Some results on the strength of relaxations of multilinear functions , 2012, Math. Program..

[10]  James B. Orlin,et al.  On the complexity of four polyhedral set containment problems , 2018, Math. Program..

[11]  Gérard Cornuéjols,et al.  Minimal Valid Inequalities for Integer Constraints , 2009, Math. Oper. Res..

[12]  Claus-Peter Schnorr,et al.  Geometry of Numbers and Integer Programming (Summary) , 1988, STACS.

[13]  M. Laurent Sums of Squares, Moment Matrices and Optimization Over Polynomials , 2009 .

[14]  Hiroshi Hirai,et al.  Discrete convexity and polynomial solvability in minimum 0-extension problems , 2013, Math. Program..

[15]  Nikolaos V. Sahinidis,et al.  Multiterm polyhedral relaxations for nonconvex, quadratically constrained quadratic programs , 2009, Optim. Methods Softw..

[16]  Hanif D. Sherali,et al.  Enhancing RLT relaxations via a new class of semidefinite cuts , 2002, J. Glob. Optim..

[17]  Gennadiy Averkov,et al.  On finite generation and infinite convergence of generalized closures from the theory of cutting planes , 2011, 1106.1526.

[18]  Andrew J. Schaefer,et al.  Totally unimodular stochastic programs , 2012, Mathematical Programming.

[19]  Alper Atamtürk,et al.  Conic mixed-integer rounding cuts , 2009, Math. Program..

[20]  Jon Lee,et al.  Convex relaxations of non-convex mixed integer quadratically constrained programs: extended formulations , 2010, Math. Program..

[21]  Laurence A. Wolsey,et al.  Constrained Infinite Group Relaxations of MIPs , 2010, SIAM J. Optim..

[22]  Laurence A. Wolsey,et al.  Inequalities from Two Rows of a Simplex Tableau , 2007, IPCO.

[23]  Daniel Kuhn,et al.  Distributionally robust multi-item newsvendor problems with multimodal demand distributions , 2014, Mathematical Programming.

[24]  Juan Pablo Vielma,et al.  Intersection cuts for nonlinear integer programming: convexification techniques for structured sets , 2013, Mathematical Programming.

[25]  Miguel F. Anjos,et al.  A dynamic inequality generation scheme for polynomial programming , 2016, Math. Program..

[26]  Hanif D. Sherali,et al.  Nondifferentiable reverse convex programs and facetial convexity cuts via a disjunctive characterization , 1987, Math. Program..

[27]  Daniel Bienstock,et al.  Cutting-Planes for Optimization of Convex Functions over Nonconvex Sets , 2014, SIAM J. Optim..

[28]  Oktay Günlük,et al.  Globally solving nonconvex quadratic programming problems with box constraints via integer programming methods , 2018, Math. Program. Comput..

[29]  Ellis L. Johnson,et al.  Some continuous functions related to corner polyhedra , 1972, Math. Program..

[30]  George L. Nemhauser,et al.  A branch-and-cut algorithm for nonconvex quadratic programs with box constraints , 2005, Math. Program..

[31]  Alper Atamtürk,et al.  A spatial branch-and-cut method for nonconvex QCQP with bounded complex variables , 2016, Math. Program..

[32]  J. Gallier Quadratic Optimization Problems , 2020, Linear Algebra and Optimization with Applications to Machine Learning.

[33]  Nikolaos V. Sahinidis,et al.  Convex extensions and envelopes of lower semi-continuous functions , 2002, Math. Program..

[34]  Fabio Schoen,et al.  On convex envelopes for bivariate functions over polytopes , 2014, Math. Program..

[35]  Santanu S. Dey,et al.  Matrix minor reformulation and SOCP-based spatial branch-and-cut method for the AC optimal power flow problem , 2017, Math. Program. Comput..

[36]  Anatoliy D. Rikun,et al.  A Convex Envelope Formula for Multilinear Functions , 1997, J. Glob. Optim..

[37]  Gérard Cornuéjols,et al.  Cut-Generating Functions and S-Free Sets , 2015, Math. Oper. Res..

[38]  Pietro Belotti,et al.  On families of quadratic surfaces having fixed intersections with two hyperplanes , 2013, Discret. Appl. Math..

[39]  Fabio Tardella,et al.  Existence and sum decomposition of vertex polyhedral convex envelopes , 2008, Optim. Lett..

[40]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[41]  S. E. Jacobsen,et al.  Reverse convex programming , 1980 .

[42]  Pietro Belotti,et al.  Linear Programming Relaxations of Quadratically Constrained Quadratic Programs , 2012, ArXiv.

[43]  Gérard Cornuéjols,et al.  Maximal Lattice-Free Convex Sets in Linear Subspaces , 2010, Math. Oper. Res..

[44]  Kent Andersen,et al.  An Analysis of Mixed Integer Linear Sets Based on Lattice Point Free Convex Sets , 2009, Math. Oper. Res..

[45]  Samuel Burer,et al.  Optimizing a polyhedral-semidefinite relaxation of completely positive programs , 2010, Math. Program. Comput..

[46]  Garth P. McCormick,et al.  Computability of global solutions to factorable nonconvex programs: Part I — Convex underestimating problems , 1976, Math. Program..

[47]  Gérard Cornuéjols,et al.  Minimal Inequalities for an Infinite Relaxation of Integer Programs , 2010, SIAM J. Discret. Math..

[48]  Egon Balas,et al.  Intersection Cuts - A New Type of Cutting Planes for Integer Programming , 1971, Oper. Res..

[49]  Peter Richtárik,et al.  Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function , 2011, Mathematical Programming.

[50]  Fatma Kilinç-Karzan,et al.  On Minimal Valid Inequalities for Mixed Integer Conic Programs , 2014, Math. Oper. Res..

[51]  Kurt M. Anstreicher,et al.  Institute for Mathematical Physics Semidefinite Programming versus the Reformulation–linearization Technique for Nonconvex Quadratically Constrained Quadratic Programming Semidefinite Programming versus the Reformulation-linearization Technique for Nonconvex Quadratically Constrained , 2022 .

[52]  Laurence A. Wolsey,et al.  Lifting Integer Variables in Minimal Inequalities Corresponding to Lattice-Free Triangles , 2008, IPCO.

[53]  Jean-Philippe P. Richard,et al.  KRANNERT GRADUATE SCHOOL OF MANAGEMENT , 2010 .