Presolving and regularization in mixed-integer second-order cone optimization

Mixed-integer second-order cone optimization is a powerful mathematical framework capable of representing both logical conditions and nonlinear relationships in mathematical models of industrial optimization problems. What is more, solution methods are already part of many major commercial solvers including that of MOSEK [72] as well as XPRESS [31], GUROBI [46] and CPLEX [50]. This thesis concerns the performance and reliability of these solvers and makes two contributions; a theoretical one and a practical one. In the theoretical part of the thesis a fundamental issue with reliability, affecting both continuous and mixed-integer conic optimization in general, is discovered and treated. This part of the thesis continues the studies of facial reduction preceding the work of Borwein and Wolkowicz [17] in 1981, when the first algorithmic cure for these kinds of reliability issues were formulated. An important distinction to make between continuous and mixed-integer optimization, however, is that the reliability issues occurring in mixed-integer optimization cannot be blamed on the practitioner’s formulation of the problem. Specifically, as shown, the causes for these issues may well lie within the modifications to the formulation performed by the solution method itself. Hence, this calls for native support of facial reduction mechanisms within the commercial solvers to function reliably. In pursuit of such mechanisms, many fast and accurate heuristics are explored, supplementing the main discovery of this thesis that facial reduction can be interleaved with common optimization methods of high efficiency. Finally, a branch-and-bound method utilizing these mechanisms is established. In the practical part of the thesis, a lack of consensus regarding basic definitions, representations and file formats is found, thereby increasing barriers for benchmarking with decreased market transparency as result. These differences are explored and results in the design of a new file format called The Conic Benchmark Format (CBF). Unlike any other file format for conic optimization, this one is both cross-platform compatible, high performant and future-proof by encompassing other conic extensions. Scripts and tools have moreover been developed to aid parsing (resp. conversion) of the file format in service of software developers (resp. optimization practitioners), and are actively distributed. The functionality of all of this is proven not only by first-class citizenship in the modeling language PICOS [87], but also by The Conic Benchmark Library (CBLIB) where the conversion tools have been used to test its more than a thousand instances with MOSEK and CPLEX. This benchmark library was compiled as part of this thesis in support of studies in performance and reliability, but has yet to be used for the theoretical subjects of this thesis.

[1]  P. Toint,et al.  Testing a class of methods for solving minimization problems with simple bounds on the variables , 1988 .

[2]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[3]  James Renegar,et al.  Incorporating Condition Measures into the Complexity Theory of Linear Programming , 1995, SIAM J. Optim..

[4]  Arthur T. Benjamin Sensible Rules for Remembering Duals - the S-O-B Method , 1995, SIAM Rev..

[5]  Knud D. Andersen,et al.  Computation of collapse states with von Mises type yield condition , 1998 .

[6]  Michael L. Overton,et al.  Computing Limit Loads by Minimizing a Sum of Norms , 1998, SIAM J. Sci. Comput..

[7]  Brian Borchers,et al.  SDPLIB 1.1, A Library of Semidefinite Programming Test Problems , 1998 .

[8]  Stefan Schmieta,et al.  The DIMACS library of semidefinite-quadratic-linear programs , 1999 .

[9]  Michael J. Todd,et al.  Infeasible-start primal-dual methods and infeasibility detectors for nonlinear programming problems , 1999, Math. Program..

[10]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[11]  Robert J. Vanderbei,et al.  Random-process formulation of computationally efficient performance measures for wideband arrays in the far field , 1999, 42nd Midwest Symposium on Circuits and Systems (Cat. No.99CH36356).

[12]  Arkadi Nemirovski,et al.  Lectures on modern convex optimization - analysis, algorithms, and engineering applications , 2001, MPS-SIAM series on optimization.

[13]  Martin Skutella,et al.  Convex quadratic and semidefinite programming relaxations in scheduling , 2001, JACM.

[14]  François Glineur,et al.  Conic optimization: an elegant framework for convex optimization , 2001 .

[15]  D.P. Scholnik,et al.  A specification language for the optimal design of exotic FIR filters with second-order cone programs , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[16]  Franz Rendl,et al.  Computational Experience with Ill-Posed Problems in Semidefinite Programming , 2002, Comput. Optim. Appl..

[17]  Donald Goldfarb,et al.  Second-order cone programming , 2003, Math. Program..

[18]  Kim-Chuan Toh,et al.  Solving semidefinite-quadratic-linear programs using SDPT3 , 2003, Math. Program..

[19]  Thorsten Koch The final NETLIB-LP results , 2004, Oper. Res. Lett..

[20]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[21]  Samir Elhedhli,et al.  Service System Design with Immobile Servers, Stochastic Demand, and Congestion , 2006, Manuf. Serv. Oper. Manag..

[22]  C. Jansson Guaranteed Accuracy for Conic Programming Problems in Vector Lattices , 2007, 0707.4366.

[23]  Oktay Günlük,et al.  IBM Research Report MINLP Strengthening for Separable Convex Quadratic Transportation-Cost UFL , 2007 .

[24]  Miguel F. Anjos,et al.  On Handling Free Variables in Interior-Point Methods for Conic Linear Optimization , 2007, SIAM J. Optim..

[25]  M. Kojima,et al.  SPARSE SECOND ORDER CONE PROGRAMMING FORMULATIONS FOR CONVEX OPTIMIZATION PROBLEMS , 2008 .

[26]  George L. Nemhauser,et al.  A Lifted Linear Programming Branch-and-Bound Algorithm for Mixed-Integer Conic Quadratic Programs , 2008, INFORMS J. Comput..

[27]  S. Ulbrich,et al.  MIXED INTEGER SECOND ORDER CONE PROGRAMMING , 2008 .

[28]  Etienne de Klerk,et al.  A new library of structured semidefinite programming instances , 2009, Optim. Methods Softw..

[29]  Tamás Terlaky,et al.  New stopping criteria for detecting infeasibility in conic optimization , 2009, Optim. Lett..

[30]  Hirokazu Anai,et al.  An effective implementation of a symbolic-numeric cylindrical algebraic decomposition for quantifier elimination , 2009, SNC '09.

[31]  Makoto Yamashita,et al.  A high-performance software package for semidefinite programs: SDPA 7 , 2010 .

[32]  Andrea Lodi,et al.  MIPLIB 2010 , 2011, Math. Program. Comput..

[33]  Pólik Imre,et al.  Conic Optimization Software , 2011 .

[34]  Jeff T. Linderoth,et al.  Algorithms and Software for Convex Mixed Integer Nonlinear Programs , 2012 .

[35]  Timo Berthold,et al.  Extending a CIP framework to solve MIQCPs , 2012 .

[36]  Masakazu Muramatsu,et al.  Strange behaviors of interior-point methods for solving semidefinite programming problems in polynomial optimization , 2012, Comput. Optim. Appl..

[37]  Lisa Turner,et al.  Applications of Second Order Cone Programming , 2012 .

[38]  Julio C. Góez,et al.  Mixed Integer Second Order Cone Optimization, Disjunctive Conic Cuts: Theory and experiments , 2013 .

[39]  Yinyu Ye,et al.  Warmstarting the homogeneous and self-dual interior point method for linear and conic quadratic problems , 2013, Math. Program. Comput..

[40]  Masakazu Muramatsu,et al.  Facial Reduction Algorithms for Conic Optimization Problems , 2012, Journal of Optimization Theory and Applications.

[41]  Frank Permenter,et al.  Solving Conic Optimization Problems via Self-Dual Embedding and Facial Reduction: A Unified Approach , 2017, SIAM J. Optim..