Reformulations in Mathematical Programming: Definitions and Systematics

A reformulation of a mathematical program is a formu- lation which shares some properties with, but is in some sense better than, the original program. Reformulations are important with respect to the choice and efficiency of the solution algorithms; furthermore, itis desirable that reformulations can be carried out automatically. Refor- mulation techniques are very common in mathematical programming but interestingly they have never been studied under a common frame- work. This paper attempts to move some steps in this direction. We define a framework for storing and manipulating mathematical pro- gramming formulations, give several fundamental definitions categoriz- ing reformulations in essentially four types (opt-reformulations, narrow- ings, relaxations and approximations). We establish some theoretical results and give reformulation examples for each type.

[1]  George B. Dantzig,et al.  Linear programming and extensions , 1965 .

[2]  Leo Liberti,et al.  Writing Global Optimization Software , 2006 .

[3]  G. Mitra,et al.  Reformulation of mathematical programming problems as linear complementarity problems and investigation of their solution methods , 1988 .

[4]  R. Lougee-Heimer,et al.  The Common Optimization INterface for Operations Research: Promoting open-source software in the operations research community , 2003 .

[5]  Philippe Michelon,et al.  A linearization framework for unconstrained quadratic (0-1) problems , 2009, Discret. Appl. Math..

[6]  Hanif D. Sherali,et al.  Reformulation-Linearization Methods for Global Optimization , 2007 .

[7]  R. Fortet L’algebre de Boole et ses applications en recherche operationnelle , 1960 .

[8]  Stephen P. Boyd,et al.  Disciplined Convex Programming , 2006 .

[9]  Leo Liberti,et al.  An Exact Reformulation Algorithm for Large Nonconvex NLPs Involving Bilinear Terms , 2006, J. Glob. Optim..

[10]  C. Adjiman,et al.  A global optimization method, αBB, for general twice-differentiable constrained NLPs—II. Implementation and computational results , 1998 .

[11]  Tsu-Shuan Chang,et al.  A Multivariate Global Optimization Using Linear Bounding Functions , 1998, J. Glob. Optim..

[12]  Leo Liberti,et al.  Reformulation and convex relaxation techniques for global optimization , 2004, 4OR.

[13]  Hanif D. Sherali,et al.  A Hierarchy of Relaxations Between the Continuous and Convex Hull Representations for Zero-One Programming Problems , 1990, SIAM J. Discret. Math..

[14]  Jacques Desrosiers,et al.  On the choice of explicit stabilizing terms in column generation , 2007, Discret. Appl. Math..

[15]  Melvyn Sim,et al.  The Price of Robustness , 2004, Oper. Res..

[16]  Christian Prins,et al.  Applications of optimisation with Xpress-MP , 2002 .

[17]  Alain Billionnet,et al.  Improving the performance of standard solvers for quadratic 0-1 programs by a tight convex reformulation: The QCR method , 2009, Discret. Appl. Math..

[18]  M. Plateau Reformulations quadratiques convexes pour la programmation quadratique en variables 0-1 , 2006 .

[19]  Leo Liberti,et al.  Convex Envelopes of Monomials of Odd Degree , 2003, J. Glob. Optim..

[20]  Tapio Westerlund,et al.  Automated reformulation of disjunctive constraints in MINLP optimization , 1999 .

[21]  Javier Peña,et al.  Exploiting equalities in polynomial programming , 2008, Oper. Res. Lett..

[22]  Christian Waibel Pruning by Isomorphism in Branch-and-Cut , 2008 .

[23]  Hanif D. Sherali,et al.  A global optimization algorithm for polynomial programming problems using a Reformulation-Linearization Technique , 1992, J. Glob. Optim..

[24]  R. Horst,et al.  Global Optimization: Deterministic Approaches , 1992 .

[25]  James E. Falk,et al.  Jointly Constrained Biconvex Programming , 1983, Math. Oper. Res..

[26]  Hanif D. Sherali,et al.  Improving Discrete Model Representations via Symmetry Considerations , 2001, Manag. Sci..

[27]  Tapio Westerlund Some Transformation Techniques in Global Optimization , 2006 .

[28]  Nenad Mladenovic,et al.  Reformulation descent applied to circle packing problems , 2003, Comput. Oper. Res..

[29]  Jakob Puchinger,et al.  Relaxation Guided Variable Neighborhood Search , 2005 .

[30]  Hanif D. Sherali,et al.  A new reformulation-linearization technique for bilinear programming problems , 1992, J. Glob. Optim..

[31]  Hanif D. Sherali,et al.  New reformulation linearization/convexification relaxations for univariate and multivariate polynomial programming problems , 1997, Oper. Res. Lett..

[32]  S. Onn,et al.  Expressing Combinatorial Optimization Problems by Systems of Polynomial Equations and the Nullstellensatz , 2007, 0706.0578.

[33]  Fabio Tardella,et al.  Existence and sum decomposition of vertex polyhedral convex envelopes , 2008, Optim. Lett..

[34]  Christodoulos A. Floudas,et al.  Trilinear Monomials with Mixed Sign Domains: Facets of the Convex and Concave Envelopes , 2004, J. Glob. Optim..

[35]  Alain Billionnet,et al.  Using a Mixed Integer Quadratic Programming Solver for the Unconstrained Quadratic 0-1 Problem , 2007, Math. Program..

[36]  Hanif D. Sherali,et al.  Global optimization of nonconvex factorable programming problems , 2001, Math. Program..

[37]  Warren P. Adams,et al.  A Tight Linearization and an Algorithm for Zero-One Quadratic Programming Problems , 1986 .

[38]  Olvi L. Mangasarian,et al.  Linear complementarity problems solvable by A single linear program , 1976, Math. Program..

[39]  Edward M. B. Smith,et al.  Global optimisation of nonconvex MINLPs , 1997 .

[40]  Olvi L. Mangasarian,et al.  The linear complementarity problem as a separable bilinear program , 1995, J. Glob. Optim..

[41]  Leo Liberti Linearity Embedded in Nonconvex Programs , 2005, J. Glob. Optim..

[42]  Nimrod Megiddo,et al.  An interior point potential reduction algorithm for the linear complementarity problem , 1992, Math. Program..

[43]  Nils Tönshoff,et al.  Implementation and Computational Results , 1997 .

[44]  Pierre Hansen,et al.  Pooling Problem: Alternate Formulations and Solution Methods , 2000, Manag. Sci..

[45]  Warren P. Adams,et al.  A hierarchy of relaxation between the continuous and convex hull representations , 1990 .

[46]  Edward M. B. Smith,et al.  On the optimal design of continuous processes , 1996 .

[47]  Jiming Liu,et al.  On bilevel programming, Part I: General nonlinear cases , 1995, Math. Program..

[48]  Philippe Michelon,et al.  “Miniaturized” Linearizations for Quadratic 0/1 Problems , 2005, Ann. Oper. Res..

[49]  A. S. Strekalovsky Extremal problems with D.C.-constraints , 2001 .

[50]  Miguel A. Lejeune,et al.  MIP reformulations of the probabilistic set covering problem , 2010, Math. Program..

[51]  Leo Liberti,et al.  Reduction constraints for the global optimization of NLPs , 2004 .

[52]  Garth P. McCormick,et al.  Computability of global solutions to factorable nonconvex programs: Part I — Convex underestimating problems , 1976, Math. Program..

[53]  Hanif D. Sherali,et al.  Global Optimization of Nonconvex Polynomial Programming Problems Having Rational Exponents , 1998, J. Glob. Optim..

[54]  Lars Svensson,et al.  Computing global minima to polynomial optimization problems using Gröbner bases , 1995, J. Glob. Optim..

[55]  Reiner Horst,et al.  On the convexification of nonlinear programming problems: An applications-oriented survey , 1984 .

[56]  Antonio Frangioni On a new class of bilevel programming problems and its use for reformulating mixed integer problems , 1995 .

[57]  Warren P. Adams,et al.  A Reformulation-Linearization Technique for Solving Discrete and Continuous Nonconvex Problems , 1998 .

[58]  Jacques Desrosiers,et al.  Stabilization in Column Generation , 2004 .

[59]  Farid Alizadeh,et al.  Interior Point Methods in Semidefinite Programming with Applications to Combinatorial Optimization , 1995, SIAM J. Optim..

[60]  Leo Liberti,et al.  Compact linearization for binary quadratic problems , 2007, 4OR.

[61]  A. Ciric,et al.  A dual temperature simulated annealing approach for solving bilevel programming problems , 1998 .

[62]  Hanif D. Sherali,et al.  A Hierarchy of Relaxations and Convex Hull Characterizations for Mixed-integer Zero-one Programming Problems , 1994, Discret. Appl. Math..

[63]  Kaj-Mikael Björk,et al.  Some convexifications in global optimization of problems containing signomial terms , 2003, Comput. Chem. Eng..

[64]  Pierre Hansen,et al.  Links Between Linear Bilevel and Mixed 0–1 Programming Problems , 1995 .

[65]  Laura Di Giacomo Mathematical Programming Methods in Supply Chain Management , 2009, Encyclopedia of Optimization.

[66]  Stephen P. Boyd,et al.  Tractable approximate robust geometric programming , 2007, Optimization and Engineering.

[67]  S. Vajda,et al.  BOOLEAN METHODS IN OPERATIONS RESEARCH AND RELATED AREAS , 1969 .

[68]  A. Neumaier,et al.  A global optimization method, αBB, for general twice-differentiable constrained NLPs — I. Theoretical advances , 1998 .

[69]  Patrice Marcotte,et al.  Bilevel Programming , 2009, Encyclopedia of Optimization.

[70]  Pierre Hansen,et al.  Improved compact linearizations for the unconstrained quadratic 0-1 minimization problem , 2009, Discret. Appl. Math..

[71]  François Margot,et al.  Exploiting orbits in symmetric ILP , 2003, Math. Program..

[72]  石塚 陽,et al.  On Global Optimality Conditions for D.C. Programming Problems , 1994 .

[73]  Francesco Maffioli,et al.  Mathematical models and a constructive heuristic for finding minimum fundamental cycle bases , 2005, Yugoslav Journal of Operations Research.

[74]  Nikolaos V. Sahinidis,et al.  Convex extensions and envelopes of lower semi-continuous functions , 2002, Math. Program..

[75]  David Kendrick,et al.  GAMS, a user's guide , 1988, SGNM.

[76]  Leo Liberti,et al.  Reformulation in mathematical programming: An application to quantum chemistry , 2009, Discret. Appl. Math..

[77]  P. Hansen Methods of Nonlinear 0-1 Programming , 1979 .

[78]  Nenad Mladenović,et al.  Towards the Optimal Solution of the Multiprocessor Scheduling Problem with Communication Delays , 2007 .

[79]  Fred W. Glover,et al.  Comparisons and enhancement strategies for linearizing mixed 0-1 quadratic programs , 2004, Discret. Optim..

[80]  Kurt M. Anstreicher,et al.  Recent advances in the solution of quadratic assignment problems , 2003, Math. Program..

[81]  Leo Liberti,et al.  Reformulation techniques in mathematical programming , 2009, Discret. Appl. Math..

[82]  Laurence A. Wolsey,et al.  Solving Mixed Integer Programming Problems Using Automatic Reformulation , 1987, Oper. Res..

[83]  Hoang Tuy,et al.  D.C. Optimization: Theory, Methods and Algorithms , 1995 .

[84]  I. Nowak Relaxation and Decomposition Methods for Mixed Integer Nonlinear Programming , 2005 .

[85]  G. Nemhauser,et al.  Integer Programming , 2020 .

[86]  Walid Ben-Ameur,et al.  Routing of Uncertain Traffic Demands , 2005 .

[87]  Edward M. B. Smith,et al.  A symbolic reformulation/spatial branch-and-bound algorithm for the global optimisation of nonconvex MINLPs , 1999 .

[88]  Nikolaos V. Sahinidis,et al.  Global optimization of mixed-integer nonlinear programs: A theoretical and computational study , 2004, Math. Program..

[89]  Hanif D. Sherali,et al.  A Hierarchy of Relaxations Leading to the Convex Hull Representation for General Discrete Optimization Problems , 2005, Ann. Oper. Res..

[90]  N. Maculan,et al.  Global optimization : from theory to implementation , 2006 .

[91]  V. Rich Personal communication , 1989, Nature.

[92]  L. Liberti Comparison of Convex Relaxations for Monomials of Odd Degree , 2003 .

[93]  Sven Leyffer,et al.  User manual for filterSQP , 1998 .

[94]  Leo Liberti,et al.  Automatic Generation of Symmetry-Breaking Constraints , 2008, COCOA.