Sorting Network Relaxations for Vector Permutation Problems

The Birkhoff polytope (the convex hull of the set of permutation matrices) is frequently invoked in formulating relaxations of optimization problems over permutations. The Birkhoff polytope is represented using $\Theta(n^2)$ variables and constraints, significantly more than the $n$ variables one could use to represent a permutation as a vector. Using a recent construction of Goemans (2010), we show that when optimizing over the convex hull of the permutation vectors (the permutahedron), we can reduce the number of variables and constraints to $\Theta(n \log n)$ in theory and $\Theta(n \log^2 n)$ in practice. We modify the recent convex formulation of the 2-SUM problem introduced by Fogel et al. (2013) to use this polytope, and demonstrate how we can attain results of similar quality in significantly less computational time for large $n$. To our knowledge, this is the first usage of Goemans' compact formulation of the permutahedron in a convex optimization problem. We also introduce a simpler regularization scheme for this convex formulation of the 2-SUM problem that yields good empirical results.

[1]  Marshall,et al.  [Springer Series in Statistics] Inequalities: Theory of Majorization and Its Applications || Matrix Theory , 2011 .

[2]  D. Kendall Abundance matrices and seriation in archaeology , 1971 .

[3]  F. Hodson The La Tène cemetery at Münsingen-Rain : catalogue and relative chronology , 1968 .

[4]  Niko Vuokko,et al.  Consecutive Ones Property and Spectral Ordering , 2010, SDM.

[5]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[6]  R. Sokal,et al.  Principles of numerical taxonomy , 1965 .

[7]  A. George,et al.  An Analysis of Spectral Envelope Reduction via Quadratic Assignment Problems , 1997, SIAM J. Matrix Anal. Appl..

[8]  Maurice Queyranne,et al.  Polyhedral Approaches to Machine Scheduling , 2008 .

[9]  Alexandre d'Aspremont,et al.  Convex Relaxations for Permutation Problems , 2013, SIAM J. Matrix Anal. Appl..

[10]  Masayuki Takeda,et al.  Online Linear Optimization over Permutations , 2011, ISAAC.

[11]  János Komlós,et al.  An 0(n log n) sorting network , 1983, STOC.

[12]  Chris H. Q. Ding,et al.  Linearized cluster assignment via spectral ordering , 2004, ICML.

[13]  E. Szemerédi,et al.  O(n LOG n) SORTING NETWORK. , 1983 .

[14]  W. S. Robinson A Method for Chronologically Ordering Archaeological Deposits , 1951, American Antiquity.

[15]  Innar Liiv,et al.  Seriation and matrix reordering methods: An historical overview , 2010, Stat. Anal. Data Min..

[16]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .

[17]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[18]  Bruce Hendrickson,et al.  A Spectral Algorithm for Seriation and the Consecutive Ones Problem , 1999, SIAM J. Comput..

[19]  Kenneth E. Batcher,et al.  Sorting networks and their applications , 1968, AFIPS Spring Joint Computing Conference.

[20]  Stephen P. Boyd,et al.  Graph Implementations for Nonsmooth Convex Programs , 2008, Recent Advances in Learning and Control.

[21]  E. Lawler Sequencing Jobs to Minimize Total Weighted Completion Time Subject to Precedence Constraints , 1978 .

[22]  Guillermo Sapiro,et al.  Robust Multimodal Graph Matching: Sparse Coding Meets Graph Matching , 2013, NIPS.

[23]  Michel X. Goemans,et al.  Smallest compact formulation for the permutahedron , 2015, Math. Program..