The Geometry of Online Packing Linear Programs

We consider packing linear programs with m rows where all constraint coefficients are normalized to be in the unit interval. The n columns arrive in random order and the goal is to set the corresponding decision variables irrevocably when they arrive to obtain a feasible solution maximizing the expected reward. Previous 1-e-competitive algorithms require the right-hand side of the linear program to be Ωm/e2logn/e, a bound that worsens with the number of columns and rows. However, the dependence on the number of columns is not required in the single-row case, and known lower bounds for the general case are also independent of n. Our goal is to understand whether the dependence on n is required in the multirow case, making it fundamentally harder than the single-row version. We refute this by exhibiting an algorithm that is 1-e-competitive as long as the right-hand sides are Ωm2/e2logm/e. Our techniques refine previous probably approximately correct learning based approaches that interpret the online decisions as linear classifications of the columns based on sampled dual prices. The key ingredient of our improvement comes from a nonstandard covering argument together with the realization that only when the columns of the linear program belong to few one-dimensional subspaces we can obtain such small covers; bounding the size of the cover constructed also relies on the geometry of linear classifiers. General packing linear programs are handled by perturbing the input columns, which can be seen as making the learning problem more robust.

[1]  Morteza Zadimoghaddam,et al.  Submodular secretary problem and extensions , 2013, TALG.

[2]  Michael Dinitz,et al.  Secretary problems: weights and discounts , 2009, SODA.

[3]  Antonio Alonso Ayuso,et al.  Introduction to Stochastic Programming , 2009 .

[4]  Joseph Naor,et al.  Online Primal-Dual Algorithms for Covering and Packing , 2009, Math. Oper. Res..

[5]  Luc Devroye,et al.  Distribution-free performance bounds for potential function rules , 1979, IEEE Trans. Inf. Theory.

[6]  José A. Soto,et al.  Matroid secretary problem in the random assignment model , 2010, SODA '11.

[7]  Allan Borodin,et al.  Online computation and competitive analysis , 1998 .

[8]  C. Kenyon Best-fit bin-packing with random order , 1996, SODA '96.

[9]  Partha Niyogi,et al.  Almost-everywhere Algorithmic Stability and Generalization Error , 2002, UAI.

[10]  Jirí Matousek,et al.  Invitation to discrete mathematics , 1998 .

[11]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[12]  Felipe Cucker,et al.  Learning Theory: An Approximation Theory Viewpoint: Index , 2007 .

[13]  Harvey J. Everett Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .

[14]  Thomas P. Hayes,et al.  The adwords problem: online keyword matching with budgeted bidders under random permutations , 2009, EC '09.

[15]  John M. Wilson,et al.  Introduction to Stochastic Programming , 1998, J. Oper. Res. Soc..

[16]  John R. Birge,et al.  Introduction to Stochastic Programming , 1997 .

[17]  Jon Feldman,et al.  Online Stochastic Packing Applied to Display Ad Allocation , 2010, ESA.

[18]  Jiri Matousek,et al.  Lectures on discrete geometry , 2002, Graduate texts in mathematics.

[19]  Felipe Cucker,et al.  Learning Theory: An Approximation Theory Viewpoint (Cambridge Monographs on Applied & Computational Mathematics) , 2007 .

[20]  Aranyak Mehta,et al.  Online budgeted matching in random input models with applications to Adwords , 2008, SODA '08.

[21]  Zizhuo Wang,et al.  A Dynamic Near-Optimal Algorithm for Online Linear Programming , 2009, Oper. Res..

[22]  Yajun Wang,et al.  Secretary problems: laminar matroid and interval scheduling , 2011, SODA '11.

[23]  Vijay V. Vazirani,et al.  Approximation Algorithms , 2001, Springer Berlin Heidelberg.

[24]  Richard M. Karp,et al.  An optimal algorithm for on-line bipartite matching , 1990, STOC '90.

[25]  Nicole Immorlica,et al.  Online auctions and generalized secretary problems , 2008, SECO.

[26]  F. Mosteller,et al.  Recognizing the Maximum of a Sequence , 1966 .

[27]  Nikhil R. Devanur,et al.  Near optimal online algorithms and fast approximation algorithms for resource allocation problems , 2011, EC '11.

[28]  Nicole Immorlica,et al.  A Knapsack Secretary Problem with Applications , 2007, APPROX-RANDOM.

[29]  Robert D. Kleinberg A multiple-choice secretary algorithm with applications to online auctions , 2005, SODA '05.