Online optimization in the random-order model

In an online problem, information is revealed incrementally and decisions have to be made before the full information is known. This occurs in various applications like, for example, resource allocation or online ad assignment. To analyze the performance of algorithms for online problems, it is classically assumed that there is a malicious adversary who always provides the worst-possible input. This, however, is a very pessimistic assumption. Therefore, in recent years, a lot of research has been done to analyze input models where the power of the adversary is restricted. In this thesis, we consider online optimization problems in the random-order model. In this online model, an adversary specifies an input instance in advance but, in contrast to the classic model, he may not determine the order in which it is revealed to the algorithm. Instead, the input sequence is revealed in random order. We analyze several combinatorial generalizations of the famous secretary problem and present algorithms with improved competitive ratios for each of them. Specifically, the problems considered here are of packing type, namely, bipartite matching, combinatorial auctions, generalized assignment and packing linear programs. First, we analyze the edge-weighted bipartite matching problem where the vertices of one side arrive online in random order. For this problem, we give a surprisingly simple algorithm that generalizes the classic algorithm for the secretary problem. Since its expected competitive ratio matches the best-possible one for the secretary problem, the algorithm is optimal. The result also gives the best-possible competitive ratio for the matroid secretary problem on transversal matroids. Then, we present improved competitive ratios for combinatorial auctions with online bidders arriving in random order. They are generalizations of the weighted matching problem and we analyze various types of valuation functions. Namely, we consider auctions where the bidders are interested in bundles of bounded or unbounded cardinality or where the valuation functions are submodular. For the online generalized assignment problem, which is another generalization of the weighted matching problem, we present the first constant-competitive algorithm. This result also improves on the best known competitive ratio for the online knapsack problem. Finally, we consider online packing LPs where the variables are revealed online in random order. For these, we present an algorithm that obtains the best-possible competitive ratio on instances with high capacity ratio, i. e., where, for every row, the capacity is large compared to the maximum entry in the constraint matrix. Furthermore, this algorithm also gives close-to-optimal results when the capacity ratio is only bounded by a constant. Additionally, we show how to modify the algorithm in the presence of strategic agents to obtain a truthful mechanism with almost identical competitive ratio.

[1]  Aranyak Mehta,et al.  Online budgeted matching in random input models with applications to Adwords , 2008, SODA '08.

[2]  Patrick Jaillet,et al.  Advances on Matroid Secretary Problems: Free Order Model and Laminar Case , 2012, IPCO.

[3]  Deeparnab Chakrabarty,et al.  Approximability of Sparse Integer Programs , 2009, Algorithmica.

[4]  Claire Mathieu,et al.  On-line bipartite matching made simple , 2008, SIGA.

[5]  Mohit Singh,et al.  Secretary Problems via Linear Programming , 2010, IPCO.

[6]  Joseph Naor,et al.  Online Primal-Dual Algorithms for Covering and Packing , 2009, Math. Oper. Res..

[7]  C. Greg Plaxton,et al.  Competitive Weighted Matching in Transversal Matroids , 2008, ICALP.

[8]  R. Ravi,et al.  Geometry of Online Packing Linear Programs , 2012, ICALP.

[9]  Berthold Vöcking,et al.  An Optimal Online Algorithm for Weighted Bipartite Matching and Extensions to Combinatorial Auctions , 2013, ESA.

[10]  Mohammad Mahdian,et al.  Online bipartite matching with random arrivals: an approach based on strongly factor-revealing LPs , 2011, STOC '11.

[11]  Nikhil R. Devanur,et al.  Near optimal online algorithms and fast approximation algorithms for resource allocation problems , 2011, EC '11.

[12]  Zizhuo Wang,et al.  A Dynamic Near-Optimal Algorithm for Online Linear Programming , 2009, Oper. Res..

[13]  Nicole Immorlica,et al.  A Knapsack Secretary Problem with Applications , 2007, APPROX-RANDOM.

[14]  Yossi Azar,et al.  Combinatorial Algorithms for the Unsplittable Flow Problem , 2005, Algorithmica.

[15]  Aranyak Mehta,et al.  Online bipartite matching with unknown distributions , 2011, STOC '11.

[16]  Aranyak Mehta,et al.  AdWords and Generalized On-line Matching , 2005, FOCS.

[17]  Ola Svensson,et al.  A Simple Order-Oblivious O(log log(rank))-Competitive Algorithm for the Matroid Secretary Problem , 2014, ArXiv.

[18]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[19]  Berthold Vöcking,et al.  Online Packing with Gradually Improving Capacity Estimations and Applications to Network Lifetime Maximization , 2012, ICALP.

[20]  Dirk Müller,et al.  Faster min–max resource sharing in theory and practice , 2011, Math. Program. Comput..

[21]  José A. Soto,et al.  Matroid secretary problem in the random assignment model , 2010, SODA '11.

[22]  Robert D. Kleinberg A multiple-choice secretary algorithm with applications to online auctions , 2005, SODA '05.

[23]  Nikhil R. Devanur,et al.  Randomized Primal-Dual analysis of RANKING for Online BiPartite Matching , 2013, SODA.

[24]  Oded Schwartz,et al.  On the complexity of approximating k-set packing , 2006, computational complexity.

[25]  Harald Niederreiter,et al.  Probability and computing: randomized algorithms and probabilistic analysis , 2006, Math. Comput..

[26]  Gagan Goel,et al.  Online Vertex-Weighted Bipartite Matching and Single-bid Budgeted Allocations , 2010, SODA.

[27]  Daniel Lehmann,et al.  Combinatorial auctions with decreasing marginal utilities , 2001, EC '01.

[28]  Thomas P. Hayes,et al.  The adwords problem: online keyword matching with budgeted bidders under random permutations , 2009, EC '09.

[29]  David Lindley,et al.  Dynamic Programming and Decision Theory , 1961 .

[30]  Tengyu Ma,et al.  The Simulated Greedy Algorithm for Several Submodular Matroid Secretary Problems , 2013, STACS.

[31]  Joseph Naor,et al.  Improved Competitive Ratios for Submodular Secretary Problems (Extended Abstract) , 2011, APPROX-RANDOM.

[32]  Richard M. Karp,et al.  An optimal algorithm for on-line bipartite matching , 1990, STOC '90.

[33]  Martin Pál,et al.  Algorithms for Secretary Problems on Graphs and Hypergraphs , 2008, ICALP.

[34]  Jon Feldman,et al.  Online Stochastic Packing Applied to Display Ad Allocation , 2010, ESA.

[35]  Michael Dinitz,et al.  Recent advances on the matroid secretary problem , 2013, SIGA.

[36]  Joseph Naor,et al.  Online Primal-Dual Algorithms for Maximizing Ad-Auctions Revenue , 2007, ESA.

[37]  Berthold Vöcking,et al.  Primal beats dual on online packing LPs in the random-order model , 2013, STOC.

[38]  Alessandro Panconesi,et al.  Concentration of Measure for the Analysis of Randomized Algorithms , 2009 .

[39]  J. Munkres ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[40]  David P. Williamson,et al.  The Design of Approximation Algorithms , 2011 .

[41]  Berthold Vöcking,et al.  Online Mechanism Design (Randomized Rounding on the Fly) , 2012, ICALP.

[42]  Aravind Srinivasan,et al.  Solving Packing Integer Programs via Randomized Rounding with Alterations , 2012, Theory Comput..

[43]  Allan Borodin,et al.  Online computation and competitive analysis , 1998 .

[44]  Tim Roughgarden,et al.  Algorithmic Game Theory , 2007 .

[45]  Chaitanya Swamy,et al.  Truthful and near-optimal mechanism design via linear programming , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[46]  Nicole Immorlica,et al.  Matroids, secretary problems, and online mechanisms , 2007, SODA '07.

[47]  Oded Lachish,et al.  O(log log Rank) Competitive Ratio for the Matroid Secretary Problem , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[48]  Thomas S. Ferguson,et al.  Who Solved the Secretary Problem , 1989 .

[49]  Sourav Chakraborty,et al.  Improved competitive ratio for the matroid secretary problem , 2012, SODA.

[50]  Aravind Srinivasan,et al.  Randomized Distributed Edge Coloring via an Extension of the Chernoff-Hoeffding Bounds , 1997, SIAM J. Comput..

[51]  Uriel Feige,et al.  Approximation algorithms for allocation problems: Improving the factor of 1 - 1/e , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[52]  Yajun Wang,et al.  Secretary problems: laminar matroid and interval scheduling , 2011, SODA '11.

[53]  P. Freeman The Secretary Problem and its Extensions: A Review , 1983 .

[54]  Robert E. Tarjan,et al.  Amortized efficiency of list update and paging rules , 1985, CACM.

[55]  Uriel Feige,et al.  The Submodular Welfare Problem with Demand Queries , 2010, Theory Comput..