Approximation algorithms for minimum norm and ordered optimization problems

In many optimization problems, a feasible solution induces a multi-dimensional cost vector. For example, in load-balancing a schedule induces a load vector across the machines. In k-clustering, opening k facilities induces an assignment cost vector across the clients. Typically, one seeks a solution which either minimizes the sum- or the max- of this vector, and these problems (makespan minimization, k-median, and k-center) are classic NP-hard problems which have been extensively studied. In this paper we consider the minimum-norm optimization problem. Given an arbitrary monotone, symmetric norm, the problem asks to find a solution which minimizes the norm of the induced cost-vector. Such norms are versatile and include ℓp norms, Top-ℓ norm (sum of the ℓ largest coordinates in absolute value), and ordered norms (non-negative linear combination of Top-ℓ norms), and consequently, the minimum-norm problem models a wide variety of problems under one umbrella, We give a general framework to tackle the minimum-norm problem, and illustrate its efficacy in the unrelated machine load balancing and k-clustering setting. Our concrete results are the following. (a) We give constant factor approximation algorithms for the minimum norm load balancing problem in unrelated machines, and the minimum norm k-clustering problem. To our knowledge, our results constitute the first constant-factor approximations for such a general suite of objectives. (b) For load balancing on unrelated machines, we give a (2+ε)-approximation for ordered load balancing (i.e., min-norm load-balancing under an ordered norm). (c) For k-clustering, we give a (5+ε)-approximation for the ordered k-median problem, which significantly improves upon the previous-best constant-factor approximation (Chakrabarty and Swamy (ICALP 2018); Byrka, Sornat, and Spoerhase (STOC 2018)). (d) Our techniques also imply O(1) approximations to the instance-wise best simultaneous approximation factor for unrelated-machine load-balancing and k-clustering. To our knowledge, these are the first positive simultaneous approximation results in these settings. At a technical level, one of our chief insights is that minimum-norm optimization can be reduced to a special case that we call min-max ordered optimization. Both the reduction, and the task of devising algorithms for the latter problem, require a sparsification idea that we develop, which is of interest for ordered optimization problems. The main ingredient in solving min-max ordered optimization is a deterministic, oblivious rounding procedure (that we devise) for suitable LP relaxations of the load-balancing and k-clustering problem; this may be of independent interest.

[1]  Vijay V. Vazirani,et al.  Approximation algorithms for metric facility location and k-Median problems using the primal-dual schema and Lagrangian relaxation , 2001, JACM.

[2]  Nikhil Bansal,et al.  Additive guarantees for degree bounded directed network design , 2008, SIAM J. Comput..

[3]  Robert Krauthgamer,et al.  Streaming symmetric norms via measure concentration , 2015, STOC.

[4]  Teofilo F. GONZALEZ,et al.  Clustering to Minimize the Maximum Intercluster Distance , 1985, Theor. Comput. Sci..

[5]  David B. Shmoys,et al.  A Bicriteria Approximation Algorithm for the k-Center and k-Median Problems , 2017, WAOA.

[6]  Shi Li,et al.  Approximating k-median via pseudo-approximation , 2012, STOC '13.

[7]  Jan Karel Lenstra,et al.  Approximation algorithms for scheduling unrelated parallel machines , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[8]  Jirí Sgall,et al.  Graph Balancing: A Special Case of Scheduling Unrelated Parallel Machines , 2008, Algorithmica.

[9]  Gerhard J. Woeginger,et al.  All-norm approximation algorithms , 2002, J. Algorithms.

[10]  Aravind Srinivasan,et al.  A unified approach to scheduling on unrelated parallel machines , 2009, JACM.

[11]  Amit Kumar,et al.  Fairness Measures for Resource Allocation , 2006, SIAM J. Comput..

[12]  Yossi Azar,et al.  Convex programming for scheduling unrelated parallel machines , 2005, STOC '05.

[13]  Shi Li,et al.  A Dependent LP-Rounding Approach for the k-Median Problem , 2012, ICALP.

[14]  Éva Tardos,et al.  An approximation algorithm for the generalized assignment problem , 1993, Math. Program..

[15]  Robert D. Carr,et al.  Randomized metarounding , 2002, Random Struct. Algorithms.

[16]  Chaitanya Swamy,et al.  Interpolating between k-Median and k-Center: Approximation Algorithms for Ordered k-Median , 2017, ICALP.

[17]  Arie Tamir,et al.  The k-centrum multi-facility location problem , 2001, Discret. Appl. Math..

[18]  Sanjeev Khanna,et al.  On (1, ∊)-Restricted Assignment Makespan Minimization , 2014, SODA.

[19]  Maxim Sviridenko,et al.  Solving Optimization Problems with Diseconomies of Scale via Decoupling , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[20]  Sudipto Guha,et al.  Improved combinatorial algorithms for the facility location and k-median problems , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[21]  Ola Svensson,et al.  Better Guarantees for k-Means and Euclidean k-Median by Primal-Dual Algorithms , 2020, SIAM J. Comput..

[22]  Justo Puerto,et al.  Location Theory - A Unified Approach , 2005 .

[23]  David K. Smith Theory of Linear and Integer Programming , 1987 .

[24]  Alexandr Andoni,et al.  Approximate near neighbors for general symmetric norms , 2016, STOC.

[25]  Danny Segev,et al.  The ordered k-median problem: surrogate models and approximation algorithms , 2019, Math. Program..

[26]  Anupam Gupta,et al.  Simpler Analyses of Local Search Algorithms for Facility Location , 2008, ArXiv.

[27]  Amit Kumar,et al.  All-Norms and All-L_p-Norms Approximation Algorithms , 2008, FSTTCS.

[28]  Sudipto Guha,et al.  A constant-factor approximation algorithm for the k-median problem (extended abstract) , 1999, STOC '99.

[29]  Klaus Jansen,et al.  On the Configuration-LP of the Restricted Assignment Problem , 2016, SODA.

[30]  Shi Li,et al.  Approximating k-Median via Pseudo-Approximation , 2016, SIAM J. Comput..

[31]  N. Alon,et al.  Approximation schemes for scheduling on parallel machines , 1998 .

[32]  Ashish Goel,et al.  Simultaneous Optimization via Approximate Majorization for Concave Profits or Convex Costs , 2006, Algorithmica.

[33]  Brian Karrer,et al.  Social Hash Partitioner: A Scalable Distributed Hypergraph Partitioner , 2017, Proc. VLDB Endow..

[34]  Jaroslaw Byrka,et al.  Constant-factor approximation for ordered k-median , 2017, STOC.

[35]  Aravind Srinivasan,et al.  An Improved Approximation for k-Median and Positive Correlation in Budgeted Optimization , 2014, SODA.

[36]  B. Awerbuch,et al.  Load Balancing in the Lp Norm , 1995, FOCS 1995.

[37]  Ola Svensson,et al.  Santa Claus schedules jobs on unrelated machines , 2010, STOC '11.

[38]  David B. Shmoys,et al.  A Best Possible Heuristic for the k-Center Problem , 1985, Math. Oper. Res..