Towards Tight Bounds for the Streaming Set Cover Problem

We consider the classic Set Cover problem in the data stream model. For n elements and m sets (m ≥ n) we give a O(1/δ)-pass algorithm with a strongly sub-linear ~O(mnδ) space and logarithmic approximation factor. This yields a significant improvement over the earlier algorithm of Demaine et al. [10] that uses exponentially larger number of passes. We complement this result by showing that the tradeoff between the number of passes and space exhibited by our algorithm is tight, at least when the approximation factor is equal to 1. Specifically, we show that any algorithm that computes set cover exactly using ({1 over 2δ}-1) passes must use ~Ω(mnδ) space in the regime of m=O(n). Furthermore, we consider the problem in the geometric setting where the elements are points in R2 and sets are either discs, axis-parallel rectangles, or fat triangles in the plane, and show that our algorithm (with a slight modification) uses the optimal ~O(n) space to find a logarithmic approximation in O(1/δ) passes. Finally, we show that any randomized one-pass algorithm that distinguishes between covers of size 2 and 3 must use a linear (i.e., Ω(mn)) amount of space. This is the first result showing that a randomized, approximate algorithm cannot achieve a space bound that is sublinear in the input size. This indicates that using multiple passes might be necessary in order to achieve sub-linear space bounds for this problem while guaranteeing small approximation factors.

[1]  Alexander A. Razborov,et al.  On the Distributional Complexity of Disjointness , 1992, Theor. Comput. Sci..

[2]  Pankaj K. Agarwal,et al.  Near-Linear Algorithms for Geometric Hitting Sets and Set Covers , 2014, Discrete & Computational Geometry.

[3]  Noam Nisan,et al.  The Communication Complexity of Approximate Set Packing and Covering , 2002, ICALP.

[4]  Graham Cormode,et al.  Set cover algorithms for very large datasets , 2010, CIKM.

[5]  Amit Chakrabarti,et al.  Incidence Geometries and the Pass Complexity of Semi-Streaming Set Cover , 2015, SODA.

[6]  Tomás Feder,et al.  Optimal algorithms for approximate clustering , 1988, STOC '88.

[7]  Noga Alon,et al.  Algorithmic construction of sets for k-restrictions , 2006, TALG.

[8]  Adi Rosén,et al.  Semi-Streaming Set Cover , 2014, ACM Trans. Algorithms.

[9]  Sudipto Guha,et al.  Lower Bounds for Quantile Estimation in Random-Order and Multi-pass Streaming , 2007, ICALP.

[10]  Nabil H. Mustafa,et al.  Settling the APX-Hardness Status for Geometric Set Cover , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[11]  Robert J. Fowler,et al.  Optimal Packing and Covering in the Plane are NP-Complete , 1981, Inf. Process. Lett..

[12]  Dana Moshkovitz,et al.  The Projection Games Conjecture and the NP-Hardness of ln n-Approximating Set-Cover , 2012, Theory Comput..

[13]  Micha Sharir,et al.  Small-Size $\eps$-Nets for Axis-Parallel Rectangles and Boxes , 2010, SIAM J. Comput..

[14]  David Steurer,et al.  Analytical approach to parallel repetition , 2013, STOC.

[15]  Lise Getoor,et al.  On Maximum Coverage in the Streaming Model & Application to Multi-topic Blog-Watch , 2009, SDM.

[16]  Venkatesan Guruswami,et al.  Superlinear Lower Bounds for Multipass Graph Processing , 2012, Algorithmica.

[17]  Ravi Kumar,et al.  Max-cover in map-reduce , 2010, WWW '10.

[18]  Sariel Har-Peled,et al.  Geometric packing under non-uniform constraints , 2011, SoCG '12.

[19]  Micha Sharir,et al.  Relative (p,ε)-Approximations in Geometry , 2011, Discret. Comput. Geom..

[20]  Yang Li,et al.  Tight bounds for single-pass streaming complexity of the set cover problem , 2016, STOC.

[21]  Bala Kalyanasundaram,et al.  The Probabilistic Communication Complexity of Set Intersection , 1992, SIAM J. Discret. Math..

[22]  Ran Raz,et al.  A sub-constant error-probability low-degree test, and a sub-constant error-probability PCP characterization of NP , 1997, STOC '97.

[23]  Sergei Vassilvitskii,et al.  Fast greedy algorithms in mapreduce and streaming , 2013, SPAA.

[24]  Sudipto Guha,et al.  Tight Lower Bounds for Multi-pass Stream Computation Via Pass Elimination , 2008, ICALP.

[25]  Ziv Bar-Yossef,et al.  An information statistics approach to data stream and communication complexity , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[26]  T. Grossman,et al.  Computational Experience with Approximation Algorithms for the Set Covering Problem , 1994 .

[27]  Piotr Indyk,et al.  On Streaming and Communication Complexity of the Set Cover Problem , 2014, DISC.

[28]  BORIS ARONOV,et al.  Small-size ε-nets for axis-parallel rectangles and boxes , 2009, STOC '09.

[29]  Kent Quanrud,et al.  Approximation Algorithms for Polynomial-Expansion and Low-Density Graphs , 2015, ESA.

[30]  Kenneth L. Clarkson,et al.  Applications of random sampling in computational geometry, II , 1988, SCG '88.

[31]  Kenneth L. Clarkson,et al.  Improved Approximation Algorithms for Geometric Set Cover , 2005, Discret. Comput. Geom..