Quorum placement in networks: minimizing network congestion

A quorum system over a universe of logical elements is a collection of subsets (quorums) of elements, any two of which intersect. In numerous distributed algorithms, the elements of the universe reside on the nodes of a physical network and the participating nodes access the system by contacting every element in some quorum, potentially causing the added network congestion induced by these quorum accesses to play a limiting factor in the performance of the algorithm.In this paper we initiate the study of algorithms to place universe elements on the nodes of a physical network so as to minimize the network congestion that results from quorum accesses, while also ensuring that no physical node is overloaded by access requests from clients. We consider two models, one in which communication routes can be chosen arbitrarily and one in which they are fixed in advance. We show that in either model, the optimal congestion (with respect to the load constraints) cannot be approximated to any factor (unless P=NP). However, we show that at most doubling the load on nodes allows us to achieve a congestion that is close to this optimal value. We also shed some light on the extent to which element migration can reduce congestion in this context.

[1]  Michael Rabinovich,et al.  A performance study of general grid structures for replicated data , 1993, [1993] Proceedings. The 13th International Conference on Distributed Computing Systems.

[2]  David Peleg,et al.  Crumbling walls: a class of practical and efficient quorum systems , 1995, PODC '95.

[3]  Robert H. Thomas,et al.  A Majority consensus approach to concurrency control for multiple copy databases , 1979, ACM Trans. Database Syst..

[4]  Moni Naor,et al.  The load, capacity and availability of quorum systems , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[5]  Prabhakar Raghavan,et al.  Provably good routing in graphs: regular arrays , 1985, STOC '85.

[6]  Mostafa H. Ammar,et al.  The Grid Protocol: A High Performance Scheme for Maintaining Replicated Data , 1992, IEEE Trans. Knowl. Data Eng..

[7]  Sanjeev Khanna,et al.  On multi-dimensional packing problems , 2004, SODA '99.

[8]  David Peleg,et al.  Average probe complexity in quorum systems , 2006, J. Comput. Syst. Sci..

[9]  Bruce M. Maggs,et al.  Exploiting locality for data management in systems of limited bandwidth , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[10]  Ada Wai-Chee Fu Delay-Optimal Quorum Consensus for Distributed Systems , 1997, IEEE Trans. Parallel Distributed Syst..

[11]  Bruce M. Maggs,et al.  Quorum placement in networks to minimize access delays , 2005, PODC '05.

[12]  Tatsuhiro Tsuchiya,et al.  Minimizing the Maximum Delay for Reaching Consensus in Quorum-Based Mutual Exclusion Schemes , 1999, IEEE Trans. Parallel Distributed Syst..

[13]  Harald Räcke,et al.  Minimizing Congestion in General Networks , 2002, FOCS.

[14]  Hector Garcia-Molina,et al.  The Reliability of Voting Mechanisms , 1987, IEEE Transactions on Computers.

[15]  Avishai Wool,et al.  The load and availability of Byzantine quorum systems , 1997, PODC '97.

[16]  Satish Rao,et al.  A polynomial-time tree decomposition to minimize congestion , 2003, SPAA '03.

[17]  Tatsuhiro Tsuchiya,et al.  Minimizing the mean delay of quorum-based mutual exclusion schemes , 2001, J. Syst. Softw..

[18]  Moni Naor,et al.  The Load, Capacity, and Availability of Quorum Systems , 1998, SIAM J. Comput..

[19]  Mamoru Maekawa,et al.  A N algorithm for mutual exclusion in decentralized systems , 1985, TOCS.

[20]  Yair Amir,et al.  Optimal Availability Quorum Systems: Theory and Practice , 1998, Inf. Process. Lett..

[21]  David K. Gifford,et al.  Weighted voting for replicated data , 1979, SOSP '79.

[22]  Marcin Bienkowski,et al.  A practical algorithm for constructing oblivious routing schemes , 2003, SPAA '03.

[23]  Leslie Lamport,et al.  The part-time parliament , 1998, TOCS.

[24]  Leslie G. Valiant,et al.  A Scheme for Fast Parallel Communication , 1982, SIAM J. Comput..

[25]  Fillia Makedon,et al.  A 2n-2 Step Algorithm for Routing in an nxn Array with Constant Size Queues , 1989, SPAA.

[26]  Jonas Holmerin,et al.  Towards optimal lower bounds for clique and chromatic number , 2003, Theor. Comput. Sci..

[27]  David Peleg,et al.  The Availability of Quorum Systems , 1995, Inf. Comput..

[28]  Leslie G. Valiant,et al.  Universal schemes for parallel communication , 1981, STOC '81.

[29]  Grzegorz Malewicz,et al.  The Quorum Deployment Problem , 2004, OPODIS.

[30]  Michel X. Goemans,et al.  On the Single-Source Unsplittable Flow Problem , 1999, Comb..

[31]  Michael K. Reiter,et al.  Probabilistic quorum systems , 1997, PODC '97.

[32]  Aravind Srinivasan,et al.  Distributions on level-sets with applications to approximation algorithms , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[33]  Matthias Westermann,et al.  Caching in networks: non uniform algorithms and memory capacity constraints , 2000 .