The Bit Complexity of Distributed Sorting (Extended Abstract)

We study the bit complexity of the sorting problem for asynchronous distributed systems. We show that for every network with a tree topology T, every sorting algorithm must send at least Ω(ΔT log L/N) bits in the worst case, where {0, 1, ..., L} is the set of possible initial values, and ΔT is the sum of distances from all the vertices to a median of the tree. In addition, we present an algorithm that sends at most O(ΔT log L N/ΔT) bits for such trees; These bounds are tight if either L=Ω(N1+e) or Δ T =Ω(N2). We also present results regarding average distributions. These results suggest that sorting is an inherently non-distributive problem, since it requires an amount of information transfer, that is equal to the concentration of all the data in a single processor, which then distributes the final results to the whole network. The importance of bit complexity — as opposed to message complexity — stems also from the fact that in the lower bound discussion, no assumptions are made as to the nature of the algorithm.