On the average communication complexity of asynchronous distributed algorithms

We study the communication complexity of asynchronous distributed algorithms. Such algorithms can generate excessively many messages in the worst case. Nevertheless, we show that, under certain probabilistic assumptions, the expected number of messages generated per time unit is bounded by a polynomial function of the number of processors under a very general model of distributed computation. Furthermore, for constant-degree processor graphs, the expected number of generated messages is only O(nT), where n is the number of processors and T is the running time. We conclude that (under our model) any asynchronous algorithm with good time complexity will also have good communication complexity, on the average.

[1]  H. Chernoff A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations , 1952 .

[2]  Dimitri Bertsekas,et al.  Distributed dynamic programming , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[3]  Baruch Awerbuch,et al.  Complexity of network synchronization , 1985, JACM.

[4]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[5]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[6]  J. Walrand,et al.  Distributed Dynamic Programming , 2022 .