Distributed asynchronous deterministic and stochastic gradient optimization algorithms

We present a model for asynchronous distributed computation and then proceed to analyze the convergence of natural asynchronous distributed versions of a large class of deterministic and stochastic gradient-like algorithms. We show that such algorithms retain the desirable convergence properties of their centralized counterparts, provided that the time between consecutive interprocessor communications and the communication delays are not too large.

[1]  P. Meyer Probability and potentials , 1966 .

[2]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[3]  H. T. Kung,et al.  Synchronized and asynchronous parallel algorithms for multiprocessors , 1976 .

[4]  Lennart Ljung,et al.  Analysis of recursive stochastic algorithms , 1977 .

[5]  Robert G. Gallager,et al.  A Minimum Delay Routing Algorithm Using Distributed Computation , 1977, IEEE Trans. Commun..

[6]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[7]  Gérard M. Baudet,et al.  Asynchronous Iterative Methods for Multiprocessors , 1978, JACM.

[8]  V. Solo The convergence of AML , 1979 .

[9]  Andrew Chi-Chih Yao,et al.  Some complexity questions related to distributive computing(Preliminary Report) , 1979, STOC.

[10]  V. Nollau Kushner, H. J./Clark, D. S., Stochastic Approximation Methods for Constrained and Unconstrained Systems. (Applied Mathematical Sciences 26). Berlin‐Heidelberg‐New York, Springer‐Verlag 1978. X, 261 S., 4 Abb., DM 26,40. US $ 13.20 , 1980 .

[11]  Dimitri Bertsekas,et al.  Distributed dynamic programming , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[12]  Dimitri P. Bertsekas,et al.  Optimal routing and flow control methods for communication networks , 1982 .

[13]  John N. Tsitsiklis,et al.  On the Complexity of Designing Distributed Protocols , 1982, Inf. Control..

[14]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[15]  Dimitri P. Bertsekas,et al.  Distributed asynchronous computation of fixed points , 1983, Math. Program..

[16]  John N. Tsitsiklis,et al.  Distributed asynchronous optimal routing in data networks , 1984 .

[17]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[18]  John N. Tsitsiklis,et al.  Convergence theories of distributed iterative processes: A survey , 1986 .