Asynchronous Stochastic Approximations

The asymptotic behavior of a distributed, asynchronous stochastic approximation scheme is analyzed in terms of a limiting nonautonomous differential equation. The relation between the latter and the relative values of suitably rescaled relative frequencies of updates of different components is underscored.

[1]  J. Neveu,et al.  Discrete Parameter Martingales , 1975 .

[2]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[3]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[4]  M. Freidlin,et al.  Random Perturbations of Dynamical Systems , 1984 .

[5]  H. Kushner,et al.  Asymptotic properties of distributed and communication stochastic approximation algorithms , 1987 .

[6]  H. Kushner,et al.  Stochastic approximation algorithms for parallel and distributed processing , 1987 .

[7]  Morris W. Hirsch,et al.  Convergent activation dynamics in continuous time networks , 1989, Neural Networks.

[8]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[9]  H. Peyton Young,et al.  Stochastic Evolutionary Game Dynamics , 1990 .

[10]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[11]  V. Borkar Topics in controlled Markov chains , 1991 .

[12]  S. Mitter,et al.  Recursive stochastic algorithms for global optimization in R d , 1991 .

[13]  T. Sargent Bounded rationality in macroeconomics , 1993 .

[14]  Vivek S. Borkar,et al.  Managing interprocessor delays in distributed recursive algorithms , 1994 .

[15]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[16]  Michael I. Jordan,et al.  MASSACHUSETTS INSTITUTE OF TECHNOLOGY ARTIFICIAL INTELLIGENCE LABORATORY and CENTER FOR BIOLOGICAL AND COMPUTATIONAL LEARNING DEPARTMENT OF BRAIN AND COGNITIVE SCIENCES , 1996 .

[17]  V. Borkar Distributed computation of fixed points of ∞-nonexpansive maps , 1996 .

[18]  R. Gharavi A structure theorem for partially asynchronous relaxations with random delays , 1996 .