论文信息 - Numerical studies of stochastic approximation procedures for constrained problems

Numerical studies of stochastic approximation procedures for constrained problems

Several algorithms for stochastic approximation under equality and inequality, constraints are discussed and described, together with numerical data and comparisons from numerous simulations. The algorithms work well, and exhibit some rather interesting behavior. Those based on "augmented Lagrangian" techniques are preferable to the "Lagrangian" methods, as in the deterministic case; the former methods seem to be quite robust and reliable. The study is the first (to the authors' knowledge) numerical study of such algorithms.

H. Kushner | S. Lakshmivarahan

[1] H. Kesten. Accelerated Stochastic Approximation , 1958 .

[2] V. Fabian. On Asymptotic Normality in Stochastic Approximation , 1968 .

[3] A. V. Levy,et al. Use of the augmented penalty function in mathematical programming problems, part 1 , 1971 .

[4] Harold J. Kushner,et al. Penalty Function Methods for Constrained Stochastic Approximation , 1974 .

[5] H. Kushner,et al. Stochastic approximation type methods for constrained systems: Algorithms and numerical results , 1974 .

[6] Lennart Ljung,et al. Convergence of Recursive Stochastic Algorithms , 1974 .

[7] Harold J. Kushner,et al. STOCHASTIC APPROXIMATION ALGORITHMS FOR CONSTRAINED OPTIMIZATION PROBLEMS , 1974 .

[8] H. Kushner,et al. Stochastic approximation of constrained systems with system and constraint noise , 1975, at - Automatisierungstechnik.

[9] H. Kushner,et al. Stochastic Approximation Algorithms of the Multiplier Type for the Sequential Monte Carlo Optimization of Stochastic Systems , 1976 .

[10] Dimitri P. Bertsekas,et al. Multiplier methods: A survey , 1975, at - Automatisierungstechnik.

[11] H. Kushner. General convergence results for stochastic approximations via weak convergence theory , 1977 .

[12] H. Kushner. Rates of Convergence for Sequential Monte Carlo Optimization Methods , 1978 .