论文信息 - ADAPTIVE CONTROL OF MARKOV CHAINS: A SURVEY

ADAPTIVE CONTROL OF MARKOV CHAINS: A SURVEY

Abstract Adaptive policies are computationally attractive procedures for controlling systems whose dynamics involve unknown parameters. The paper organizes a survey of the literature in terms of the convergence properties of proposed adaptive policies and the restrictions imposed on the unknown parameters. Suggestions for future research are summarized in the conclusion.

Pravin Varaiya

[1] V. Borkar,et al. Adaptive control of Markov chains, I: Finite parameter set , 1979 .

[2] B. Doshi,et al. Strong consistency of a modified maximum likelihood estimator for controlled Markov chains , 1980 .

[3] P. Mandl. Some Results in the Adaptive Control of Linear Systems , 1977 .

[4] P. R. Kumar,et al. Adaptive Control with a Compact Parameter Set , 1982 .

[5] V. Borkar,et al. Identification and adaptive control of Markov chains , 1982 .

[6] Optimal adaptive controllers for unknown systems , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[7] Björn Wittenmark,et al. On Self Tuning Regulators , 1973 .

[8] P. Varaiya. Optimal and suboptimal stationary controls for Markov chains , 1978 .

[9] P. Mandl,et al. Estimation and control in Markov chains , 1974, Advances in Applied Probability.