Optimization of stochastic systems : topics in discrete-time dynamics

Deterministic Models and Their Control Problems. Stochastic Models. Stochastic Control Problems. Time Series and Econometric Models: Examples. Estimation. Convergence Questions. Adaptive Control Systems and Bayesian Optimal Control Problems. Linear Rational Expectations Models. Approximations in Sequential Decision Processes. References. Appendix: Markov Processes.