Topics in controlled Markov chains

Markov chains - a review controlled Markov chains the discounted cost problem finite time control problems ergodic - existence results ergodic control - dynamic programming multiobject control problems control under partial observations adaptive control - the raw self-tuner adaptive control - the Kumar-Becker-Lin scheme concluding remarks. Appendices: spaces of probability measures.