Stochastic Models: An Algorithmic Approach

Renewable processes with applications Markov chains and applications Markovian decision processes and their applications algorithmic analysis of queueing models.