Markov Chains and Stochastic Stability: Markov models