PROBABILITIES OF A FINITE MARKOV CHAIN