Fuzzy Markov chains

We first review some of the basic results of finite Markov chains based on probability theory, then we present fuzzy finite Markov chains based on possibility theory, and compare the results of the two theories. Then we introduce finite horizon Markovian decision processes based on fuzzy Markov chains and study an example in detail showing our solution procedure.