Statistics of discrete-time Markov chains