Markov chain transition probabilities and experimental data