A Uniform Theory for Sums of Markov Chain Transition Probabilities