Markov Chains in Many Dimensions