Collapsed Markov Chains and the Chapman-Kolmogorov Equation