Formulas for the variance of the sample mean in finite state Markov processes

Formulas are derived for the variance of sample means associated with finite state Markov processes. Results are presented to illustrate the use of the formulas for example processes. The formulas can be used to evaluate proposed statistical methods for estimating the variance of a sample mean obtained from simulation experiments.