The Frequency Count of a Markov Chain and the Transition to Continuous Time