Practical Considerations in the Numerical Analysis of Markovian Models