Numerical methods for infinite Markov processes