MARKOV REPRESENTATIONS OF STOCHASTIC SYSTEMS