The Markovian Case