Markovian control problems : functional equations and algorithms