Strongly convergent dynamic programming