Tests for Suboptimal Actions in Discounted Markov Programming

A new test for suboptimal actions in discounted Markov decision problems is proposed. The test is discussed in relation to that of MacQueen and Porteus and preferred computational schemes are given.