On Minimum Cost Per Unit Time Control of Markov Chains

The “minimum cost per unit time” control problem is studied for a class of Markov chains that, though important in applications, does not fit the conventional framework for this problem. Existence of optimal stationary strategies and necessary and sufficient conditions for optimality are established.