Time-Average Control of Martingale Problems: Existence of a Stationary Solution

One studies the average cost for controlled systems via the martingale problem for their generator. The stationary distributions for these processes on the product of the state and control spaces are characterized in terms of integration of the generator and existence of a stationary solution is established. The gives existence of a stationary control