State-Action Frequencies Related to Strategies in Markov Decision Processes