Mixed generalized Dynkin game and stochastic control in a Markovian framework