Markov decision processes in artificial intelligence : MDPs, beyond MDPs and applications