Receding Horizon Markov Game Autonomous Driving Strategy

This paper presents a novel human-like autonomous driving algorithms for lane-changing problem. To this end, we present a multi-agent decision-making scheme by blending game theory with the Markov decision process, forming a Markov game (MG). In this decision-making process, interaction of a subject vehicle (SV) and traffic vehicles (TVs) are captured in a mathematically tractable manner via both a cooperative game (max - max) where vehicles perform their decisions for collective objectives and a noncooperative game (max - min) where vehicles perform their decisions for individual objectives. Strategies of the players are computed via a Receding Horizon (RH) approach where optimal solutions are found through an optimization strategy by taking into account current and future constraints. The proposed approach is evaluated in a human-in-the-Ioop (HIL) environment built around a MATLAB/SimulinkldSPACE realtime simulator where the Markov game-guided SV controller interacts with programmed TV s and one human-driven vehicle (HV). Experimental results show that the Markov game driving strategy is capable of finding a safe gap in multi-move traffic that is consistent with human drivers' behaviours in mandatory lane-changing.