Towards Comprehensive Maneuver Decisions for Lane Change Using Reinforcement Learning

In this paper, we consider the problem of autonomous lane changing for self driving 1 vehicles in a multi-lane, multi-agent setting. We use reinforcement learning solely 2 to obtain a high-level policy for decision making, while the lower level action is 3 executed by a pre-defined controller. To obtain a comprehensive model adaptive 4 to as wide traffic scenarios as possible, training is carried out based on more 5 than 700 handcrafted traffic scenarios with various types of traffic involved. A 6 new asynchronous DQN architecture is proposed to handle the training samples’ 7 diversity while improving the training efficiency. Moreover, we also present a 8 new state representation that contains both short range information and long range 9 information, to retain the merit of each individual representation while refining 10 them in terms of generalization ability and training efficiency. The generated policy 11 is evaluated on other 200 testing scenarios in a simulator, the results demonstrate 12 that our approach shows the better generalization ability than a rule-based baseline, 13 and possesses better intelligence and flexibility. 14