Tactical cooperative planning for autonomous highway driving using Monte-Carlo Tree Search

Human drivers use nonverbal communication and anticipation of other drivers' actions to master conflicts occurring in everyday driving situations. Without a high penetration of vehicle-to-vehicle communication an autonomous vehicle has to have the possibility to understand intentions of others and share own intentions with the surrounding traffic participants. This paper proposes a cooperative combinatorial motion planning algorithm without the need for inter vehicle communication based on Monte Carlo Tree Search (MCTS). We motivate why MCTS is particularly suited for the autonomous driving domain. Furthermore, adoptions to the MCTS algorithm are presented as for example simultaneous decisions, the usage of the Intelligent Driver Model as microscopic traffic simulation, and a cooperative cost function. We further show simulation results of merging scenarios in highway-like situations to underline the cooperative nature of the approach.

[1]  Peter King,et al.  Odin: Team VictorTango's entry in the DARPA Urban Challenge , 2008, J. Field Robotics.

[2]  Peter I. Cowling,et al.  Information Set Monte Carlo Tree Search , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[3]  Dennis J. N. J. Soemers,et al.  Tactical Planning Using MCTS in the Game of StarCraft , 2014 .

[4]  Wilko Schwarting,et al.  Recursive conflict resolution for cooperative motion planning in dynamic highway traffic , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[5]  John M. Dolan,et al.  Autonomous vehicle social behavior for highway entrance ramp management , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[6]  Simon M. Lucas,et al.  A Survey of Monte Carlo Tree Search Methods , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[7]  Jürgen Beyerer,et al.  A comparison of motion planning algorithms for cooperative collision avoidance of multiple cognitive automobiles , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[8]  Markus Maurer,et al.  Structuring Cooperative Behavior Planning Implementations for Automated Driving , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[9]  Markus Maurer,et al.  Towards Tactical Lane Change Behavior Planning for Automated Vehicles , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[10]  Julius Ziegler,et al.  Team AnnieWAY's autonomous system for the 2007 DARPA Urban Challenge , 2008, J. Field Robotics.

[11]  Rüdiger Dillmann,et al.  Probabilistic MDP-behavior planning for cars , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[12]  Jonas Sjöberg,et al.  Strategic decision making for automated driving on two-lane, one way roads using model predictive control , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[13]  Joel Veness,et al.  Monte-Carlo Planning in Large POMDPs , 2010, NIPS.

[14]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[15]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[16]  Rüdiger Dillmann,et al.  Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[17]  Julian Eggert,et al.  Risk-Aversive Behavior Planning under Multiple Situations with Uncertainty , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[18]  Francesco Borrelli,et al.  Scenario model predictive control for lane change assistance on highways , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[19]  Mortuza Ali,et al.  An efficient cooperative lane-changing algorithm for sensor- and communication-enabled automated vehicles , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[20]  Patrick Pascheka,et al.  Cooperative decentralized decision making for conflict resolution among autonomous agents , 2014, 2014 IEEE International Symposium on Innovations in Intelligent Systems and Applications (INISTA) Proceedings.