Intention estimation for ramp merging control in autonomous driving

Cooperative driving behavior is essential for driving in traffic, especially for ramp merging, lane changing or navigating intersections. Autonomous vehicles should also manage these situations by behaving cooperatively and naturally. In this paper, we present a novel learning-based method to efficiently estimate other vehicles' intentions and interact with them in ramp merging scenarios, without over-the-air communication between vehicles. The intention estimate is generated from a Probabilistic Graphical Model (PGM) which organizes historical data and latent intentions and determines predictions. Real driving trajectories are used to learn transition models in the PGM. Thus, besides the structure of the PGM, our method does not require human-designed reward or cost functions. The PGM-based intention estimation is followed by an off-the-shelf ACC distance keeping model to generate proper acceleration/deceleration commands. The PGM plays a plug-in role in our self-driving framework [1]. We validate the performance of our method both on real merging data and using a designed merging strategy in simulation, and show significant improvements compared with previous methods. Parameter design is also discussed by experiments. The new method is computationally efficient, and does not require acceleration information about other vehicles, which is hard to read directly from sensors mounted on the autonomous vehicle.

[1]  Klaus-Dieter Kuhnert,et al.  When will it change the lane? A probabilistic regression approach for rarely occurring events , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[2]  John M. Dolan,et al.  Autonomous vehicle social behavior for highway entrance ramp management , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[3]  John M. Dolan,et al.  A behavioral planning framework for autonomous driving , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[4]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[5]  Alois Knoll,et al.  Tactical cooperative planning for autonomous highway driving using Monte-Carlo Tree Search , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[6]  Nicholas J. Garber,et al.  Traffic and Highway Engineering , 1988 .

[7]  John M. Dolan,et al.  A point-based MDP for robust single-lane autonomous driving behavior under uncertainties , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Peter Hidas,et al.  Modelling vehicle interactions in microscopic simulation of merging and weaving , 2005 .

[9]  Jarrod M. Snider Automatic Steering Methods for Autonomous Automobile Path Tracking , 2009 .

[10]  Edwin Olson,et al.  Multipolicy decision-making for autonomous driving via changepoint-based behavior prediction: Theory and experiment , 2015, Autonomous Robots.

[11]  Dan C. Marinescu,et al.  On-ramp traffic merging using cooperative intelligent vehicles: A slot-based approach , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[12]  Edwin Olson,et al.  MPDM: Multipolicy decision-making in dynamic, uncertain environments for autonomous driving , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Joelle Pineau,et al.  Point-based value iteration: An anytime algorithm for POMDPs , 2003, IJCAI.