Situation-aware decision making for autonomous driving on urban road using online POMDP

As autonomous vehicles begin venturing on the urban road, rational decision making is essential for driving safety and efficiency. This paper presents a situation-aware decision making algorithm for autonomous driving on urban road. Specifically, an urban road situation model is proposed first for proper environment representation, thereafter the situation-aware decision making problem is modeled as a Partially Observable Markov Decision Process (POMDP) and solved in an online manner. The proposed algorithm has been extensively evaluated, which is general enough for autonomous driving in various urban road scenarios, including leader following, collision avoidance and traffic negotiation at both T-junction and roundabout.

[1]  Emilio Frazzoli,et al.  Intention-Aware Pedestrian Avoidance , 2012, ISER.

[2]  David Hsu,et al.  DESPOT: Online POMDP Planning with Regularization , 2013, NIPS.

[3]  Marcelo H. Ang,et al.  Probabilistic road context inference for autonomous vehicles , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Richard Vaughan,et al.  Massively multi-robot simulation in stage , 2008, Swarm Intelligence.

[5]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[6]  Marcelo H. Ang,et al.  Autonomy for mobility on demand , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Marcelo H. Ang,et al.  Vehicle motion intention reasoning using cooperative perception on urban road , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[8]  Emilio Frazzoli,et al.  A Spatial-Temporal Approach for Moving Object Recognition with 2D LIDAR , 2014, ISER.

[9]  Christian Berger,et al.  Autonomous Driving-5 Years after the Urban Challenge: The Anticipatory Vehicle as a Cyber-Physical System , 2014, GI-Jahrestagung.

[10]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[11]  Luke Fletcher,et al.  The MIT - Cornell Collision and Why It Happened , 2009, The DARPA Urban Challenge.

[12]  Markus Maurer,et al.  Probabilistic online POMDP decision making for lane changes in fully automated driving , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[13]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[14]  Joelle Pineau,et al.  Online Planning Algorithms for POMDPs , 2008, J. Artif. Intell. Res..

[15]  Rüdiger Dillmann,et al.  Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[16]  John M. Dolan,et al.  A point-based MDP for robust single-lane autonomous driving behavior under uncertainties , 2011, 2011 IEEE International Conference on Robotics and Automation.