Online Risk-Bounded Motion Planning for Autonomous Vehicles in Dynamic Environments

A crucial challenge to efficient and robust motion planning for autonomous vehicles is understanding the intentions of the surrounding agents. Ignoring the intentions of the other agents in dynamic environments can lead to risky or over-conservative plans. In this work, we model the motion planning problem as a partially observable Markov decision process (POMDP) and propose an online system that combines an intent recognition algorithm and a POMDP solver to generate risk-bounded plans for the ego vehicle navigating with a number of dynamic agent vehicles. The intent recognition algorithm predicts the probabilistic hybrid motion states of each agent vehicle over a finite horizon using Bayesian filtering and a library of pre-learned maneuver motion models. We update the POMDP model with the intent recognition results in real time and solve it using a heuristic search algorithm which produces policies with upper-bound guarantees on the probability of near colliding with other dynamic agents. We demonstrate that our system is able to generate better motion plans in terms of efficiency and safety in a number of challenging environments including unprotected intersection left turns and lane changes as compared to the baseline methods.

[1]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[2]  Brian Williams,et al.  Learning and Recognition of Hybrid Manipulation Motions in Variable Environments Using Probabilistic Flow Tubes , 2012, Int. J. Soc. Robotics.

[3]  Min Chen,et al.  POMDP-lite for robust robot planning under uncertainty , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Bo Gao,et al.  Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance: A Survey , 2018, IEEE Transactions on Intelligent Transportation Systems.

[5]  Xin Huang,et al.  Hybrid Risk-Aware Conditional Planning with Applications in Autonomous Vehicles , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[6]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[7]  Kian Hsiang Low,et al.  A General Framework for Interacting Bayes-Optimally with Self-Interested Agents using Arbitrary Parametric Model and Model Prior , 2013, IJCAI.

[8]  Quan Hung Tran,et al.  Modelling of traffic situations at urban intersections with probabilistic non-parametric regression , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[9]  Eun-Ha Choi,et al.  Crash Factors in Intersection-Related Crashes: An On-Scene Perspective , 2010 .

[10]  Jonathan P. How,et al.  An online algorithm for constrained POMDPs , 2010, 2010 IEEE International Conference on Robotics and Automation.

[11]  Véronique Berge-Cherfaoui,et al.  Vehicle trajectory prediction based on motion model and maneuver recognition , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Horst-Michael Groß,et al.  Combining behavior and situation information for reliably estimating multiple intentions , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[13]  Mark M. Tobenkin,et al.  Invariant Funnels around Trajectories using Sum-of-Squares Programming , 2010, 1010.3013.

[14]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[15]  Michael Stolz,et al.  Search-Based Optimal Motion Planning for Automated Driving , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Brian C. Williams,et al.  Mode Estimation of Probabilistic Hybrid Systems , 2002, HSCC.

[17]  Kee-Eung Kim,et al.  Approximate Linear Programming for Constrained Partially Observable Markov Decision Processes , 2015, AAAI.

[18]  Volker Willert,et al.  Bayesian, maneuver-based, long-term trajectory prediction and criticality assessment for driver assistance systems , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[19]  Chonhyon Park,et al.  I-Planner: Intention-aware motion planning using learning-based human motion prediction , 2016, Robotics: Science and Systems.

[20]  David Hsu,et al.  Monte Carlo Bayesian Reinforcement Learning , 2012, ICML.

[21]  K. Arras,et al.  Predictive Planning for a Mobile Robot in Human Environments , 2017 .

[22]  Jonathan P. How,et al.  Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Sylvie Thiébaux,et al.  RAO*: An Algorithm for Chance-Constrained POMDP's , 2016, AAAI.

[24]  David Hsu,et al.  Intention-aware online POMDP planning for autonomous driving in a crowd , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[27]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[28]  Fang Chen,et al.  Lane change maneuver recognition via vehicle state and driver operation signals — Results from naturalistic driving data , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[29]  Dot Hs,et al.  Crash Factors in Intersection-Related Crashes: An On-Scene Perspective , 2010 .

[30]  Dinesh Manocha,et al.  PORCA: Modeling and Planning for Autonomous Driving Among Many Pedestrians , 2018, IEEE Robotics and Automation Letters.

[31]  Kikuo Fujimura,et al.  Collaborative Planning for Mixed-Autonomy Lane Merging , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[32]  Markus Maurer,et al.  Probabilistic online POMDP decision making for lane changes in fully automated driving , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[33]  Rüdiger Dillmann,et al.  Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[34]  Aaron E. Rosenberg,et al.  Performance tradeoffs in dynamic time warping algorithms for isolated word recognition , 1980 .

[35]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.