Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perception

Autonomous vehicles interacting with other traffic participants heavily rely on the perception and prediction of other agents’ behaviors to plan safe trajectories. However, as occlusions limit the vehicle’s perception ability, reasoning about potential hazards beyond the field of view is one of the most challenging issues in developing autonomous driving systems. This paper introduces a novel analytical approach that poses safe trajectory planning under occlusions as a hybrid zero-sum dynamic game between the autonomous vehicle (evader) and an initially hidden traffic participant (pursuer). Due to occlusions, the pursuer’s state is initially unknown to the evader and may later be discovered by the vehicle’s sensors. The analysis yields optimal strategies for both players as well as the set of initial conditions from which the autonomous vehicle is guaranteed to avoid collisions. We leverage this theoretical result to develop a novel trajectory planning framework for autonomous driving that provides worst-case safety guarantees while minimizing conservativeness by accounting for the vehicle’s ability to actively avoid other road users as soon as they are detected in future observations. Our framework is agnostic to the driving environment and suitable for various motion planners. We demonstrate our algorithm on challenging urban and highway driving scenarios using the open-source CARLA simulator.

[1]  Jonathan P. How,et al.  Receding horizon control of autonomous aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[2]  Paulo Tabuada,et al.  Control Barrier Functions: Theory and Applications , 2019, 2019 18th European Control Conference (ECC).

[3]  Ian M. Mitchell The Flexible, Extensible and Efficient Toolbox of Level Set Methods , 2008, J. Sci. Comput..

[4]  Jin-Woo Lee,et al.  Motion planning for autonomous driving with a conformal spatiotemporal lattice , 2011, 2011 IEEE International Conference on Robotics and Automation.

[5]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[6]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[7]  Hassen Salhi,et al.  Provably safe navigation for mobile robots with limited field-of-views in dynamic environments , 2012, Auton. Robots.

[8]  Tom Schouwenaars,et al.  Safe Trajectory Planning of Autonomous Vehicles , 2006 .

[9]  Thierry Fraichard,et al.  Partial motion planning framework for reactive planning within dynamic environments , 2005, ICINCO.

[10]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[11]  Christoph Stiller,et al.  Generating Efficient Behaviour with Predictive Visibility Risk for Scenarios with Occlusions , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[12]  Roland Siegwart,et al.  Towards Safe Vehicle Navigation in Dynamic Urban Scenarios , 2009 .

[13]  Mykel J. Kochenderfer,et al.  Scalable Decision Making with Sensor Occlusions for Autonomous Driving , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Srikanth Saripalli,et al.  Improving Bounds on Occluded Vehicle States for Use in Safe Motion Planning , 2020, 2020 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[15]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[16]  Kristian Kirsch,et al.  Theory Of Ordinary Differential Equations , 2016 .

[17]  Thierry Fraichard,et al.  Safe motion planning in dynamic environments , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Woojin Chung,et al.  Safe Navigation of a Mobile Robot Considering Visibility of Environment , 2009, IEEE Transactions on Industrial Electronics.

[19]  Mo Chen,et al.  Reach-avoid problems with time-varying dynamics, targets and constraints , 2014, HSCC.

[20]  Dimos V. Dimarogonas,et al.  Learning Control Barrier Functions from Expert Demonstrations , 2020, 2020 59th IEEE Conference on Decision and Control (CDC).

[21]  Nicholas J. Butko,et al.  Active perception , 2010 .

[22]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[23]  Julius Ziegler,et al.  Spatiotemporal state lattices for fast trajectory planning in dynamic on-road driving scenarios , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Christoph Stiller,et al.  A POMDP Maneuver Planner For Occlusions in Urban Scenarios , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[25]  Martin Lauer,et al.  Tackling Occlusions & Limited Sensor Range with Set-based Safety Verification , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[26]  Matthias Althoff,et al.  Efficient Computation of Invariably Safe States for Motion Planning of Self-Driving Vehicles , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Matthias Althoff,et al.  Set-Based Prediction of Traffic Participants Considering Occlusions and Traffic Rules , 2021, IEEE Transactions on Intelligent Vehicles.

[28]  Matthew Johnson-Roberson,et al.  Risk Assessment and Planning with Bidirectional Reachability for Autonomous Driving , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Jaime F. Fisac,et al.  The pursuit-evasion-defense differential game in dynamic constrained environments , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[30]  Emilio Frazzoli,et al.  What lies in the shadows? Safe and computation-aware motion planning for autonomous vehicles using intent-aware dynamic shadow regions , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[31]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[32]  Michael Himmelsbach,et al.  Active perception for autonomous vehicles , 2012, 2012 IEEE International Conference on Robotics and Automation.

[33]  John K. Tsotsos,et al.  Revisiting active perception , 2016, Autonomous Robots.

[34]  Hassen Salhi,et al.  Passively safe partial motion planning for mobile robots with limited field-of-views in unknown dynamic environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Dariu M. Gavrila,et al.  Human motion trajectory prediction: a survey , 2019, Int. J. Robotics Res..

[36]  Mo Chen,et al.  Reach-Avoid Problems via Sum-or-Squares Optimization and Dynamic Programming , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[37]  Jonathan P. How,et al.  Guaranteed infinite horizon avoidance of unpredictable, dynamically constrained obstacles , 2012, Autonomous Robots.

[38]  Rüdiger Dillmann,et al.  Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[39]  Myoungho Sunwoo,et al.  Collision risk assessment for possible collision vehicle in occluded area based on precise map , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[40]  Paulo Tabuada,et al.  Control Barrier Function Based Quadratic Programs for Safety Critical Systems , 2016, IEEE Transactions on Automatic Control.

[41]  Y. Ho,et al.  Differential games and optimal pursuit-evasion strategies , 1965 .

[42]  Kanwaldeep Kaur,et al.  Trust in driverless cars: Investigating key factors influencing the adoption of driverless cars , 2018 .

[43]  Matthew Johnson-Roberson,et al.  Occlusion-Aware Risk Assessment for Autonomous Driving in Urban Environments , 2018, IEEE Robotics and Automation Letters.

[44]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[45]  Eric Thorn,et al.  A Framework for Automated Driving System Testable Cases and Scenarios , 2018 .

[46]  Javier Alonso-Mora,et al.  Trajectory optimization for autonomous overtaking with visibility maximization , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).