Probabilistic Decision-Making at Road Intersections: Formulation and Quantitative Evaluation

As drivers approach a road intersection, they must decide whether to cross it or to come to a stop. For this purpose, drivers make a situation assessment and adapt their behaviour accordingly. When this task is performed by a computer, the available information is partial and uncertain. Any decision requires the system to use this information as well as taking into account the behaviour of other drivers to avoid collisions. Common metrics such as collision rate can remain low in an interactive environment because of other driver's actions. Consequently, evaluation metrics must depend on other driving aspects. In this paper a decision-making mechanism and metrics to evaluate such a system at road intersection crossing are presented. For the former, a Partially Observable Markov Decision Process is used to model the system with respect to uncertainties in the behaviour of other drivers. For the latter, different key performance indicators are defined to evaluate the resulting behaviour of the system with different configurations and scenarios. The approach is demonstrated within an automotive grade simulator. It has showed at times, that whilst the vehicle can cross safely the intersection, it might not satisfy other key performance indicators related to highway code.

[1]  Joel Veness,et al.  Monte-Carlo Planning in Large POMDPs , 2010, NIPS.

[2]  Kay Fitzpatrick.  GAPS ACCEPTED AT STOP-CONTROLLED INTERSECTIONS , 1991 .

[3]  Jonathan P. How,et al.  Driver Behavior Classification at Intersections and Validation on Large Naturalistic Data Set , 2012, IEEE Transactions on Intelligent Transportation Systems.

[4]  Javier Ibanez Guzman,et al.  Vehicle to vehicle communications applied to road intersection safety, field results , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[5]  John Schulman,et al.  Concrete Problems in AI Safety , 2016, ArXiv.

[6]  Sebastian Thrun,et al.  Monte Carlo POMDPs , 1999, NIPS.

[7]  Axel Legay,et al.  Statistical Model Checking: An Overview , 2010, RV.

[8]  Marcelo H. Ang,et al.  Situation-aware decision making for autonomous driving on urban road using online POMDP , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[9]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[10]  Joelle Pineau,et al.  Online Planning Algorithms for POMDPs , 2008, J. Artif. Intell. Res..

[11]  Rüdiger Dillmann,et al.  Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[12]  Christian Laugier,et al.  Risk assessment at road intersections: Comparing intention and expectation , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[13]  David Hsu,et al.  DESPOT: Online POMDP Planning with Regularization , 2013, NIPS.

[14]  Christoph Stiller,et al.  Automated Driving in Uncertain Environments: Planning With Interaction and Uncertain Maneuver Prediction , 2018, IEEE Transactions on Intelligent Vehicles.

[15]  Moshe Livneh,et al.  A decision model for gap acceptance and capacity at intersections , 2002 .

[16]  Kyongsu Yi,et al.  Nonlinear brake control for vehicle CW/CA systems , 2001 .

[17]  Christian Laugier,et al.  Classification of drivers manoeuvre for road intersection crossing with synthethic and real data , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[18]  David Isele,et al.  Navigating Occluded Intersections with Autonomous Vehicles Using Deep Reinforcement Learning , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Nanning Zheng,et al.  Artificial intelligence test: a case study of intelligent vehicles , 2018, Artificial Intelligence Review.

[20]  Mykel J. Kochenderfer,et al.  Belief state planning for autonomously navigating urban intersections , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).