Courteous Autonomous Cars

Typically, autonomous cars optimize for a combination of safety, efficiency, and driving quality. But as we get better at this optimization, we start seeing behavior go from too conservative to too aggressive. The car's behavior exposes the incentives we provide in its cost function. In this work, we argue for cars that are not optimizing a purely selfish cost, but also try to be courteous to other interactive drivers. We formalize courtesy as a term in the objective that measures the increase in another driver's cost induced by the autonomous car's behavior. Such a courtesy term enables the robot car to be aware of possible irrationality of the human behavior, and plan accordingly. We analyze the effect of courtesy in a variety of scenarios. We find, for example, that courteous robot cars leave more space when merging in front of a human driver. Moreover, we find that such a courtesy term can help explain real human driver behavior on the NGSIM dataset.

[1]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[2]  Nan Li,et al.  Game Theoretic Modeling of Driver and Vehicle Interactions for Verification and Validation of Autonomous Vehicle Control Systems , 2016, IEEE Transactions on Control Systems Technology.

[3]  Hirokatsu Kataoka,et al.  Predicting driving behavior using inverse reinforcement learning with multiple reward functions towards environmental diversity , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[4]  Jonas Sjöberg,et al.  Autonomous cooperative driving: A velocity-based negotiation approach for intersection crossing , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[5]  Anca D. Dragan,et al.  Planning for Autonomous Cars that Leverage Effects on Human Actions , 2016, Robotics: Science and Systems.

[6]  Wei Zhan,et al.  Spatially-partitioned environmental representation and planning architecture for on-road autonomous driving , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[7]  Martin Lauer,et al.  How good is my prediction? Finding a similarity measure for trajectory prediction evaluation , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[8]  Jishun Li,et al.  Automatic parking path optimization based on Bezier curve fitting , 2012, 2012 IEEE International Conference on Automation and Logistics.

[9]  Jonathan P. How,et al.  Real-Time Motion Planning With Applications to Autonomous Urban Driving , 2009, IEEE Transactions on Control Systems Technology.

[10]  Wolfram Burgard,et al.  Socially compliant mobile robot navigation via inverse reinforcement learning , 2016, Int. J. Robotics Res..

[11]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[12]  Anind K. Dey,et al.  Maximum Entropy Inverse Reinforcement Learning , 2008, AAAI.

[13]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Domitilla Del Vecchio,et al.  Automated Vehicle-to-Vehicle Collision Avoidance at Intersections , 2011 .

[15]  Andreas Lawitzky,et al.  A Game-Theoretic Approach to Replanning-Aware Interactive Scene Prediction and Planning , 2016, IEEE Transactions on Vehicular Technology.

[16]  Wei Zhan,et al.  A non-conservatively defensive strategy for urban autonomous driving , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[17]  Sergey Levine,et al.  Continuous Inverse Optimal Control with Locally Optimal Examples , 2012, ICML.

[18]  Pieter Abbeel,et al.  Inverse Reinforcement Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[19]  Alexiadis,et al.  The next generation simulation program , 2004 .

[20]  Anca D. Dragan,et al.  Information gathering actions over human internal state , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Carla E. Brodley,et al.  Proceedings of the twenty-first international conference on Machine learning , 2004, International Conference on Machine Learning.