How Shall I Drive? Interaction Modeling and Motion Planning towards Empathetic and Socially-Graceful Driving

While intelligence of autonomous vehicles (AVs) has significantly advanced in recent years, accidents involving AVs suggest that these autonomous systems lack gracefulness in driving when interacting with human drivers. In the setting of a two-player game, we propose model predictive control based on social gracefulness, which is measured by the discrepancy between the actions taken by the AV and those that could have been taken in favor of the human driver. We define social awareness as the ability of an agent to infer such favorable actions based on knowledge about the other agent’s intent, and further show that empathy, i.e., the ability to understand others’ intent by simultaneously inferring others’ understanding of the agent’s self intent, is critical to successful intent inference. Lastly, through an intersection case, we show that the proposed gracefulness objective allows an AV to learn more sophisticated behavior, such as passive-aggressive motions that gently force the other agent to yield.

[1]  Nan Li,et al.  Game Theoretic Modeling of Driver and Vehicle Interactions for Verification and Validation of Autonomous Vehicle Control Systems , 2016, IEEE Transactions on Control Systems Technology.

[2]  Stephen D. Boyles,et al.  Auction-based autonomous intersection management , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[3]  Reza Langari,et al.  A human-like game theory-based controller for automatic lane changing , 2018 .

[4]  Anca D. Dragan,et al.  Planning for Autonomous Cars that Leverage Effects on Human Actions , 2016, Robotics: Science and Systems.

[5]  Anouck Girard,et al.  A Finite State Machine Based Automated Driving Controller and its Stochastic Optimization , 2017 .

[6]  Siddhartha S. Srinivasa,et al.  Human-robot mutual adaptation in collaborative tasks: Models and experiments , 2017, Int. J. Robotics Res..

[7]  Anca D. Dragan,et al.  Planning for cars that coordinate with people: leveraging effects on human actions for planning and active information gathering over human internal state , 2018, Autonomous Robots.

[8]  Alex Pentland,et al.  Modeling and Prediction of Human Behavior , 1999, Neural Computation.

[9]  Miguel A. Costa-Gomes,et al.  Comparing Models of Strategic Thinking in Van Huyck, Battalio, and Beil’s Coordination Games , 2009 .

[10]  Fang Liu,et al.  Lane-changes prediction based on adaptive fuzzy neural network , 2018, Expert Syst. Appl..

[11]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[12]  Kevin Leyton-Brown,et al.  A Tutorial on the Proof of the Existence of Nash Equilibria , 2007 .

[13]  Anca D. Dragan,et al.  Courteous Autonomous Cars , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Shimon Whiteson,et al.  Learning with Opponent-Learning Awareness , 2017, AAMAS.

[15]  Masayoshi Tomizuka,et al.  Who to Blame? learning and control strategies with information asymmetry , 2016, 2016 American Control Conference (ACC).

[16]  Christian Laugier,et al.  Intention-Aware Risk Estimation for General Traffic Situations, and Application to Intersection Safety , 2013 .

[17]  Junqiang Xi,et al.  Learning and Inferring a Driver's Braking Action in Car-Following Scenarios , 2018, IEEE Transactions on Vehicular Technology.

[18]  Chang Liu,et al.  How Much Data Are Enough? A Statistical Approach With Case Study on Longitudinal Driving Behavior , 2017, IEEE Transactions on Intelligent Vehicles.

[19]  Kazuhide Okamoto,et al.  A Comparative Study of Data-Driven Human Driver Lateral Control Models , 2018, 2018 Annual American Control Conference (ACC).

[20]  Sergey Levine,et al.  Feature Construction for Inverse Reinforcement Learning , 2010, NIPS.

[21]  Masayoshi Tomizuka,et al.  Distributed Conflict Resolution for Connected Autonomous Vehicles , 2018, IEEE Transactions on Intelligent Vehicles.