Validating human driver models for interaction-aware automated vehicle controllers: A human factors approach

A major challenge for autonomous vehicles is interacting with other traffic participants safely and smoothly. A promising approach to handle such traffic interactions is equipping autonomous vehicles with interaction-aware controllers (IACs). These controllers predict how surrounding human drivers will respond to the autonomous vehicle’s actions, based on a driver model. However, the predictive validity of driver models used in IACs is rarely validated, which can limit the interactive capabilities of IACs outside the simple simulated environments in which they are demonstrated. In this paper, we argue that besides evaluating the interactive capabilities of IACs, their underlying driver models should be validated on natural human driving behavior. We propose a workflow for this validation that includes scenario-based data extraction and a two-stage (tactical/operational) evaluation procedure based on human factors literature. We demonstrate this workflow in a case study on an inverse-reinforcement-learningbased driver model replicated from an existing IAC. This model only showed the correct tactical behavior in 40% of the predictions. The model’s operational behavior was inconsistent with observed human behavior. The case study illustrates that a principled evaluation workflow is useful and needed. We believe that our workflow will support the development of appropriate driver models for future automated vehicles.

[1]  Olger Siebinga TraViA: a Traffic data Visualization and Annotation tool in Python , 2021, J. Open Source Softw..

[2]  Aravinda Ramakrishnan Srinivasan,et al.  Comparing merging behaviors observed in naturalistic data with behaviors generated by a machine learned model , 2021, 2021 IEEE International Intelligent Transportation Systems Conference (ITSC).

[3]  Jingda Wu,et al.  Driving Behavior Modeling Using Naturalistic Human Driving Data With Inverse Reinforcement Learning , 2020, IEEE Transactions on Intelligent Transportation Systems.

[4]  Chen Lv,et al.  Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach , 2020, IEEE Transactions on Intelligent Transportation Systems.

[5]  Masayoshi Tomizuka,et al.  Analyzing the Suitability of Cost Functions for Explaining and Imitating Human Driving Behavior based on Inverse Reinforcement Learning , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Emmanouil N. Barmpounakis,et al.  On the new era of urban traffic monitoring with massive drone data: The pNEUMA large-scale field experiment , 2020 .

[7]  Thomas A. Dingus,et al.  Second strategic highway research program naturalistic driving study methods , 2019, Safety Science.

[8]  Anne Spalanzani,et al.  Game theoretic decision making for autonomous vehicles’ merge manoeuvre in high traffic scenarios , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[9]  David Isele,et al.  Interactive Decision Making for Autonomous Vehicles in Dense Traffic , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[10]  Qingyu Zhang,et al.  Receding Horizon Markov Game Autonomous Driving Strategy , 2019, 2019 American Control Conference (ACC).

[11]  Stefan Roth,et al.  Driving with Style: Inverse Reinforcement Learning in General-Purpose Planning for Automated Driving , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Christoph Stiller,et al.  A Belief State Planner for Interactive Merge Maneuvers in Congested Traffic , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[13]  Lutz Eckstein,et al.  The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systems , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[14]  Nan Li,et al.  Adaptive Game-Theoretic Decision Making for Autonomous Vehicle Control at Roundabouts , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[15]  Reza Langari,et al.  Addressing Mandatory Lane Change Problem with Game Theoretic Model Predictive Control and Fuzzy Markov Chain , 2018, 2018 Annual American Control Conference (ACC).

[16]  Anca D. Dragan,et al.  Planning for cars that coordinate with people: leveraging effects on human actions for planning and active information gathering over human internal state , 2018, Autonomous Robots.

[17]  Reza Langari,et al.  A human-like game theory-based controller for automatic lane changing , 2018 .

[18]  Daniel Axehill,et al.  Probabilistic Model for Interaction Aware Planning in Merge Scenarios , 2017, IEEE Transactions on Intelligent Vehicles.

[19]  Simone Pettigrew,et al.  Why public health should embrace the autonomous car , 2017, Australian and New Zealand journal of public health.

[20]  Kara M. Kockelman,et al.  Economic Effects of Automated Vehicles , 2017 .

[21]  Jinya Su,et al.  Dynamic decision making in lane change: Game theory with receding horizon , 2016, 2016 UKACC 11th International Conference on Control (CONTROL).

[22]  Daniel Axehill,et al.  Interaction aware trajectory planning for merge scenarios in congested traffic situations , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[23]  Corey D. Harper,et al.  Estimating potential increases in travel with autonomous vehicles for the non-driving, elderly and people with travel-restrictive medical conditions , 2016 .

[24]  Malte Risto,et al.  The social behavior of autonomous vehicles , 2016, UbiComp Adjunct.

[25]  Alois Knoll,et al.  Tactical cooperative planning for autonomous highway driving using Monte-Carlo Tree Search , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[26]  Marcelo H. Ang,et al.  Situation-aware decision making for autonomous driving on urban road using online POMDP , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[27]  H.M.Zhang,et al.  On some experimental features of car-following behavior and how to model them , 2015, 1505.02380.

[28]  Zuduo Zheng,et al.  Incorporating human-factors in car-following models : a review of recent developments and research needs , 2014 .

[29]  Fang Zhang,et al.  Analysis of Chinese driver's lane change characteristic based on real vehicle tests in highway , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[30]  Sergey Levine,et al.  Continuous Inverse Optimal Control with Locally Optimal Examples , 2012, ICML.

[31]  Serge P. Hoogendoorn,et al.  Heterogeneity In Car-Following Behavior: Theory And Empirics , 2011 .

[32]  Thomas A Ranney Psychological Fidelity: Perception of Risk , 2011 .

[33]  Jeffry Allen Greenberg,et al.  Physical Fidelity of Driving Simulators , 2011 .

[34]  René van Paassen,et al.  Haptic car-following support with deceleration control , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[35]  Anind K. Dey,et al.  Maximum Entropy Inverse Reinforcement Learning , 2008, AAAI.

[36]  Takayuki Kondoh,et al.  Identification of Visual Cues and Quantification of Drivers' Perception of Proximity Risk to the Lead Vehicle in Car-Following Situations , 2008 .

[37]  Serge P. Hoogendoorn,et al.  Empirics of Multianticipative Car-Following Behavior , 2006 .

[38]  René van Paassen,et al.  Effects of lead vehicle speed and separation distance on driver car-following behavior , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[39]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[40]  Andrew Y. Ng,et al.  Pharmacokinetics of a novel formulation of ivermectin after administration to goats , 2000, ICML.

[41]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[42]  John A. Michon,et al.  A critical view of driver behavior models: What do we know , 1985 .

[43]  David N. Lee,et al.  A Theory of Visual Control of Braking Based on Information about Time-to-Collision , 1976, Perception.