Human-robot interaction for truck platooning using hierarchical dynamic games

This paper proposes a controller design framework for autonomous truck platoons to ensure safe interaction with a human-driven car. The interaction is modelled as a hierarchical dynamic game, played between the human driver and the nearest truck in the platoon. The hierarchical decomposition is temporal with a high-fidelity tactical horizon predicting immediate interactions and a low-fidelity strategic horizon estimating long-horizon behaviour. The hierarchical approach enables feasible computations where human uncertainties are represented by the quantal response model, and the truck is supposed to maximise its payoff. The closed-loop control is validated via case studies using a driving simulator, where we compare our approach with a short-horizon alternative using only the tactical horizon. The results indicate that our controller is more situation-aware resulting in natural and safe interactions.

[1]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[2]  Elis Stefansson.  Hierarchical Dynamic Games for Human-Robot Interaction with Applications to Autonomous Vehicles , 2018 .

[3]  Anca D. Dragan,et al.  Hierarchical Game-Theoretic Planning for Autonomous Vehicles , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[4]  Kevin Leyton-Brown,et al.  Beyond equilibrium: predicting human behaviour in normal form games , 2010, AAAI.

[5]  Andreas Lawitzky,et al.  A Game-Theoretic Approach to Replanning-Aware Interactive Scene Prediction and Planning , 2016, IEEE Transactions on Vehicular Technology.

[6]  Markus Brummer,et al.  Use of electronically linked konvoi truck platoons on motorways , 2010 .

[7]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[8]  Pravin Varaiya,et al.  Smart cars on smart roads: problems of control , 1991, IEEE Trans. Autom. Control..

[9]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[10]  Wilko Schwarting,et al.  Recursive conflict resolution for cooperative motion planning in dynamic highway traffic , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[11]  Jianfeng Gao,et al.  Scalable training of L1-regularized log-linear models , 2007, ICML '07.

[12]  Petr Krejci,et al.  Cooperative Control of SARTRE Automated Platoon Vehicles , 2012 .

[13]  Sabina Jeschke,et al.  A Review of Truck Platooning Projects for Energy Savings , 2016, IEEE Transactions on Intelligent Vehicles.

[14]  J. Cruz,et al.  Additional aspects of the Stackelberg strategy in nonzero-sum games , 1973 .

[15]  Anca D. Dragan,et al.  Information gathering actions over human internal state , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Shin Kato,et al.  An automated truck platoon for energy saving , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Tamer Basar,et al.  Feedback Equilibria in Differential Games with Structural and Modal Uncertainties , 1982 .

[18]  Anca D. Dragan,et al.  Planning for Autonomous Cars that Leverage Effects on Human Actions , 2016, Robotics: Science and Systems.

[19]  Karl Henrik Johansson,et al.  Cyber–Physical Control of Road Freight Transport , 2015, Proceedings of the IEEE.

[20]  Karl Henrik Johansson,et al.  An experimental study on the fuel reduction potential of heavy duty vehicle platooning , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[21]  Marwan A. Simaan,et al.  Additional aspects of the Stackelberg strategy in nonzero-sum games , 1972, CDC 1972.

[22]  Alois Knoll,et al.  Tactical cooperative planning for autonomous highway driving using Monte-Carlo Tree Search , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).