A Noncooperative Game Approach to Autonomous Racing

We consider autonomous racing of two cars and present an approach to formulate racing decisions as a noncooperative nonzero-sum game. We design three different games where the players aim to fulfill static track constraints as well as avoid collision with each other; the latter constraint depends on the combined actions of the two players. The difference between the games is the collision constraints and the payoff. In the first game, collision avoidance is only considered by the follower, and each player maximizes their own progress toward the finish line. We show that, thanks to the sequential structure of this game, equilibria can be computed through an efficient sequential maximization approach. Furthermore, we show that these actions, if feasible, are also a Stackelberg and Nash equilibrium in pure strategies of our second game where both players consider the collision constraints. The payoff of our third game is designed to promote blocking, by additionally rewarding the cars for staying ahead at the end of the horizon. We show that this changes the Stackelberg equilibrium, but has a minor influence on the Nash equilibria. For online implementation, we propose to play the games in a moving horizon fashion and discuss two methods for guaranteeing feasibility of the resulting coupled repeated games. Finally, we study the performance of the proposed approaches in simulation for a setup that replicates the miniature race car tested at the Automatic Control Laboratory, ETH Zürich, Switzerland. The simulation study shows that the presented games can successfully model different racing behaviors and generate interesting racing situations.

[1]  S. Sastry,et al.  Probabilistic pursuit-evasion games: a one-step Nash approach , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[2]  R. Horowitz,et al.  Control design of an automated highway system , 2000, Proceedings of the IEEE.

[3]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[4]  Mac Schwager,et al.  A Real-Time Game Theoretic Planner for Autonomous Two-Player Drone Racing , 2018, Robotics: Science and Systems.

[5]  Xiaojing Zhang,et al.  Optimization-Based Collision Avoidance , 2017, IEEE Transactions on Control Systems Technology.

[6]  Kai Virtanen,et al.  Modeling Air Combat by a Moving Horizon Influence Diagram Game , 2006 .

[7]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[8]  Hans B. Pacejka,et al.  Tyre Modelling for Use in Vehicle Dynamics Studies , 1987 .

[9]  Sanjiv Singh,et al.  The 2005 DARPA Grand Challenge: The Great Robot Race , 2007 .

[10]  P. Saint-Pierre Approximation of the viability kernel , 1994 .

[11]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[12]  John Lygeros,et al.  Real-Time Control for Autonomous Racing Based on Viability Theory , 2017, IEEE Transactions on Control Systems Technology.

[13]  James M. Rehg,et al.  Autonomous Racing with AutoRally Vehicles and Differential Games , 2017, ArXiv.

[14]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[15]  M. Egerstedt,et al.  On the regularization of Zeno hybrid automata , 1999 .

[16]  J. B. Cruz,et al.  Moving horizon Nash strategies for a military air operation , 2002 .

[17]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[18]  John Lygeros,et al.  Verified hybrid controllers for automated vehicles , 1998, IEEE Trans. Autom. Control..

[19]  Zhengyuan Zhou,et al.  Efficient path planning algorithms in reach-avoid problems , 2018, Autom..

[20]  J. Maciejowski,et al.  Soft constraints and exact penalty functions in model predictive control , 2000 .

[21]  M. Levas OBBTree : A Hierarchical Structure for Rapid Interference Detection , .

[22]  Nan Li,et al.  Game Theoretic Modeling of Driver and Vehicle Interactions for Verification and Validation of Autonomous Vehicle Control Systems , 2016, IEEE Transactions on Control Systems Technology.

[23]  J. Lygeros,et al.  Viable set computation for hybrid systems , 2013 .

[24]  Zhengyuan Zhou,et al.  A general, open-loop formulation for reach-avoid games , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[25]  W. Marsden I and J , 2012 .

[26]  J Bekker,et al.  Planning Formula One race strategies using discrete-event simulation , 2009, J. Oper. Res. Soc..

[27]  John Lygeros,et al.  Hamilton–Jacobi Formulation for Reach–Avoid Differential Games , 2009, IEEE Transactions on Automatic Control.

[28]  F. Borrelli,et al.  Stochastic Predictive Control of Autonomous Vehicles in Uncertain Environments , 2014 .

[29]  P. Saint-Pierre,et al.  Set-Valued Numerical Analysis for Optimal Control and Differential Games , 1999 .

[30]  Matthias Althoff,et al.  Model-Based Probabilistic Collision Detection in Autonomous Driving , 2009, IEEE Transactions on Intelligent Transportation Systems.

[31]  Mario Zanon,et al.  Towards time-optimal race car driving using nonlinear MPC in real-time , 2014, 53rd IEEE Conference on Decision and Control.

[32]  Reza Langari,et al.  Stackelberg Game Based Model of Highway Driving , 2012 .

[33]  Manfred Morari,et al.  Optimization‐based autonomous racing of 1:43 scale RC cars , 2015, ArXiv.

[34]  Francesco Borrelli,et al.  Automated driving: The role of forecasts and uncertainty - A control perspective , 2015, Eur. J. Control.

[35]  Jean-Pierre Aubin,et al.  Viability theory , 1991 .

[36]  Francesco Borrelli,et al.  Autonomous racing using learning Model Predictive Control , 2016, 2017 American Control Conference (ACC).

[37]  Stephen M. Erlien,et al.  Collision Avoidance and Stabilization for Autonomous Vehicles in Emergency Scenarios , 2017, IEEE Transactions on Control Systems Technology.

[38]  Pieter Abbeel,et al.  Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization , 2013, Robotics: Science and Systems.

[39]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[40]  S. Shankar Sastry,et al.  Conflict resolution for air traffic management: a study in multiagent hybrid systems , 1998, IEEE Trans. Autom. Control..

[41]  Alexander Liniger,et al.  Path Planning and Control for Autonomous Racing , 2018 .

[42]  J. Christian Gerdes,et al.  Using the centre of percussion to design a steering controller for an autonomous race car , 2012 .

[43]  Zhengyuan Zhou,et al.  An Efficient Algorithm for a Visibility-Based Surveillance-Evasion Game , 2014 .