Driving and Routing Game for Autonomous Vehicles on a Network

This paper aims to answer the research question as to optimal design of decision-making processes for autonomous vehicles (AVs), including dynamical selection of driving velocity and route choices on a transportation network. Dynamic traffic assignment (DTA) has been widely used to model travelers' route choice or/and departure-time choice and predict dynamic traffic flow evolution in the short term. However, the existing DTA models do not explicitly describe one's selection of driving velocity on a road link. Driving velocity choice may not be crucial for modeling the movement of human drivers but it is a must-have control to maneuver AVs. In this paper, we aim to develop a game-theoretic model to solve for AVs' optimal driving strategies of velocity control in the interior of a road link and route choice at a junction node. To this end, we will first reinterpret the DTA problem as an N-car differential game and show that this game can be tackled with a general mean field game-theoretic framework. The developed mean field game is challenging to solve because of the forward and backward structure for velocity control and the complementarity conditions for route choice. An efficient algorithm is developed to address these challenges. The model and the algorithm are illustrated in on Braess networks. We first compare the LWR based DTA model with the proposed game and find that the driving and routing control navigates AVs with overall lower costs. We then compare the total travel cost without and with the middle link and find that the Braess paradox may still arise under certain conditions.

[1]  Lorenzo Meschini,et al.  Spillback congestion in dynamic traffic assignment: A macroscopic flow model with time-varying bottlenecks , 2007 .

[2]  E. Dockner,et al.  Differential Games in Economics and Management Science , 2001 .

[3]  Athanasios K. Ziliaskopoulos,et al.  Foundations of Dynamic Traffic Assignment: The Past, the Present and the Future , 2001 .

[4]  P. I. Richards.  Shock Waves on the Highway , 1956 .

[5]  Bin Ran,et al.  Solving an Instantaneous Dynamic User-Optimal Route Choice Model , 1995, Transp. Sci..

[6]  Malachy Carey,et al.  Comparing whole-link travel time models , 2003 .

[7]  M J Lighthill,et al.  On kinematic waves II. A theory of traffic flow on long crowded roads , 1955, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[8]  R. LeVeque.  Finite Volume Methods for Hyperbolic Problems: Characteristics and Riemann Problems for Linear Hyperbolic Equations , 2002 .

[9]  H. M. Zhang,et al.  A Comparative Study of Some Macroscopic Link Models Used in Dynamic Traffic Assignment , 2005 .

[10]  S. Shankar Sastry,et al.  Inverse Problem for Non-Viscous Mean Field Control: Example From Traffic , 2016, IEEE Transactions on Automatic Control.

[11]  W. Y. Szeto,et al.  A cell-based variational inequality formulation of the dynamic user optimal assignment problem , 2002 .

[12]  Randall J. LeVeque,et al.  Finite difference methods for ordinary and partial differential equations - steady-state and time-dependent problems , 2007 .

[13]  Y. W. Xu,et al.  Advances in the Continuous Dynamic Network Loading Problem , 1996, Transp. Sci..

[14]  Christian A. Ringhofer,et al.  Large-Scale Dynamics of Mean-Field Games Driven by Local Nash Equilibria , 2014, J. Nonlinear Sci..

[15]  Malachy Carey,et al.  Behaviour of a whole-link travel time model used in dynamic traffic assignment , 2002 .

[16]  H. M. Zhang,et al.  Modelling network flow with and without link interactions: the cases of point queue, spatial queue and cell transmission model , 2013 .

[17]  Hyunsoo Noh,et al.  Technical Report on SHRP 2 C10B Version of DynusT and FAST-TrIPs , 2013 .

[18]  Xuan Di,et al.  Scalable traffic stability analysis in mixed-autonomy using continuum models , 2020 .

[19]  Hai-Jun Huang,et al.  Dynamic user optimal traffic assignment model for many to one travel demand , 1995 .

[20]  Xuan Zhang,et al.  Density Flow in Dynamical Networks via Mean-Field Games , 2017, IEEE Transactions on Automatic Control.

[21]  Hani S. Mahmassani,et al.  Dynamic Network Traffic Assignment and Simulation Methodology for Advanced System Management Applications , 2001 .

[22]  B. Ran,et al.  A LINK-BASED VARIATIONAL INEQUALITY FORMULATION OF IDEAL DYNAMIC USER-OPTIMAL ROUTE CHOICE PROBLEM , 1996 .

[23]  M. Lighthill.  On sound generated aerodynamically I. General theory , 1952, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[24]  H. M. Zhang,et al.  Delay-Function-Based Link Models: Their Properties and Computational Issues , 2005 .

[25]  Benedetto Piccoli,et al.  Multiscale Modeling and Control Architecture for V2X Enabled Traffic Streams , 2017, IEEE Transactions on Vehicular Technology.

[26]  Yafeng Yin,et al.  Optimal deployment of charging lanes for electric vehicles in transportation networks , 2016 .

[27]  Marie-Therese Wolfram,et al.  On a mean field game approach modeling congestion and aversion in pedestrian crowds , 2011 .

[28]  Kuang Huang,et al.  A Game-Theoretic Framework for Autonomous Vehicles Velocity Control: Bridging Microscopic Differential Games and Macroscopic Mean Field Games , 2019, Discrete & Continuous Dynamical Systems - B.

[29]  Tao Yao,et al.  A partial differential equation formulation of Vickrey’s bottleneck model, part I: Methodology and theoretical analysis , 2013 .

[30]  Guido Gentile,et al.  Using the General Link Transmission Model in a Dynamic Traffic Assignment to Simulate Congestion on Urban Networks , 2015 .

[31]  Michel Bierlaire,et al.  Dynamic network loading: a stochastic differentiable model that derives link state distributions , 2011 .

[32]  B. W. Wie.  Dynamic User Optimal Traffic Assignment on Congested Multi-destination Network , 1990 .

[33]  Terry L. Friesz,et al.  Computing Dynamic User Equilibria on Large-Scale Networks with Software Implementation , 2019, Networks and Spatial Economics.

[34]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[35]  Mukund Sundararajan,et al.  Mean Field Equilibria of Dynamic Auctions with Learning , 2014, Manag. Sci..

[36]  Masao Kuwahara,et al.  Dynamic user optimal assignment with physical queues for a many-to-many OD pattern , 2001 .

[37]  Roland P. Malhamé,et al.  A micro-macro traffic model based on Mean-Field Games , 2015, 2015 American Control Conference (ACC).

[38]  Richard E. Rosenthal,et al.  GAMS -- A User's Guide , 2004 .

[39]  Stephen D. Boyles,et al.  A multiclass cell transmission model for shared human and autonomous vehicle roads , 2016 .

[40]  M. Burger,et al.  Mean field games with nonlinear mobilities in pedestrian dynamics , 2013, 1304.5201.

[41]  P. Cardaliaguet,et al.  Mean Field Games , 2020, Lecture Notes in Mathematics.

[42]  Terry L. Friesz,et al.  A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem , 1993, Oper. Res..

[43]  Terry L. Friesz,et al.  Continuity of the path delay operator for dynamic network loading with spillback , 2015, 1501.04241.

[44]  W. Y. Szeto,et al.  A CELL-BASED SIMULTANEOUS ROUTE AND DEPARTURE TIME CHOICE MODEL WITH ELASTIC DEMAND , 2004 .

[45]  Hamidou Tembine,et al.  Electrical Vehicles in the Smart Grid: A Mean Field Game Analysis , 2011, IEEE Journal on Selected Areas in Communications.

[46]  Henry X. Liu,et al.  Continuous-time point-queue models in dynamic network loading , 2012 .

[47]  Jia Yuan Yu,et al.  Mean field equilibria of multi armed bandit games , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[48]  Kuang Huang,et al.  Stabilizing Traffic via Autonomous Vehicles: A Continuum Mean Field Game Approach , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[49]  H. Lo.  A DYNAMIC TRAFFIC ASSIGNMENT FORMULATION THAT ENCAPSULATES THE CELL-TRANSMISSION MODEL , 1999 .

[50]  Bin Ran,et al.  A link-based variational inequality model for dynamic departure time/route choice , 1996 .

[51]  Adriano Festa,et al.  A Mean Field Games approach for multi-lane traffic management , 2017, 1711.04116.

[52]  A. Lachapelle,et al.  COMPUTATION OF MEAN FIELD EQUILIBRIA IN ECONOMICS , 2010 .

[53]  Deepak K. Merchant,et al.  A Model and an Algorithm for the Dynamic Traffic Assignment Problems , 1978 .

[54]  Pedro A. Neto,et al.  Dynamic user equilibrium based on a hydrodynamic model , 2013 .

[55]  Terry L. Friesz,et al.  The mathematical foundations of dynamic user equilibrium , 2019, Transportation Research Part B: Methodological.

[56]  Bin Ran,et al.  for dynamic user equilibria with exact flow propagations , 2008 .

[57]  George L. Nemhauser,et al.  Optimality Conditions for a Dynamic Traffic Assignment Model , 1978 .

[58]  Hamidou Tembine,et al.  Mean-Field-Type Games in Engineering , 2016, ArXiv.

[59]  Omar Drissi-Kaïtouni,et al.  A variational inequality formulation of the Dynamic Traffic Assignment Problem , 1993 .