Solving a Dynamic User-Optimal Route Guidance Problem Based on Joint Strategy Fictitious Play

Dynamic route guidance systems aim to provide users with on-line information on traffic conditions and suggest relevant route guidance to facilitate route choices for users. In this study, we consider the problem as a multi-player repeated game in a dynamic multi-agent transportation system. We propose a game theory approach based on joint strategy fictitious play by explicitly modeling users’ compliances to route recommendations as an inertia term. Each guided user makes his travel time estimations and local outgoing link decisions based on his historical experiences and traffic time information received en-route as provided by a system administrator. Based on the travel times estimated en-route, users adapt their route choices progressively via fast routes to their destinations. The dynamic user-optimal route guidance problem is formulated as a variational inequality problem in a queue-based traffic flow model. We show that the proposed approach can solve a dynamic user-optimal route guidance problem based on users’ local outgoing link choice decisions. The numerical studies are implemented by considering two classes of users in the system: informed and non-informed users. The results demonstrate the convergence of the proposed algorithm and highlight significant travel times and delay reduction in a congested situation. Although the user-compliance mechanism for the route recommendations is currently modeled as a static term, it provides rooms for further improvement based on more realistic compliance mechanisms.

[1]  Xiao-Yan Sun,et al.  Prediction feedback in intelligent traffic systems , 2009 .

[2]  Robert A. Meyers,et al.  Encyclopedia of Complexity and Systems Science , 2009 .

[3]  J. G. Wardrop,et al.  Some Theoretical Aspects of Road Traffic Research , 1952 .

[4]  Terry L. Friesz,et al.  Solving the Dynamic Network User Equilibrium Problem with State-Dependent Time Shifts , 2006 .

[5]  Jason R. Marden,et al.  Joint Strategy Fictitious Play with Inertia for Potential Games , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[6]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[7]  Roberto Cominetti,et al.  Author's Personal Copy Games and Economic Behavior a Payoff-based Learning Procedure and Its Application to Traffic Games , 2022 .

[8]  Hai-Jun Huang,et al.  Modeling and solving the dynamic user equilibrium route and departure time choice problem in network with queues , 2002 .

[9]  O. H. Brownlee,et al.  ACTIVITY ANALYSIS OF PRODUCTION AND ALLOCATION , 1952 .

[10]  S. Peeta,et al.  Adaptability of a hybrid route choice model to incorporating driver behavior dynamics under information provision , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[11]  Jean-Patrick Lebacque,et al.  A cross entropy based multiagent approach for multiclass activity chain modeling and simulation , 2013 .

[12]  Ulrich Berger,et al.  Two more classes of games with the continuous-time fictitious play property , 2007, Games Econ. Behav..

[13]  Wendy Weijermars,et al.  The relationship between road safety and congestion on motorways : a literature review of potential effects. , 2010 .

[14]  Yixuan Li,et al.  Large-Scale Dynamic Traffic Assignment: Implementation Issues and Computational Analysis , 2004 .

[15]  R. Minciardi,et al.  A decentralized optimal control scheme for route guidance in urban road networks , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[16]  Bing-Hong Wang,et al.  A comprehensive study of advanced information feedbacks in real-time intelligent traffic systems , 2012 .

[17]  Zugang Liu,et al.  On the stochastic network equilibrium with heterogeneous choice inertia , 2014 .

[18]  Markos Papageorgiou,et al.  Dynamic modeling, assignment, and route guidance in traffic networks , 1990 .

[19]  Hai-Jun Huang,et al.  A Multi-Class Dynamic User Equilibrium Model for Queuing Networks with Advanced Traveler Information Systems , 2003, J. Math. Model. Algorithms.

[20]  Rolf H. Möhring,et al.  System-optimal Routing of Traffic Flows with User Constraints in Networks with Congestion System-optimal Routing of Traffic Flows with User Constraints in Networks with Congestion , 2022 .

[21]  Francesco Paolo Deflorio,et al.  Evaluation of a reactive dynamic route guidance strategy , 2003 .

[22]  Sebastian Kube,et al.  Experimental Investigation of Day-to-Day Route-Choice Behaviour and Network Simulations of Autobahn Traffic in North Rhine-Westphalia , 2004 .

[23]  Alfredo Garcia,et al.  Fictitious play for finding system optimal routings in dynamic traffic networks 1 This work was supp , 2000 .

[24]  Hubert Rehborn,et al.  Traffic Prediction of Congested Patterns , 2009, Encyclopedia of Complexity and Systems Science.

[25]  Xiaoyan Sun,et al.  Effects of prediction feedback in multi-route intelligent traffic systems ☆ , 2009, 0909.5202.

[26]  D.E. Kaufman,et al.  An iterative routing/assignment method for anticipatory real-time route guidance , 1991, Vehicle Navigation and Information Systems Conference, 1991.

[27]  T. Arentze,et al.  Traveler Compliance with Advice: A Bayesian Utilitarian Perspective , 2009 .

[28]  Zilla Sinuany-Stern,et al.  THE EFFECT OF INFORMATION ON COMMUTERS' BEHAVIOR: A COMPARATIVE MICRO-SIMULATION APPROACH. IN: TRANSPORT AND INFORMATION SYSTEMS , 1997 .

[29]  Soummya Kar,et al.  Distributed learning in large-scale multi-agent games: A modified fictitious play approach , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[30]  Lorenzo Meschini,et al.  Spillback congestion in dynamic traffic assignment: A macroscopic flow model with time-varying bottlenecks , 2007 .

[31]  S. Hart,et al.  A simple adaptive procedure leading to correlated equilibrium , 2000 .

[32]  J. Lebacque.  THE GODUNOV SCHEME AND WHAT IT MEANS FOR FIRST ORDER TRAFFIC FLOW MODELS , 1996 .

[33]  Moshe Ben-Akiva,et al.  A joint model of travel information acquisition and response to received messages , 2013 .

[34]  Ana L. C. Bazzan,et al.  The impact of real-time information in a two-route scenario using agent-based simulation , 2002 .

[35]  Hani S. Mahmassani,et al.  Time dependent, shortest-path algorithm for real-time intelligent vehicle highway system applications , 1993 .

[36]  H. Peyton Young,et al.  Strategic Learning and Its Limits , 2004 .

[37]  W. Y. Szeto,et al.  Dynamic traffic assignment: model classifications and recent advances in travel choice principles , 2012 .

[38]  Toshihiko Miyagi,et al.  Adaptive Learning Algorithms for Traffic Games with Naive Users , 2013 .

[39]  Haris N. Koutsopoulos,et al.  Simulation-Based Evaluation of Advanced Traveler Information Systems , 2005 .

[40]  Terry L. Friesz,et al.  A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem , 1993, Oper. Res..

[41]  Alexander Paz,et al.  Behavior-consistent real-time traffic routing under information provision , 2009 .

[42]  C. Gawron,et al.  An Iterative Algorithm to Determine the Dynamic User Equilibrium in a Traffic Simulation Model , 1998 .

[43]  Masao Kuwahara,et al.  Decomposition of the reactive dynamic assignments with queues for a many-to-many origin-destination pattern , 1997 .

[44]  Michel Bierlaire,et al.  Solving the anticipatory route guidance generation problem using a generalization of secant methods , 2003 .

[45]  He Huang,et al.  Real-time traveler information for optimal adaptive routing in stochastic time-dependent networks , 2012 .

[46]  Sjaak Hurkens.  Learning by Forgetful Players , 1995 .

[47]  Athanasios K. Ziliaskopoulos,et al.  Foundations of Dynamic Traffic Assignment: The Past, the Present and the Future , 2001 .

[48]  Ching-Jong Wang.  The relationship between traffic congestion and road accidents : an econometric approach using GIS , 2010 .

[49]  Michael Schreckenberg,et al.  A cellular automaton model for freeway traffic , 1992 .

[50]  Hai Yang,et al.  Modeling User Adoption of Advanced Traveler Information Systems: a Control Theoretic Approach for Optimal Endogenous Growth , 2004 .

[51]  Masao Kuwahara,et al.  Dynamic user optimal assignment with physical queues for a many-to-many OD pattern , 2001 .

[52]  Sarah Minty.  Working paper 7 , 2014 .

[53]  R. Minciardi,et al.  Dynamic models and optimal control methods for route guidance in urban traffic networks , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[54]  Samer Madanat,et al.  Perception updating and day-to-day travel choice dynamics in traffic networks with information provision , 1998 .

[55]  L. Shapley,et al.  Fictitious Play Property for Games with Identical Interests , 1996 .

[56]  Michael Schreckenberg,et al.  Human Behaviour and Traffic Networks , 2004 .

[57]  B. Dellaert,et al.  Travel Choice Inertia: The Joint Role of Risk Aversion and Learning , 2010 .

[58]  Haris N. Koutsopoulos,et al.  DEVELOPMENT OF A ROUTE GUIDANCE GENERATION SYSTEM FOR REAL-TIME APPLICATION , 1997 .

[59]  Robert L. Smith,et al.  A Fictitious Play Approach to Large-Scale Optimization , 2005, Oper. Res..

[60]  Jon Alan Bottom,et al.  Consistent anticipatory route guidance , 2000 .

[61]  Yusen Chen,et al.  Generating Optimal Controlled Prescriptive Route Guidance in Realistic Traffic Networks; A Generic Approach , 2006 .

[62]  Jean-Loup Farges,et al.  Optimization of traffic dynamic route guidance with drivers' reactions in a queue-based model , 1995, IEEE Trans. Syst. Man Cybern..

[63]  J. Lebacque.  First-Order Macroscopic Traffic Flow Models: Intersection Modeling, Network Modeling , 2005 .

[64]  Srinivas Peeta,et al.  A Hybrid Model for Driver Route Choice Incorporating En-Route Attributes and Real-Time Information Effects , 2003 .

[65]  Louis Anthony Cox,et al.  Wiley encyclopedia of operations research and management science , 2011 .

[66]  Anders Rantzer,et al.  Using Game Theory for Distributed Control Engineering , 2008 .