Using Topological Statistics to Bias and Accelerate Route Choice: Preliminary Findings in Synthetic and Real-World Road Networks

This paper discusses the first steps towards the definition of novel statistics and metrics that characterize networks in terms of the complexity they pose to the traffic assignment problem. Here, we follow an approach in which the assignment emerges from routes selected by learning agents. Specifically, we deal with issues related to how routes are coupled. We first define and quantify route coupling, i.e., how much a given route is coupled with other routes that can be used by learning agents. The investigation of route coupling is important in multiagent reinforcement learning settings since it measures how a change in action selection by one agent interferes with the actions taken by other agents. Our preliminary empirical results indicate that using route coupling to bias the learning process of agents results in faster convergence in the traffic assignment problem.

[1]  Christos H. Papadimitriou,et al.  Worst-case Equilibria , 1999, STACS.

[2]  T. Koopmans,et al.  Studies in the Economics of Transportation. , 1956 .

[3]  J. Y. Yen,et al.  Finding the K Shortest Loopless Paths in a Network , 2007 .

[4]  Tim Roughgarden,et al.  Designing networks for selfish users is hard , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[5]  E. Cascetta,et al.  A MODIFIED LOGIT ROUTE CHOICE MODEL OVERCOMING PATH OVERLAPPING PROBLEMS. SPECIFICATION AND SOME CALIBRATION RESULTS FOR INTERURBAN NETWORKS , 1996 .

[6]  Ana L. C. Bazzan,et al.  Route Decision Behaviour in a Commuting Scenario: Simple Heuristics Adaptation and Effect of Traffic Forecast , 2004, J. Artif. Soc. Soc. Simul..

[7]  Ana L. C. Bazzan,et al.  A multiagent reinforcement learning approach to en-route trip building , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[8]  J. G. Wardrop,et al.  Some Theoretical Aspects of Road Traffic Research , 1952 .

[9]  Hussein Dia,et al.  Intelligent transport systems - neural agent (Neugent) models of driver behaviour , 2014 .

[10]  Tim Roughgarden,et al.  How bad is selfish routing? , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[11]  Craig Boutilier,et al.  The Dynamics of Reinforcement Learning in Cooperative Multiagent Systems , 1998, AAAI/IAAI.

[12]  Kai Nagel,et al.  Towards truly agent-based traffic and mobility simulations , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[13]  Fabián A. Chudak,et al.  Stattic Traffic Assignment Problem: A comparison between Beckmann (1956) and Nesterov & De Palma (1998) models , 2007 .

[14]  M. Bierlaire,et al.  Discrete Choice Methods and their Applications to Short Term Travel Decisions , 1999 .

[15]  Kagan Tumer,et al.  Agent Reward Shaping for Alleviating Traffic Congestion , 2006 .

[16]  Dietrich Braess,et al.  Über ein Paradoxon aus der Verkehrsplanung , 1968, Unternehmensforschung.