A market-inspired approach to reservation-based urban road traffic management

Urban road traffic management is an example of a socially relevant problem that can be modelled as a large-scale, open, distributed system, composed of many autonomous interacting agents, which need to be controlled in a decentralized manner. Most models for urban road traffic management rely on control elements that act on traffic flows. Dresner and Stone have put forward the idea of an advanced urban road traffic infrastructure that allows for cars to individually reserve space and time at an intersection so as to be able to safely cross it. In this paper we extend Dresner and Stone's approach to networks of intersections. For this purpose, we draw upon market-inspired control methods as a paradigm for urban road traffic management. We conceive the system as a computational economy, where driver agents trade with infrastructure agents in a virtual marketplace, purchasing reservations to cross intersections when commuting through the city. We show that in situations of similar traffic load, an increase of the infrastructure's monetary benefit usually implies a decrease of the drivers' average travel times.

[1]  S. Clearwater.  Market-based control: a paradigm for distributed resource allocation , 1996 .

[2]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[3]  R. Tobin,et al.  Dynamic congestion pricing models for general traffic networks , 1998 .

[4]  Ana L. C. Bazzan,et al.  Congestion tolls as utility alignment between agent and system optimum , 2006, AAMAS '06.

[5]  Ana L. C. Bazzan,et al.  Evaluating the performance of DCOP algorithms in a real world, dynamic problem , 2008, AAMAS.

[6]  Márk Jelasity,et al.  Gossip-based aggregation in large dynamic networks , 2005, TOCS.

[7]  Ana L. C. Bazzan,et al.  Reducing the Effects of the Braess Paradox with Information Manipulation , 2005, Applications of Agent Technology in Traffic and Transportation.

[8]  M. Meyer,et al.  Urban transportation planning , 1984 .

[9]  Shimon Whiteson,et al.  Multiagent Reinforcement Learning for Urban Traffic Control Using Coordination Graphs , 2008, ECML/PKDD.

[10]  Ana L. C. Bazzan,et al.  Opportunities for multiagent systems and multiagent reinforcement learning in traffic control , 2009, Autonomous Agents and Multi-Agent Systems.

[11]  Kagan Tumer,et al.  Optimal Payoff Functions for Members of Collectives , 2001, Adv. Complex Syst..

[12]  T Schwerdtfeger,et al.  DYNEMO: A MODEL FOR THE SIMULATION OF TRAFFIC FLOW IN MOTORWAY NETWORKS , 1984 .

[13]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[14]  Sean Luke,et al.  History-based traffic control , 2006, AAMAS '06.

[15]  Kagan Tumer,et al.  Distributed agent-based air traffic flow management , 2007, AAMAS '07.

[16]  Michael Schreckenberg,et al.  A cellular automaton model for freeway traffic , 1992 .

[17]  Ronghui Liu,et al.  An agent-based framework for the assessment of drivers' decision-making , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[18]  Peter Stone,et al.  A Multiagent Approach to Autonomous Intersection Management , 2008, J. Artif. Intell. Res..