JADE, TraSMAPI and SUMO: A tool-chain for simulating traffic light control

Increased stress, fuel consumption, air pollution, accidents and delays are some of the consequences of traffic congestion usually incurring in tremendous economic impacts, which society aims to remedy in order to leverage a sustainable development. Recently, unconventional means for modeling and controlling such complex traffic systems relying on multi-agent systems have arisen. This paper contributes to the understanding of such complex and highly dynamic systems by proposing an open-source tool-chain to implement multi-agent-based solutions in traffic and transportation. The proposed approach relies on two very popular tools in both domains, with focus on traffic light control. This tool-chain consists in combining JADE (Java Agent DEvelopment Framework), for the implementation of multi-agent systems, with SUMO (Simulation of Urban MObility), for the microscopic simulation of traffic interactions. TraSMAPI (Traffic Simulation Manager Application Programming Interface) is used to combine JADE and SUMO allowing communication between them. A demonstration of the concept is presented to illustrate the main features of this tool-chain, using Q-Learning as the reinforcement learning method for each traffic light agent in a simulated network. Results demonstrate the feasibility of the proposed framework as a practical means to experiment with different agent-based designs of intelligent transportation solutions.

[1]  Rosaldo J. F. Rossetti,et al.  Capability-Enhanced AIMSUN with Real-Time Signal Timing Control , 2014 .

[2]  Ana L. C. Bazzan,et al.  I TSUMO: an Agent-Based Simulator for ITS Applications , 2010 .

[3]  Kenneth Tze Kin Teo,et al.  Q-Learning Traffic Signal Optimization within Multiple Intersections Traffic Network , 2012, 2012 Sixth UKSim/AMSS European Symposium on Computer Modeling and Simulation.

[4]  Rosaldo J. F. Rossetti,et al.  TraSMAPI: An API oriented towards Multi-Agent Systems real-time interaction with multiple Traffic Simulators , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[5]  Kay W. Axhausen,et al.  Agent-based simulation of travel demand: Structure and computational performance of MATSim-T , 2008 .

[6]  Ana L. C. Bazzan,et al.  A review on agent-based technology for traffic and transportation , 2013, The Knowledge Engineering Review.

[7]  Naser Pariz,et al.  A Novel Fuzzy Model and Control of Single Intersection at Urban Traffic Network , 2010, IEEE Systems Journal.

[8]  Ana L. C. Bazzan,et al.  ITSUMO: an Intelligent Transportation System for Urban Mobility , 2004, AAMAS '06.

[9]  Andreas Tolk,et al.  Towards a taxonomy of agents and multi-agent systems , 2007, SpringSim '07.

[10]  Rosaldo J. F. Rossetti,et al.  An Integrated Framework for Multi-Agent Traffic Simulation using SUMO and JADE , 2013 .

[11]  Ana L. C. Bazzan,et al.  Multi-Agent Systems for Traffic and Transportation Engineering , 2009 .

[12]  Lucas Barcelos de Oliveira,et al.  Multi-agent Model Predictive Control of Signaling Split in Urban Traffic Networks ∗ , 2010 .

[13]  Rosaldo J. F. Rossetti,et al.  Using TraSMAPI for the assessment of multi-agent traffic management solutions , 2012, Progress in Artificial Intelligence.

[14]  Wei Lu,et al.  A multi-agent adaptive traffic signal control system using swarm intelligence and neuro-fuzzy reinforcement learning , 2011, 2011 IEEE Forum on Integrated and Sustainable Transportation Systems.

[15]  T. Urbanik,et al.  Reinforcement learning-based multi-agent system for network traffic signal control , 2010 .

[16]  Agachai Sumalee,et al.  A Genetic Algorithm Approach for Optimizing Traffic Control Signals Considering Routing , 2007, Comput. Aided Civ. Infrastructure Eng..

[17]  Ana L. C. Bazzan,et al.  Learning in groups of traffic signals , 2010, Eng. Appl. Artif. Intell..

[18]  Maxim Raya,et al.  TraCI: an interface for coupling road traffic and network simulators , 2008, CNS '08.

[19]  Cade Braud,et al.  Traffic signal timing manual. , 2008 .