A collaborative agent-based traffic signal system for highly dynamic traffic conditions

In this paper we present DALI, a distributed, collaborative multi-agent Traffic Signal Timing system (TST) for highly dynamic traffic conditions. In DALI, intersection controllers are augmented with software agents which collaboratively adapt signal timings by considering the feedback of all controller agents that may be affected by a change. The model is based on a real-world TST and is intended to be deployed with minimal changes to the infrastructure. DALI has been validated on a simulated model of the City of Richardson, Texas, comprising 128 signalized intersections. The experimental results show that it outperforms the conventional traffic operation modes as well as an RL-based TST in highly dynamic scenarios.

[1]  Vinny Cahill,et al.  Towards autonomic urban traffic control with collaborative multi-policy reinforcement learning , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[2]  Jean-Loup Farges,et al.  THE PRODYN REAL TIME TRAFFIC ALGORITHM , 1983 .

[3]  P. Mannion.  Learning Traffic Signal Control with Advice , 2015 .

[4]  Robert L. Smith,et al.  CoSIGN: A Parallel Algorithm for Coordinated Traffic Signal Control , 2006, IEEE Transactions on Intelligent Transportation Systems.

[5]  Ana L. C. Bazzan,et al.  A Distributed Approach for Coordination of Traffic Signal Agents , 2004, Autonomous Agents and Multi-Agent Systems.

[6]  Lucia Lo Bello,et al.  A novel approach for dynamic traffic lights management based on Wireless Sensor Networks and multiple fuzzy logic controllers , 2015, Expert Syst. Appl..

[7]  Mee Hong Ling,et al.  A Survey on Reinforcement Learning Models and Algorithms for Traffic Signal Control , 2017, ACM Comput. Surv..

[8]  Baher Abdulhai,et al.  An agent-based learning towards decentralized and coordinated traffic signal control , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[9]  Shalabh Bhatnagar,et al.  Multi-agent reinforcement learning for traffic signal control , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[10]  Iisakki Kosonen,et al.  Multi-agent fuzzy signal control based on real-time simulation , 2001 .

[11]  Dipti Srinivasan,et al.  Neural Networks for Real-Time Traffic Signal Control , 2006, IEEE Transactions on Intelligent Transportation Systems.

[12]  Vinny Cahill,et al.  Soilse: A decentralized approach to optimization of fluctuating urban traffic using Reinforcement Learning , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[13]  Matthew E. Taylor,et al.  Learning Coordinated Traffic Light Control , 2013 .

[14]  Vinny Cahill,et al.  Autonomic multi-policy optimization in pervasive systems: Overview and evaluation , 2012, TAAS.

[15]  Ana L. C. Bazzan,et al.  A review on agent-based technology for traffic and transportation , 2013, The Knowledge Engineering Review.

[16]  Juan C. Medina,et al.  Traffic signal control using reinforcement learning and the max-plus algorithm as a coordinating strategy , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[17]  Zhe Sun,et al.  Type-2 fuzzy multi-intersection traffic signal control with differential evolution optimization , 2014, Expert Syst. Appl..

[18]  Baher Abdulhai,et al.  Multiagent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC): Methodology and Large-Scale Application on Downtown Toronto , 2013, IEEE Transactions on Intelligent Transportation Systems.

[19]  Abbas Khosravi,et al.  Intelligent cuckoo search optimized traffic signal controllers for multi-intersection network , 2015, Expert Syst. Appl..

[20]  Monireh Abdoos,et al.  Holonic multi-agent system for traffic signals control , 2013, Eng. Appl. Artif. Intell..

[21]  Ana L. C. Bazzan,et al.  Learning in groups of traffic signals , 2010, Eng. Appl. Artif. Intell..

[22]  Baher Abdulhai,et al.  Reinforcement learning for true adaptive traffic signal control , 2003 .

[23]  Meng-Hui Wang,et al.  An Intelligent Traffic Light Control Based on Extension Neural Network , 2008, KES.