Adaptive Traffic Signal Control: Game-Theoretic Decentralized vs. Centralized Perimeter Control

This paper compares the operation of a decentralized Nash bargaining traffic signal controller (DNB) to the operation of state-of-the-art adaptive and gating traffic signal control. Perimeter control (gating), based on the network fundamental diagram (NFD), was applied on the borders of a protected urban network (PN) to prevent and/or disperse traffic congestion. The operation of gating control and local adaptive controllers was compared to the operation of the developed DNB traffic signal controller. The controllers were implemented and their performance assessed on a grid network in the INTEGRATION microscopic simulation software. The results show that the DNB controller, although not designed to solve perimeter control problems, successfully prevents congestion from building inside the PN and improves the performance of the entire network. Specifically, the DNB controller outperforms both gating and non-gating controllers, with reductions in the average travel time ranging between 21% and 41%, total delay ranging between 40% and 55%, and emission levels/fuel consumption ranging between 12% and 20%. The results demonstrate statistically significant benefits of using the developed DNB controller over other state-of-the-art centralized and decentralized gating/adaptive traffic signal controllers.

[1]  Hesham Rakha,et al.  Weather-Tuned Network Perimeter Control - A Network Fundamental Diagram Feedback Controller Approach , 2018, VEHITS.

[2]  Nikolas Geroliminis,et al.  Economic Model Predictive Control of Large-Scale Urban Road Networks via Perimeter Control and Regional Route Guidance , 2018, IEEE Transactions on Intelligent Transportation Systems.

[3]  Jack Haddad,et al.  Robust perimeter control design for an urban region , 2014 .

[4]  Nikolaos Geroliminis,et al.  Perimeter and boundary flow control in multi-reservoir heterogeneous networks , 2013 .

[5]  M. S. French,et al.  Benefits of Signal Timing Optimization and ITS to Corridor Operations , 2006 .

[6]  Hesham A. Rakha,et al.  Implementation and Investigation of a Weather- and Jam Density-Tuned Network Perimeter Controller , 2018, SMARTGREENS/VEHITS.

[7]  Zhiyong Liu,et al.  A Survey of Intelligence Methods in Urban Traffic Signal Control , 2007 .

[8]  Hossam M. Abdelghaffar,et al.  Aerosol tracking using lidar-based atmospheric profiling and Bayesian estimation , 2020 .

[9]  Hesham A. Rakha,et al.  Developing a de-centralized cycle-free nash bargaining arterial traffic signal controller , 2017, 2017 5th IEEE International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS).

[10]  Hesham Rakha,et al.  ESTIMATING VEHICLE FUEL CONSUMPTION AND EMISSIONS BASED ON INSTANTANEOUS SPEED AND ACCELERATION LEVELS , 2002 .

[11]  Ella Bingham,et al.  Neurofuzzy Traffic Signal Control , 1998 .

[12]  Kenneth Tze Kin Teo,et al.  Multiple intersections traffic signal timing optimization with genetic algorithm , 2011, 2011 IEEE International Conference on Control System, Computing and Engineering.

[13]  A G Sims,et al.  SCAT the Sydney coordinated adaptive traffic system: philosophy and benefits , 1979 .

[14]  Francois Dion,et al.  Vehicle Dynamics Model for Estimating Maximum Light-Duty Vehicle Acceleration Levels , 2004 .

[15]  Emilio Frazzoli,et al.  Capacity-Aware Backpressure Traffic Signal Control , 2013, IEEE Transactions on Control of Network Systems.

[16]  James C. Spall,et al.  A model-free approach to optimal signal light timing for system-wide traffic control , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[17]  Nikolas Geroliminis,et al.  A linear formulation for model predictive perimeter traffic control in cities , 2017 .

[18]  Ming Yang,et al.  Toward A Thousand Lights: Decentralized Deep Reinforcement Learning for Large-Scale Traffic Signal Control , 2020, AAAI.

[19]  Abbas Khosravi,et al.  A review on computational intelligence methods for controlling traffic signal timing , 2015, Expert Syst. Appl..

[20]  Nathan H. Gartner,et al.  OPAC: A DEMAND-RESPONSIVE STRATEGY FOR TRAFFIC SIGNAL CONTROL , 1983 .

[21]  Francois Dion,et al.  Estimating Vehicle Stops at Undersaturated and Oversaturated Fixed-Time Signalized Intersections , 2001 .

[22]  N. Geroliminis,et al.  Existence of urban-scale macroscopic fundamental diagrams: Some experimental findings - eScholarship , 2007 .

[23]  Danwei Wang,et al.  Distributed traffic signal control for maximum network throughput , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[24]  Henk Wymeersch,et al.  Back-Pressure Traffic Signal Control With Fixed and Adaptive Routing for Urban Vehicular Networks , 2016, IEEE Transactions on Intelligent Transportation Systems.

[25]  Francois Dion,et al.  COMPARISON OF DELAY ESTIMATES AT UNDER-SATURATED AND OVER-SATURATED PRE-TIMED SIGNALIZED INTERSECTIONS , 2004 .

[26]  Markos Papageorgiou,et al.  Exploiting the fundamental diagram of urban networks for feedback-based gating , 2012 .

[27]  Hesham A. Rakha,et al.  Development and Testing of a Novel Game Theoretic De-Centralized Traffic Signal Controller , 2019, IEEE Transactions on Intelligent Transportation Systems.

[28]  Vinny Cahill,et al.  A Collaborative Reinforcement Learning Approach to Urban Traffic Control Optimization , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[29]  Baher Abdulhai,et al.  Reinforcement learning for true adaptive traffic signal control , 2003 .

[30]  Nikolaos Geroliminis,et al.  Properties of a well-defined Macroscopic Fundamental Diagram for urban traffic , 2011 .

[31]  Tung Le,et al.  Decentralized signal control for urban road networks , 2013, 1310.0491.

[32]  Baher Abdulhai,et al.  Multiagent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC): Methodology and Large-Scale Application on Downtown Toronto , 2013, IEEE Transactions on Intelligent Transportation Systems.

[33]  Hesham A Rakha,et al.  Computing optimum traffic signal cycle length considering vehicle delay and fuel consumption , 2019 .

[34]  Ana L. C. Bazzan,et al.  A Distributed Approach for Coordination of Traffic Signal Agents , 2005, Autonomous Agents and Multi-Agent Systems.

[35]  Michael G.H. Bell,et al.  Traffic signal timing optimisation based on genetic algorithm approach, including drivers’ routing , 2004 .

[36]  Hossam M Abdelghaffar,et al.  A Novel Decentralized Game-Theoretic Adaptive Traffic Signal Controller: Large-Scale Testing , 2019, Sensors.

[37]  Hesham A. Rakha,et al.  Isolated traffic signal control using a game theoretic framework , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[38]  Markos Papageorgiou,et al.  Feedback Gating Based on Sparse-Measurement Urban Network Fundamental Diagrams , 2013 .

[39]  Hesham Rakha,et al.  INTEGRATION 2.30 Framework for Modeling Lane-Changing Behavior in Weaving Sections , 2004 .

[40]  R D Bretherton,et al.  SCOOT-a Traffic Responsive Method of Coordinating Signals , 1981 .

[41]  Hesham Rakha,et al.  Deriving macroscopic fundamental diagrams from probe data: Issues and proposed solutions , 2016 .

[42]  Dongfang Ma,et al.  A Back-Pressure-Based Model With Fixed Phase Sequences for Traffic Signal Optimization Under Oversaturated Networks , 2021, IEEE Transactions on Intelligent Transportation Systems.

[43]  Victor L. Knoop,et al.  Traffic-responsive signals combined with perimeter control: investigating the benefits , 2019, Transportmetrica B: Transport Dynamics.

[44]  Hesham Rakha,et al.  A simplified behavioral vehicle longitudinal motion model , 2009 .

[45]  Hesham A. Rakha,et al.  Sliding Mode Network Perimeter Control , 2020, ArXiv.

[46]  Markos Papageorgiou,et al.  Controller Design for Gating Traffic Control in Presence of Time-delay in Urban Road Networks , 2015 .

[47]  Zhu Han,et al.  Game Theory in Wireless and Communication Networks: Theory, Models, and Applications , 2011 .

[48]  Victor L. Knoop,et al.  Combination of traffic-responsive and gating control in urban networks: Effective interactions , 2016 .

[49]  Pitu B. Mirchandani,et al.  A REAL-TIME TRAFFIC SIGNAL CONTROL SYSTEM: ARCHITECTURE, ALGORITHMS, AND ANALYSIS , 2001 .

[50]  Mudasser F. Wyne,et al.  Traffic responsive signal timing plan generation based on neural network , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[51]  Carlos F. Daganzo,et al.  Fundamentals of Transportation and Traffic Operations , 1997 .

[52]  Dipti Srinivasan,et al.  Neural Networks for Real-Time Traffic Signal Control , 2006, IEEE Transactions on Intelligent Transportation Systems.