Development and Testing of a Novel Game Theoretic De-Centralized Traffic Signal Controller

The paper presents a novel de-centralized traffic signal controller, achieved using a Nash bargaining game-theoretic framework, that operates a flexible phasing sequence to adapt to dynamic changes in traffic demand levels. The Nash bargaining algorithm is used to optimize the traffic signal timings at each signalized intersection by modeling each phase as a player in a game, where players cooperate to reach a mutually agreeable outcome. The algorithm was implemented in the INTEGRATION microscopic traffic assignment and simulation software and tested on two sample networks. The proposed control approach was compared to the operation of an optimum fixed-time coordinated plan, an actuated controller, a centralized adaptive phase split controller, a decentralized phase split and cycle length controller, and a fully coordinated adaptive phase split, cycle length, and offset optimization controller to evaluate its performance. Testing was initially conducted on an isolated intersection, showing a 77% reduction in queue length, a a 64% reduction in vehicle delay, and a 17% reduction in vehicle emission levels. In addition, the algorithm was tested on an arterial network producing statistically significant reductions in total delay ranging between 36% and 67% and vehicle emission reductions ranging between 6% and 13%.

[1]  Nathan H. Gartner,et al.  OPAC: A DEMAND-RESPONSIVE STRATEGY FOR TRAFFIC SIGNAL CONTROL , 1983 .

[2]  R D Bretherton,et al.  SCOOT-a Traffic Responsive Method of Coordinating Signals , 1981 .

[3]  Ana L. C. Bazzan,et al.  Opportunities for multiagent systems and multiagent reinforcement learning in traffic control , 2009, Autonomous Agents and Multi-Agent Systems.

[4]  Dongbin Zhao,et al.  Computational Intelligence in Urban Traffic Signal Control: A Survey , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Hao Yang,et al.  Isolated Traffic Signal Control using Nash Bargaining Optimization , 2017 .

[6]  Ana L. C. Bazzan,et al.  A Distributed Approach for Coordination of Traffic Signal Agents , 2005, Autonomous Agents and Multi-Agent Systems.

[7]  Zhiyong Liu,et al.  A Survey of Intelligence Methods in Urban Traffic Signal Control , 2007 .

[8]  Marco Wiering,et al.  Multi-Agent Reinforcement Learning for Traffic Light control , 2000 .

[9]  M. S. French,et al.  Benefits of Signal Timing Optimization and ITS to Corridor Operations , 2006 .

[10]  A G Sims S.C.A.T. The Sydney Co-ordinated Adaptive Traffic System , 1981 .

[11]  Kenneth Tze Kin Teo,et al.  Multiple intersections traffic signal timing optimization with genetic algorithm , 2011, 2011 IEEE International Conference on Control System, Computing and Engineering.

[12]  Zhu Han,et al.  Fair multiuser channel allocation for OFDMA networks using Nash bargaining solutions and coalitions , 2005, IEEE Transactions on Communications.

[13]  Carlos F. Daganzo,et al.  Fundamentals of Transportation and Traffic Operations , 1997 .

[14]  James C. Spall,et al.  A model-free approach to optimal signal light timing for system-wide traffic control , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[15]  Vinny Cahill,et al.  A Collaborative Reinforcement Learning Approach to Urban Traffic Control Optimization , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[16]  I J Fullerton,et al.  DEVELOPMENT AND TESTING OF ADVANCED CONTROL STRATEGIES IN THE URBAN TRAFFIC CONTROL SYSTEM , 1979 .

[17]  Michael G.H. Bell,et al.  Traffic signal timing optimisation based on genetic algorithm approach, including drivers’ routing , 2004 .

[18]  H. REALTRAN : An Off-Line Emulator for Estimating the Effects of SCOOT , .

[19]  Jie Zhang,et al.  Traffic Signal Coordination Control for Two Intersections Applying Cooperative Game Theory , 2009 .

[20]  Baher Abdulhai,et al.  An agent-based learning towards decentralized and coordinated traffic signal control , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[21]  Baher Abdulhai,et al.  Reinforcement learning for true adaptive traffic signal control , 2003 .

[22]  C. P. Pappis,et al.  A Fuzzy Logic Controller for a Trafc Junction , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Mohsen Guizani,et al.  A Cooperation Strategy Based on Nash Bargaining Solution in Cooperative Relay Networks , 2008, IEEE Transactions on Vehicular Technology.

[24]  Henk Taale,et al.  Integrated anticipatory control of road networks: A game-theoretical approach , 2008 .

[25]  Ella Bingham,et al.  Neurofuzzy Traffic Signal Control , 1998 .