Distributed Q-learning Controller for a Multi-Intersection Traffic Network

This paper proposes a Q-learning based controller for a network of multi intersections. According to the increasing amount of traffic congestion in modern cities, using an efficient control system is demanding. The proposed controller designed to adjust the green time for traffic signals by the aim of reducing the vehicles’ travel delay time in a multi-intersection network. The designed system is a distributed traffic timing control model, applies individual controller for each intersection. Each controller adjusts its own intersection’s congestion while attempt to reduce the travel delay time in whole traffic network. The results of experiments indicate the satisfied efficiency of the developed distributed Q-learning controller.

[1]  Monireh Abdoos,et al.  Traffic light control in non-stationary environments based on multi agent Q-learning , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[2]  A. Koopman,et al.  Simulation and optimization of traffic in a city , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[3]  Chen-Khong Tham,et al.  Multi-agent System based Urban Traffic Management , 2007, 2007 IEEE Congress on Evolutionary Computation.

[4]  Chen Cai,et al.  Adaptive traffic signal control using approximate dynamic programming , 2009 .

[5]  Vikram Manikonda,et al.  A multi-agent approach to cooperative traffic management and route guidance , 2005 .

[6]  Visit Hirankitti,et al.  An Agent Approach for Intelligent Traffic-Light Control , 2007, First Asia International Conference on Modelling & Simulation (AMS'07).

[7]  Iisakki Kosonen,et al.  Multi-agent fuzzy signal control based on real-time simulation , 2001 .

[8]  Sylvain Piechowiak,et al.  A behavioral multi-agent model for road traffic simulation , 2008, Eng. Appl. Artif. Intell..

[9]  Abbas Khosravi,et al.  A review on computational intelligence methods for controlling traffic signal timing , 2015, Expert Syst. Appl..

[10]  P Kronborg,et al.  MOVA and LHOVRA: traffic signal control for isolated intersections , 1993 .

[11]  B.M. Nair,et al.  A fuzzy Logic Controller for Isolated Signalized Intersection with Traffic Abnormality Considered , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[12]  Christopher J. Hogger,et al.  A Multi-Agent Approach for Intelligent Traffic-Light Control , 2007, World Congress on Engineering.

[13]  Kardi Teknomo,et al.  Application of microscopic pedestrian simulation model , 2006 .

[14]  Baher Abdulhai,et al.  Reinforcement learning for true adaptive traffic signal control , 2003 .

[15]  Richard S. Sutton,et al.  Generalization in Reinforcement Learning: Successful Examples Using Sparse Coarse Coding , 1995, NIPS.

[16]  Abbas Khosravi,et al.  Intelligent Traffic Light Control of Isolated Intersections Using Machine Learning Methods , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[17]  Shalabh Bhatnagar,et al.  Reinforcement Learning With Function Approximation for Traffic Signal Control , 2011, IEEE Transactions on Intelligent Transportation Systems.

[18]  James C. Spall,et al.  TRAFFIC-RESPONSIVE SIGNAL TIMING FOR SYSTEM-WIDE TRAFFIC CONTROL , 1997 .

[19]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[20]  Abbas Khosravi,et al.  Q-learning method for controlling traffic signal phase time in a single intersection , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[21]  R A Vincent,et al.  'MOVA': TRAFFIC RESPONSIVE, SELF-OPTIMISING SIGNAL CONTROL FOR ISOLATED INTERSECTIONS , 1988 .