Intelligent cuckoo search optimized traffic signal controllers for multi-intersection network

Implementing intelligent adaptive traffic signal controllers for a network of intersections.Using Cuckoo cuckoo search to determine optimal parameters of NN and ANFIS traffic signal controllers.Showing the better performance of CS-NN, CS-ANFIS, and Q-learning controllers compared to the pre-defined method respectively. Traffic congestion in urban roads is one of the biggest challenges of 21 century. Despite a myriad of research work in the last two decades, optimization of traffic signals in network level is still an open research problem. This paper for the first time employs advanced cuckoo search optimization algorithm for optimally tuning parameters of intelligent controllers. Neural Network (NN) and Adaptive Neuro-Fuzzy Inference System (ANFIS) are two intelligent controllers implemented in this study. For the sake of comparison, we also implement Q-learning and fixed-time controllers as benchmarks. Comprehensive simulation scenarios are designed and executed for a traffic network composed of nine four-way intersections. Obtained results for a few scenarios demonstrate the optimality of trained intelligent controllers using the cuckoo search method. The average performance of NN, ANFIS, and Q-learning controllers against the fixed-time controller are 44%, 39%, and 35%, respectively.

[1]  Faridoon Shabaninia,et al.  Type-2 fuzzy multiagent traffic signal control , 2012, 2012 IEEE 13th International Conference on Information Reuse & Integration (IRI).

[2]  Baher Abdulhai,et al.  Reinforcement learning for true adaptive traffic signal control , 2003 .

[3]  Richard S. Sutton,et al.  Generalization in ReinforcementLearning : Successful Examples UsingSparse Coarse , 1996 .

[4]  S. Chand,et al.  Self-organizing traffic control via fuzzy logic , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[5]  A. Koopman,et al.  Simulation and optimization of traffic in a city , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[6]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[7]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[8]  Abbas Khosravi,et al.  Q-learning method for controlling traffic signal phase time in a single intersection , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[9]  Shalabh Bhatnagar,et al.  Reinforcement Learning With Function Approximation for Traffic Signal Control , 2011, IEEE Transactions on Intelligent Transportation Systems.

[10]  Dipti Srinivasan,et al.  Computational intelligence-based congestion prediction for a dynamic urban street network , 2009, Neurocomputing.

[11]  C. P. Pappis,et al.  A Fuzzy Logic Controller for a Trafc Junction , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[13]  Lotfi A. Zadeh,et al.  The concept of a linguistic variable and its application to approximate reasoning-III , 1975, Inf. Sci..

[14]  Chen Cai,et al.  Adaptive traffic signal control using approximate dynamic programming , 2009 .

[15]  Xin-She Yang,et al.  Cuckoo search: recent advances and applications , 2013, Neural Computing and Applications.

[16]  Dipti Srinivasan,et al.  Cooperative, hybrid agent architecture for real-time traffic signal control , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[17]  Min-Liang Huang,et al.  Intersection traffic flow forecasting based on ν-GSVR with a new hybrid evolutionary algorithm , 2015, Neurocomputing.

[18]  Baher Abdulhai,et al.  Multiagent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC): Methodology and Large-Scale Application on Downtown Toronto , 2013, IEEE Transactions on Intelligent Transportation Systems.

[19]  Beatrice Gralton,et al.  Washington DC - USA , 2008 .

[20]  Yu-Chiun Chiou,et al.  Stepwise genetic fuzzy logic signal control under mixed traffic conditions , 2013 .

[21]  Pitu B. Mirchandani,et al.  A REAL-TIME TRAFFIC SIGNAL CONTROL SYSTEM: ARCHITECTURE, ALGORITHMS, AND ANALYSIS , 2001 .

[22]  Monireh Abdoos,et al.  Holonic multi-agent system for traffic signals control , 2013, Eng. Appl. Artif. Intell..

[23]  D. C. Chin,et al.  Traffic-responsive signal timing for system-wide traffic control , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[24]  Dipti Srinivasan,et al.  Neural Networks for Real-Time Traffic Signal Control , 2006, IEEE Transactions on Intelligent Transportation Systems.

[25]  Philip J Tarnoff,et al.  EVALUATION OF OPTIMIZED POLICIES FOR ADAPTIVE CONTROL STRATEGY , 1991 .

[26]  E. Mamdani,et al.  FUZZY LOGIC CONTROLLER FOR A TRAFFIC JUNCTION , 1977 .

[27]  Carlos Gershenson,et al.  Self-organizing traffic lights: A realistic simulation , 2013 .

[28]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[29]  Pinar Civicioglu,et al.  A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms , 2013, Artificial Intelligence Review.

[30]  Nedal T. Ratrout,et al.  Review of the Fuzzy Logic Based Approach in Traffic Signal Control: Prospects in Saudi Arabia , 2009 .

[31]  Equipment Corp,et al.  The Sydney Coordinated Adaptive Traffic (SCAT) System Philosophy and Benefits , 1980 .

[32]  Dipti Srinivasan,et al.  Type-2 fuzzy logic based urban traffic management , 2011, Eng. Appl. Artif. Intell..

[33]  Zhe Sun,et al.  Type-2 fuzzy multi-intersection traffic signal control with differential evolution optimization , 2014, Expert Syst. Appl..

[34]  Luís Gomes,et al.  Optimizing urban traffic flow using Genetic Algorithm with Petri net analysis as fitness function , 2014, Neurocomputing.

[35]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[36]  Mu-Chen Chen,et al.  A data mining based approach for travel time prediction in freeway with non-recurrent congestion , 2014, Neurocomputing.

[37]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[38]  Emile H. L. Aarts,et al.  Global optimization and simulated annealing , 1991, Math. Program..

[39]  Thomas L. Thorpe,et al.  Traac Light Control Using Sarsa with Three State Representations , 1996 .

[40]  Monireh Abdoos,et al.  Traffic light control in non-stationary environments based on multi agent Q-learning , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[41]  Wei-bin Zhang,et al.  Anti-Congestion Fuzzy Algorithm for Traffic Control of a Class of Traffic Networks , 2007, 2007 IEEE International Conference on Granular Computing (GRC 2007).

[42]  Xin-She Yang,et al.  Chapter 9 – Cuckoo Search , 2014 .

[43]  R D Bretherton,et al.  THE SCOOT ON-LINE TRAFFIC SIGNAL OPTIMISATION TECHNIQUE , 1982 .