Hierarchical Multi-agent System in Traffic Network Signalization with Improved Genetic Algorithm

Instead of using classical offline data-driven optimization technique in traffic network signal control, this work aims to explore the potential of implementing an online data-driven optimization technique. A dynamic modeling technique is proposed using Q-learning (QL) algorithm to online observe and learn the inflow-outflow traffic behaviors and extract the model parameters to update the evaluation model used in the fitness function of genetic algorithm (GA). The proposed GA with dynamic modeling is known as dyna-GA. Dyna-GA is then integrated into a hierarchical-based multi-agent traffic signal control system which consists of two layers. The lower-layer consists of several local agents that have autonomy in controlling their local intersection, whereas the upper-layer consists of one supervisory agent that has jurisdiction on all the local agents. The supervisory agent has the superiority in overwriting the local control decision if conflict occurred. The robustness of the proposed dyna-GA under several traffic scenarios is tested using a simulated arterial traffic network. The simulation results show the proposed dyna-GA has better performances in minimizing travel delay as compared to the classical GA which does not have the dynamic model.

[1]  Kenneth Tze Kin Teo,et al.  Evolvable traffic signal control for intersection congestion alleviation with enhanced particle swarm optimisation , 2017, 2017 IEEE 2nd International Conference on Automatic Control and Intelligent Systems (I2CACIS).

[2]  Seyed Ali Mohamad Dehghan,et al.  A New Traffic Light Controller Using Fuzzy Logic for a Full Single Junction Involving Emergency Vehicle Preemption , 2015 .

[3]  Kenneth Tze Kin Teo,et al.  Computation of cell transmission model for congestion and recovery traffic flow , 2016, 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia).

[4]  R. Karthikeyan,et al.  Multi Layer Perception Type Artificial Neural Network based Traffic Control , 2016 .

[5]  John Doherty,et al.  Offline Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles , 2019, IEEE Transactions on Evolutionary Computation.

[6]  Kenneth Tze Kin Teo,et al.  Agent-Based Optimization for Multiple Signalized Intersections using Q-Learning , 2020 .

[7]  Kenneth Tze Kin Teo,et al.  Optimization of traffic network signal timing using decentralized genetic algorithm , 2017, 2017 IEEE 2nd International Conference on Automatic Control and Intelligent Systems (I2CACIS).

[8]  Mutiu Adesina Adegboye,et al.  An Embedded Fuzzy Logic Based Application for Density Traffic Control System , 2018, International Journal of Artificial Intelligence Research.

[9]  Shing Chung Josh Wong,et al.  Group-based approach to predictive delay model based on incremental queue accumulations for adaptive traffic control systems , 2017 .

[10]  Kenneth Tze Kin Teo,et al.  Genetic algorithm based signal optimizer for oversaturated urban signalized intersection , 2016, 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia).

[11]  Soo Chen Kwan,et al.  Trip characteristics as the determinants of intention to shift to rail transport among private motor vehicle users in Kuala Lumpur, Malaysia , 2018 .

[12]  Guilherme B. Castro,et al.  Adaptive traffic signal control based on bio-neural network , 2017, ANT/SEIT.

[13]  Kenneth Tze Kin Teo,et al.  A traffic cellular automaton model with optimised speed , 2016, 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia).

[14]  Kenneth Tze Kin Teo,et al.  Optimization of urban traffic network signalization using genetic algorithm , 2016, 2016 IEEE Conference on Open Systems (ICOS).

[15]  Yifeng Chen,et al.  Signal Timing Optimization for Corridors with Multiple Highway-Rail Grade Crossings Using Genetic Algorithm , 2018 .

[16]  Kenneth Tze Kin Teo,et al.  Agent-Based Traffic Flow Optimization at Multiple Signalized Intersections , 2014, 2014 8th Asia Modelling Symposium.

[17]  Ali Payıdar Akgüngör,et al.  Estimation of delay and vehicle stops at signalized intersections using artificial neural network , 2016 .

[18]  Shee Eng Tan,et al.  Design and development of portable fuzzy logic based traffic optimizer , 2013, 2013 IEEE International Conference on Consumer Electronics - China.

[19]  Frederico Gil Sander.  Malaysia economic monitor : transforming urban transport , 2015 .