A Traffic Signal Co-learning Adaptive Control Method Based on Gridding Model and Probability Grey Number Theory

The increasing volume of traffic in cities has a significant effect on the road traffic congestions and as well the time it takes for road users to reach their destination. In this paper, we use the information of vehicles on the road network, including position, velocity, number of passengers, destination etc., as system inputs, to establish adaptive traffic signal coordination optimization model, in order to generate the optimal traffic signal area coordinated control scheme, and to suggest the best route to vehicles dynamically. We divide road network into grids, and use Mix-truncation-gauss-probabilitybased Interval Grey Number to describe vehicle position. The target of system optimization is to minimize the Total Trip Travel Time. To solve the problem, dynamic programming model is established, and the iterative algorithm is presented. A nice feature of our method is to recommend the shortest paths for vehicles when optimizing signal timing scheme of each intersection, which is called co-learning. Simulation results show that, the proposed method outperforms the Fixtiming method and Vehicle Actuated method on multiple evaluation indexes, including the Average Vehicle Delay Time, Average Vehicle Queue Length, Stops, Total Trip Travel Time and so on.

[1]  Jingcheng Wu,et al.  Methodologies for Estimating Vehicle Queue Length at Metered On-Ramps , 2008 .

[2]  W. Marsden I and J , 2012 .

[3]  Marco Wiering,et al.  Multi-Agent Reinforcement Learning for Traffic Light control , 2000 .

[4]  Baher Abdulhai,et al.  Reinforcement learning for true adaptive traffic signal control , 2003 .

[5]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[6]  Bart De Schutter,et al.  Efficient network-wide model-based predictive control for urban traffic networks , 2012 .

[7]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[8]  Li Cheng-rong Map building for mobile robot based on GQSIM , 2009 .

[9]  Mohamed A. Khamis,et al.  Adaptive multi-objective reinforcement learning with hybrid exploration for traffic signal control based on cooperative multi-agent framework , 2014, Eng. Appl. Artif. Intell..

[10]  Pravin Varaiya,et al.  Real-Time Measurement of Link Vehicle Count and Travel Time in a Road Network , 2010, IEEE Transactions on Intelligent Transportation Systems.

[11]  Bart De Schutter,et al.  Traffic Management for Automated Highway Systems Using Model-Based Predictive Control , 2012, IEEE Transactions on Intelligent Transportation Systems.

[12]  Bart De Schutter,et al.  A Predictive Traffic Controller for Sustainable Mobility Using Parameterized Control Policies , 2012, IEEE Transactions on Intelligent Transportation Systems.

[13]  A.G. Sims,et al.  The Sydney coordinated adaptive traffic (SCAT) system philosophy and benefits , 1980, IEEE Transactions on Vehicular Technology.

[14]  R D Bretherton,et al.  THE SCOOT ON-LINE TRAFFIC SIGNAL OPTIMISATION TECHNIQUE , 1982 .

[15]  Alexander Skabardonis,et al.  Identification and Analysis of Queue Spillovers in City Street Networks , 2011, IEEE Transactions on Intelligent Transportation Systems.

[16]  Baher Abdulhai,et al.  Multi-Agent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC) , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[17]  Peng Wang,et al.  Grey qualitative modeling and control method for subjective uncertain systems , 2015, Int. J. Autom. Comput..

[18]  Markos Papageorgiou,et al.  A Simplified Estimation Scheme for the Number of Vehicles in Signalized Links , 2010, IEEE Transactions on Intelligent Transportation Systems.

[19]  Zonghai Chen,et al.  Adaptive Traffic Signal Control of Bottleneck Subzone based on Grey Qualitative Reinforcement Learning Algorithm , 2015, ICPRAM.

[20]  Andreas Hegyi,et al.  Considerations for model-based traffic control , 2013 .

[21]  Mecit Cetin,et al.  Analytical Evaluation of the Error in Queue Length Estimation at Traffic Signals From Probe Vehicle Data , 2011, IEEE Transactions on Intelligent Transportation Systems.

[22]  Bin Ran,et al.  An Exploratory Shockwave Approach to Estimating Queue Length Using Probe Trajectories , 2012, J. Intell. Transp. Syst..

[23]  Fei-Yue Wang,et al.  RHODES to Intelligent Transportation Systems , 2005, IEEE Intell. Syst..

[24]  Henry X. Liu,et al.  A virtual vehicle probe model for time-dependent travel time estimation on signalized arterials , 2009 .