AN MDP DECOMPOSITION APPROACH FOR TRAFFIC CONTROL AT ISOLATED SIGNALIZED INTERSECTIONS

This article presents a novel approach for the dynamic control of a signalized intersection. At the intersection, there is a number of arrival flows of cars, each having a single queue (lane). The set of all flows is partitioned into disjoint combinations of nonconflicting flows that will receive green together. The dynamic control of the traffic lights is based on the numbers of cars waiting in the queues. The problem concerning when to switch (and which combination to serve next) is modeled as a Markovian decision process in discrete time. For large intersections (i.e., intersections with a large number of flows), the number of states becomes tremendously large, prohibiting straightforward optimization using value iteration or policy iteration. Starting from an optimal (or nearly optimal) fixed-cycle strategy, a one-step policy improvement is proposed that is easy to compute and is shown to give a close to optimal strategy for the dynamic problem.

[1]  Wang,et al.  Review of road traffic control strategies , 2003, Proceedings of the IEEE.

[2]  Suvrajeet Sen,et al.  Controlled Optimization of Phases at an Intersection , 1997, Transp. Sci..

[3]  Johan van Leeuwaarden,et al.  Delay Analysis for the Fixed-Cycle Traffic-Light Queue , 2006, Transp. Sci..

[4]  G. F. Newell.  Approximation Methods for Queues with Application to the Fixed-Cycle Traffic Light , 1965 .

[5]  J. M. Norman,et al.  Heuristic procedures in dynamic programming , 1972 .

[6]  H. Tijms.  A First Course in Stochastic Models , 2003 .

[7]  Gordon F. Newell,et al.  Queues for a Fixed-Cycle Traffic Light , 1960 .

[8]  K. Krishnan,et al.  Joining the right queue: A Markov decision-rule , 1987, 26th IEEE Conference on Decision and Control.

[9]  Sandjai Bhulai.  Dynamic routing policies for multiskill call centers , 2009 .

[10]  Henk C. Tijms,et al.  A First Course in Stochastic Models: Tijms/Stochastic Models , 2003 .

[11]  K. Krishnan,et al.  State-dependent routing for telephone traffic: Theory and results , 1986, 1986 25th IEEE Conference on Decision and Control.

[12]  R A Vincent,et al.  Self-optimising traffic signal control using microprocessors. The TRRL MOVA strategy for isolated intersections , 1986 .

[13]  Alan J. Miller.  Settings for Fixed-Cycle Traffic Signals , 1963 .

[14]  J. Darroch.  On the Traffic-light Queue , 1964 .

[15]  Donald R. McNeil,et al.  A solution to the fixed-cycle traffic light problem for compound Poisson arrivals , 1968 .

[16]  Alan J. Miller,et al.  A COMPUTER CONTROL SYSTEM FOR TRAFFIC NETWORKS. , 1963 .

[17]  J Wijngaard,et al.  Decomposition for dynamic programming in production and inventory control , 1979 .

[18]  Henk Tijms,et al.  A heuristic rule for routing customers to parallel servers , 1997 .

[19]  Jean-Loup Farges,et al.  THE PRODYN REAL TIME TRAFFIC ALGORITHM , 1983 .

[20]  M Higashikubo,et al.  TRAFFIC QUEUE LENGTH MEASUREMENT USING AN IMAGE PROCESSING SENSOR , 1996 .

[21]  Arne Koopman,et al.  Intelligent Traffic Light Control , 2004 .

[22]  F. Webster.  TRAFFIC SIGNAL SETTINGS , 1958 .