Solving the multi-traffic signal-control problem for a class of continuous-time markov games

The traffic signal control setting is the most important factor that impacts the road network efficiency. The problem consists on generate appropriate signal patterns by controlling the timing of the green/red light cycles at an intersection with the goal of optimally reduce congestion and the amount of time wasted stuck in traffic. This is a very complicated problem. This paper deals with the solution of the multi-traffic signal control problem for continuos-time Markov games under the expected average cost criterion. We consider three intersecting unidirectional roads that imply three possible traffic phases which alternate. This game describes a Poisson process where the cars leave the queue in the order they arrive. The optimization approach is applied to constant arrival flows λ and departure flows μ over short time periods (Δt) involved in our processes. A conflict appears when each signal controller tries to minimize its queue. The c??variable method is extended with a special restriction for continuous-time Markov chains to obtain the set of average optimal policies. The usefulness of the method is demonstrated empirically by an application example.

[1]  Alexander S. Poznyak,et al.  Self-Learning Control of Finite Markov Chains , 2000 .

[2]  Wann-Ming Wey,et al.  Model formulation and solution algorithm of traffic signal control in an urban network , 2000 .

[3]  Song Yifan,et al.  A reserve capacity model of optimal signal control with user-equilibrium route choice , 2002 .

[4]  Kensuke Tanaka,et al.  On ε-equilibrium point in a noncooperative n-person game , 1991 .

[5]  K. Tanaka,et al.  The closest solution to the shadow minimum of a cooperative dynamic game , 1989 .

[6]  Robert Shorten,et al.  Traffic modelling framework for electric vehicles , 2012, Int. J. Control.

[7]  Monireh Abdoos,et al.  Holonic multi-agent system for traffic signals control , 2013, Eng. Appl. Artif. Intell..

[8]  Benjamin Heydecker.  A decomposition approach for signal optimisation in road networks , 1996 .

[9]  Suh-Wen Chiou,et al.  Optimization of Area Traffic Control for Equilibrium Network Flows , 1999, Transp. Sci..

[10]  Warren B. Powell,et al.  Optimal Signal Settings Over Transportation Networks , 1983 .

[11]  Yangzhou Chen,et al.  Traffic light control method for a single intersection based on hybrid systems , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[12]  Suh-Wen Chiou,et al.  Reserve capacity of signal-controlled road network , 2007, Appl. Math. Comput..

[13]  Hai Yang,et al.  Traffic assignment and signal control in saturated road networks , 1995 .

[14]  Mahmood Fathy,et al.  Real-time image processing approach to measure traffic queue parameters , 1995 .

[15]  I Alvarez,et al.  Game theory applied to urban traffic control problem , 2010, ICCAS 2010.

[16]  Bart De Schutter,et al.  Optimal Traffic Light Control for a Single Intersection , 1999, Eur. J. Control.

[17]  Alexander S. Poznyak,et al.  Extraproximal Method Application for a Stackelberg–Nash Equilibrium Calculation in Static Hierarchical Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Mariano Gallo,et al.  Models and algorithms for the optimization of signal settings on urban networks with stochastic assignment models , 2006, Ann. Oper. Res..

[19]  Alexander S. Poznyak,et al.  Modeling the multi-traffic signal-control synchronization: A Markov chains game theory approach , 2015, Eng. Appl. Artif. Intell..

[20]  Umit Ozguner,et al.  Combined decentralized multi-destination dynamic routing and real-time traffic light control for congested traffic networks , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[21]  Charles Desjardins,et al.  Urban Traffic Control Based on Learning Agents , 2007, 2007 IEEE Intelligent Transportation Systems Conference.