Infinitesimal Perturbation Analysis for Quasi-Dynamic Traffic Light Controllers

Abstract We consider the traffic light control problem for a single intersection modeled as a stochastic hybrid system. We study a quasi-dynamic policy based on partial state information defined by detecting whether vehicle backlogs are above or below certain controllable thresholds. Using Infinitesimal Perturbation Analysis (IPA), we derive online gradient estimators of a cost metric with respect to these threshold parameters and use these estimators to iteratively adjust the threshold values through a standard gradient-based algorithm so as to improve overall system performance under various traffic conditions. Results obtained by applying this methodology to a simulated urban setting are also included.

[1]  Christos G. Cassandras,et al.  Quasi-dynamic traffic light control for a single intersection , 2013, 52nd IEEE Conference on Decision and Control.

[2]  Christos G. Cassandras,et al.  Perturbation analysis of stochastic hybrid systems and applications to resource contention games , 2011 .

[3]  Sung-Joo Lee,et al.  A Traffic Light Controlling FLC Considering the Traffic Congestion , 2002, AFSS.

[4]  Michael C. Fu,et al.  ONLINE TRAFFIC LIGHT CONTROL THROUGH GRADIENT ESTIMATION USING STOCHASTIC FLUID MODELS , 2005 .

[5]  Yorai Wardi,et al.  A Unified Approach to Infinitesimal Perturbation Analysis in Stochastic Flow Models: The Single-Stage Case , 2010, IEEE Transactions on Automatic Control.

[6]  Christos G. Cassandras,et al.  Traffic light control using Infinitesimal Perturbation Analysis , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[7]  Christos G. Cassandras,et al.  Introduction to Discrete Event Systems , 1999, The Kluwer International Series on Discrete Event Dynamic Systems.

[8]  C. Cassandras,et al.  Stochastic hybrid systems , 2006 .

[9]  Christos G. Cassandras,et al.  Perturbation analysis for online control and optimization of stochastic fluid models , 2002, IEEE Trans. Autom. Control..

[10]  I Alvarez,et al.  Game theory applied to urban traffic control problem , 2010, ICCAS 2010.

[11]  B. De Schutter.  Optimal traffic light control for a single intersection , 1999 .

[12]  Wilfred W. Recker,et al.  Stochastic adaptive control model for traffic signal systems , 2006 .

[13]  Christos G. Cassandras,et al.  Multi-intersection Traffic Light Control with blocking , 2015, Discret. Event Dyn. Syst..

[14]  Yangzhou Chen,et al.  Traffic light control method for a single intersection based on hybrid systems , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[15]  Michael C. Fu,et al.  Application of perturbation analysis to traffic light signal timing , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[16]  Daniel Vanderpooten,et al.  Multiobjective and multimodal adaptive traffic light control on single junctions , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[17]  Stéphane Lafortune,et al.  A decentralized scheme for real-time optimization of traffic signals , 1996, Proceeding of the 1996 IEEE International Conference on Control Applications IEEE International Conference on Control Applications held together with IEEE International Symposium on Intelligent Contro.

[18]  Christos G. Cassandras,et al.  Perturbation Analysis and Optimization of Stochastic Hybrid Systems , 2010, Eur. J. Control.