Extremum-Seeking for Adaptation of Urban Traffic Signal Control

Abstract This paper investigates the application of an extremum-seeking scheme to fine-tune the parameters of a “local” urban traffic signal control strategy to improve its performance. A set of conditions that the local traffic controller has to satisfy for stability of the closed-loop system are introduced. Employing a self-organised traffic light scheme as the local controller, it is shown that this strategy satisfies the aforementioned conditions, and its optimality is dependent on the selection of a certain parameter. It is then demonstrated that, by employing an ES scheme, it is possible to always regulate this parameter close to its optimum given any traffic conditions.

[1]  R E Allsop,et al.  SIGCAP: A COMPUTER PROGRAM FOR ASSESSING THE TRAFFIC CAPACITY OF SIGNAL-CONTROLLED ROAD JUNCTIONS , 1976 .

[2]  Bart De Schutter,et al.  Efficient network-wide model-based predictive control for urban traffic networks , 2012 .

[3]  Chan Gook Park,et al.  Peak-Seeking Control for Drag Reduction in Formation Flight , 2006 .

[4]  Dirk Helbing,et al.  Self-control of traffic lights and vehicle flows in urban road networks , 2008, 0802.0403.

[5]  Terutoshi Kaku,et al.  DEVELOPMENT OF A SELF-ORGANIZING TRAFFIC CONTROL SYSTEM USING NEURAL NETWORK MODELS , 1991 .

[6]  Markos Papageorgiou,et al.  A Multivariable Regulator Approach to Traffic-Responsive Network-Wide Signal Control , 2000 .

[7]  Dragan Nesic,et al.  A unified framework for input-to-state stability in systems with two time scales , 2003, IEEE Trans. Autom. Control..

[8]  Miroslav Krstic,et al.  Stability of extremum seeking feedback for general nonlinear dynamic systems , 2000, Autom..

[9]  I Alvarez,et al.  Game theory applied to urban traffic control problem , 2010, ICCAS 2010.

[10]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[11]  D I Robertson,et al.  "TRANSYT" METHOD FOR AREA TRAFFIC CONTROL , 1969 .

[12]  Chris Manzie,et al.  Non-local stability of a Nash equilibrium seeking scheme with dither re-use , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[13]  Ying Tan,et al.  On non-local stability properties of extremum seeking control , 2006, Autom..

[14]  Carlos Gershenson,et al.  Self-organizing Traffic Lights , 2004, Complex Syst..

[15]  Lele Zhang,et al.  A comparative study of Macroscopic Fundamental Diagrams of arterial road networks governed by adaptive traffic signal systems , 2011, 1112.3761.

[16]  Jan de Gier,et al.  Traffic flow on realistic road networks with adaptive traffic lights , 2010, 1011.6211.

[17]  M. Krstic,et al.  Auto-tuning of PID controllers via extremum seeking , 2005, Proceedings of the 2005, American Control Conference, 2005..

[18]  Chris Manzie,et al.  Semi-Global Stability Analysis of Observer-Based Extremum-Seeking for Hammerstein Plants , 2012, IEEE Transactions on Automatic Control.

[19]  Miroslav Krstic,et al.  An adaptive algorithm for control of combustion instability , 2004, Autom..

[20]  S. Chand,et al.  Self-organizing traffic control via fuzzy logic , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[21]  Chris Manzie,et al.  Newton-Like Extremum-Seeking for the Control of Thermoacoustic Instability , 2010, IEEE Transactions on Automatic Control.

[22]  Nathan H. Gartner,et al.  A multi-band approach to arterial traffic signal optimization , 1991 .

[23]  M. Papageorgiou,et al.  OPTIMAL SIGNAL CONTROL OF URBAN TRAFFIC NETWORKS , 1992 .

[24]  Miroslav Krstic,et al.  Stochastic averaging in continuous time and its applications to extremum seeking , 2010, Proceedings of the 2010 American Control Conference.

[25]  P R Lowrie,et al.  The Sydney coordinated adaptive traffic system - principles, methodology, algorithms , 1982 .

[26]  István Varga,et al.  Distributed traffic control system based on model predictive control , 2010 .

[27]  B. Srinivasan,et al.  Real‐time optimization of dynamic systems using multiple units , 2007 .

[28]  Carlos Gershenson,et al.  Self-organizing traffic lights at multiple-street intersections , 2011, Complex..