Data driven model free adaptive iterative learning perimeter control for large-scale urban road networks

Abstract Most perimeter control methods in literature are the model-based schemes designing the controller based on the available accurate macroscopic fundamental diagram (MFD) function with well known techniques of modern control methods. However, accurate modeling of the traffic flow system is hard and time-consuming. On the other hand, macroscopic traffic flow patterns show heavily similarity between days, and data from past days might enable improving the performance of the perimeter controller. Motivated by this observation, a model free adaptive iterative learning perimeter control (MFAILPC) scheme is proposed in this paper. The three features of this method are: (1) No dynamical model is required in the controller design by virtue of dynamic linearization data modeling technique, i.e., it is a data-driven method, (2) the perimeter controller performance will improve iteratively with the help of the repetitive operation pattern of the traffic system, (3) the learning gain is tuned adaptively along the iterative axis. The effectiveness of the proposed scheme is tested comparing with various control methods for a multi-region traffic network considering modeling errors, measurement noise, demand variations, and time-changing MFDs. Simulation results show that the proposed MFAILPC presents a great potential and is more resilient against errors than the standard perimeter control methods such as model predictive control, proportional-integral control, etc.

[1]  Abdelhamid Tayebi.  Adaptive iterative learning control for robot manipulators , 2004, Autom..

[2]  Meead Saberi,et al.  H∞ robust perimeter flow control in urban networks with partial information feedback , 2020 .

[3]  Pravin Varaiya,et al.  Max pressure control of a network of signalized intersections , 2013 .

[4]  Di Wu,et al.  Online Monitoring and Model-Free Adaptive Control of Weld Penetration in VPPAW Based on Extreme Learning Machine , 2019, IEEE Transactions on Industrial Informatics.

[5]  Zhongsheng Hou,et al.  Model Free Adaptive Control: Theory and Applications , 2013 .

[6]  Nikolaos Geroliminis,et al.  Properties of a well-defined Macroscopic Fundamental Diagram for urban traffic , 2011 .

[7]  Hwasoo Yeo,et al.  Investigating Transfer Flow between Urban Networks Based on a Macroscopic Fundamental Diagram , 2018, Transportation Research Record: Journal of the Transportation Research Board.

[8]  Jack Haddad,et al.  Robust perimeter control design for an urban region , 2014 .

[9]  M. Bierlaire,et al.  Discrete Choice Methods and their Applications to Short Term Travel Decisions , 1999 .

[10]  Nikolaos Geroliminis,et al.  Enhancing model-based feedback perimeter control with data-driven online adaptive optimization , 2017 .

[11]  Meead Saberi,et al.  Urban Network Gridlock: Theory, Characteristics, and Dynamics , 2013 .

[12]  Nikolaos Geroliminis,et al.  On the stability of traffic perimeter control in two-region urban cities , 2012 .

[13]  Jack Haddad.  Optimal coupled and decoupled perimeter control in one-region cities , 2017 .

[14]  Ting Lei,et al.  Data-Driven Model Free Adaptive Perimeter Control for Multi-Region Urban Traffic Networks With Route Choice , 2020, IEEE Transactions on Intelligent Transportation Systems.

[15]  Carlos Canudas-de-Wit,et al.  Aggregation and travel time calculation over large scale traffic networks: An empiric study on the Grenoble City , 2018, Transportation Research Part C: Emerging Technologies.

[16]  Markos Papageorgiou,et al.  Exploiting the fundamental diagram of urban networks for feedback-based gating , 2012 .

[17]  N. Geroliminis,et al.  Existence of urban-scale macroscopic fundamental diagrams: Some experimental findings - eScholarship , 2007 .

[18]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[19]  Carlos F. Daganzo,et al.  Urban Gridlock: Macroscopic Modeling and Mitigation Approaches , 2007 .

[20]  Nikolas Geroliminis,et al.  Macroscopic modelling and robust control of bi-modal multi-region urban road networks , 2017 .

[21]  Z. Hou,et al.  Dual-stage Optimal Iterative Learning Control for Nonlinear Non-affine Discrete-time Systems , 2007 .

[22]  Dong Liu,et al.  Data-Driven Adaptive Sliding Mode Control of Nonlinear Discrete-Time Systems With Prescribed Performance , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[23]  Jack Haddad.  Optimal perimeter control synthesis for two urban regions with aggregate boundary queue dynamics , 2017 .

[24]  Zhongsheng Hou,et al.  Repeatability and Similarity of Freeway Traffic Flow and Long-Term Prediction Under Big Data , 2016, IEEE Transactions on Intelligent Transportation Systems.

[25]  Yugeng Xi,et al.  NONLINEAR MULTI-MODEL PREDICTIVE CONTROL , 1996 .

[26]  Nikolaos Geroliminis,et al.  Clustering of Heterogeneous Networks with Directional Flows Based on “Snake” Similarities , 2016 .

[27]  Jack Haddad,et al.  Coordinated distributed adaptive perimeter control for large-scale urban road networks , 2017 .

[28]  E. Rogers,et al.  Iterative learning control for discrete-time systems with exponential rate of convergence , 1996 .

[29]  Kumpati S. Narendra,et al.  Identification and control of a nonlinear discrete-time system based on its linearization: a unified framework , 2004, IEEE Transactions on Neural Networks.

[30]  Jian-Xin Xu,et al.  A survey on iterative learning control for nonlinear systems , 2011, Int. J. Control.

[31]  Nikolaos Geroliminis,et al.  Dynamic clustering and propagation of congestion in heterogeneously congested urban traffic networks , 2017 .

[32]  Hwasoo Yeo,et al.  Agent-based network transmission model using the properties of macroscopic fundamental diagram , 2018, Transportation Research Part C: Emerging Technologies.

[33]  Gang Hu,et al.  Hierarchical perimeter control with guaranteed stability for dynamically coupled heterogeneous urban traffic , 2017 .

[34]  Stelios Timotheou,et al.  Controlling road congestion via a low-complexity route reservation approach , 2017 .

[35]  Xuhui Bu,et al.  Model Free Adaptive Iterative Learning Consensus Tracking Control for a Class of Nonlinear Multiagent Systems , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[36]  Zhongsheng Hou,et al.  On Model-Free Adaptive Control and Its Stability Analysis , 2019, IEEE Transactions on Automatic Control.

[37]  Markos Papageorgiou,et al.  A multivariable regulator approach to traffic-responsive network-wide signal control , 2000 .

[38]  Bart De Schutter,et al.  Two-Level Hierarchical Model-Based Predictive Control for Large-Scale Urban Traffic Networks , 2017, IEEE Transactions on Control Systems Technology.

[39]  Markos Papageorgiou,et al.  Controller Design for Gating Traffic Control in Presence of Time-delay in Urban Road Networks , 2015 .

[40]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[41]  Nikolaos Geroliminis,et al.  Perimeter and boundary flow control in multi-reservoir heterogeneous networks , 2013 .

[42]  Hamed Kebriaei,et al.  Analytical Optimal Solution of Perimeter Traffic Flow Control Based on MFD Dynamics: A Pontryagin’s Maximum Principle Approach , 2019, IEEE Transactions on Intelligent Transportation Systems.

[43]  Agachai Sumalee,et al.  Robust perimeter control for two urban regions with macroscopic fundamental diagrams: A control-Lyapunov function approach , 2018, Transportation Research Part B: Methodological.

[44]  Weihua Zhang,et al.  Hybrid Perimeter Control for Two-region Urban Cities With Different States , 2018, IEEE Transactions on Control Systems Technology.

[45]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[46]  Nikolas Geroliminis,et al.  Economic Model Predictive Control of Large-Scale Urban Road Networks via Perimeter Control and Regional Route Guidance , 2018, IEEE Transactions on Intelligent Transportation Systems.

[47]  Vikash V. Gayah,et al.  An analytical framework to model uncertainty in urban network dynamics using Macroscopic Fundamental Diagrams , 2018, Transportation Research Part B: Methodological.

[48]  Shangtai Jin,et al.  A unified data-driven design framework of optimality-based generalized iterative learning control , 2015, Comput. Chem. Eng..

[49]  R. D. Bretherton,et al.  Optimizing networks of traffic signals in real time-the SCOOT method , 1991 .

[50]  S. Saab.  Stochastic P-type/D-type iterative learning control algorithms , 2003 .

[51]  P R Lowrie,et al.  The Sydney coordinated adaptive traffic system - principles, methodology, algorithms , 1982 .

[52]  Nikolas Geroliminis,et al.  Dynamics of heterogeneity in urban networks: aggregated traffic modeling and hierarchical control , 2015 .

[53]  Jack Haddad,et al.  Adaptive perimeter traffic control of urban road networks based on MFD model with time delays , 2016 .

[54]  Huijun Gao,et al.  An Overview of Dynamic-Linearization-Based Data-Driven Control and Applications , 2017, IEEE Transactions on Industrial Electronics.

[55]  Agachai Sumalee,et al.  Boundary conditions and behavior of the macroscopic fundamental diagram based network traffic dynamics: A control systems perspective , 2018 .

[56]  Jingwen Yan,et al.  An iterative learning approach for density control of freeway traffic flow via ramp metering , 2008 .

[57]  Vikash V. Gayah,et al.  Clockwise Hysteresis Loops in the Macroscopic Fundamental Diagram , 2010 .

[58]  Nan Zheng,et al.  Heterogeneity aware urban traffic control in a connected vehicle environment: A joint framework for congestion pricing and perimeter control , 2019, Transportation Research Part C: Emerging Technologies.

[59]  Nikolaos Geroliminis,et al.  On the spatial partitioning of urban transportation networks , 2012 .

[60]  Xin Xu,et al.  A Complementary Modularized Ramp Metering Approach Based on Iterative Learning Control and ALINEA , 2011, IEEE Transactions on Intelligent Transportation Systems.

[61]  Nikolas Geroliminis,et al.  Multiple Concentric Gating Traffic Control in Large-Scale Urban Networks , 2015, IEEE Transactions on Intelligent Transportation Systems.

[62]  Nikolas Geroliminis,et al.  Optimal Perimeter Control for Two Urban Regions With Macroscopic Fundamental Diagrams: A Model Predictive Approach , 2013, IEEE Transactions on Intelligent Transportation Systems.

[63]  Zhuo Wang,et al.  From model-based control to data-driven control: Survey, classification and perspective , 2013, Inf. Sci..

[64]  Ludovic Leclercq,et al.  Spatiotemporal Partitioning of Transportation Network Using Travel Time Data , 2017 .