Variable Speed Limit and Ramp Metering for Mixed Traffic Flows: A Review and Open Questions

The trend of increasing traffic demand is causing congestion on existing urban roads, including urban motorways, resulting in a decrease in Level of Service (LoS) and safety, and an increase in fuel consumption. Lack of space and non-compliance with cities’ sustainable urban plans prevent the expansion of new transport infrastructure in some urban areas. To alleviate the aforementioned problems, appropriate solutions come from the domain of Intelligent Transportation Systems by implementing traffic control services. Those services include Variable Speed Limit (VSL) and Ramp Metering (RM) for urban motorways. VSL reduces the speed of incoming vehicles to a bottleneck area, and RM limits the inflow through on-ramps. In addition, with the increasing development of Autonomous Vehicles (AVs) and Connected AVs (CAVs), new opportunities for traffic control are emerging. VSL and RM can reduce traffic congestion on urban motorways, especially so in the case of mixed traffic flows where AVs and CAVs can fully comply with the control system output. Currently, there is no existing overview of control algorithms and applications for VSL and RM in mixed traffic flows. Therefore, we present a comprehensive survey of VSL and RM control algorithms including the most recent reinforcement learning-based approaches. Best practices for mixed traffic flow control are summarized and new viewpoints and future research directions are presented, including an overview of the currently open research questions.

[1]  Antonella Ferrara,et al.  Nonlinear optimization for freeway control using variable-speed signaling , 1999 .

[2]  S. A. Smulders,et al.  Variable speed control: state-of-the-art and synthesis , 1998 .

[3]  Xuemin Shen,et al.  Connected Vehicles: Solutions and Challenges , 2014, IEEE Internet of Things Journal.

[4]  Andreas A. Malikopoulos,et al.  Optimal Control for Speed Harmonization of Automated Vehicles , 2016, IEEE Transactions on Intelligent Transportation Systems.

[5]  Alexandra Kondyli,et al.  Evaluation of Ramp Metering Impacts on Travel Time Reliability and Traffic Operations through Simulation , 2019 .

[6]  Markos Papageorgiou,et al.  Traffic-Responsive Linked Ramp-Metering Control , 2008, IEEE Transactions on Intelligent Transportation Systems.

[7]  Danya Yao,et al.  Integrated Variable Speed Limits and Lane-Changing Control for Freeway Lane-Drop Bottlenecks , 2020, IEEE Access.

[8]  Andreas Hegyi,et al.  Distributed Controller Design Approach to Dynamic Speed Limit Control against Shockwaves on Freeways , 2008 .

[9]  Markos Papageorgiou,et al.  Integrated Ramp Metering and Variable Speed Limit Control of Motorway Traffic Flow , 2008 .

[10]  Alexandre M. Bayen,et al.  Expert Level Control of Ramp Metering Based on Multi-Task Deep Reinforcement Learning , 2017, IEEE Transactions on Intelligent Transportation Systems.

[11]  Peter Wagner,et al.  Impacts of gradual automated vehicle penetration on motorway operation: a comprehensive evaluation , 2019 .

[12]  Babak Mirbaha,et al.  Comparing Methods of Ramp Metering for On-Ramps to Improve the Operational Conditions at Peak Hours , 2018 .

[13]  Germà Bel,et al.  Effects of the 80 km/h and variable speed limits on air pollution in the metropolitan area of barcelona , 2013 .

[14]  A. Hegyi,et al.  Shock wave elimination/reduction by optimal coordination of variable speed limits , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[15]  Bernhard Friedrich,et al.  The Effect of Autonomous Vehicles on Traffic , 2016 .

[16]  Dan C. Marinescu,et al.  On-ramp traffic merging using cooperative intelligent vehicles: A slot-based approach , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[17]  Lanhang Ye,et al.  Evaluating the impact of connected and autonomous vehicles on traffic safety , 2019, Physica A: Statistical Mechanics and its Applications.

[18]  Martin Gregurić,et al.  The use of cooperative approach in ramp metering , 2016 .

[19]  Alireza Talebpour,et al.  Influence of connected and autonomous vehicles on traffic flow stability and throughput , 2016 .

[20]  Ching-Yao Chan,et al.  Formulation of deep reinforcement learning architecture toward autonomous driving for on-ramp merge , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[21]  Jingqiu Guo,et al.  Characteristic analysis of mixed traffic flow of regular and autonomous vehicles using cellular automata , 2017 .

[22]  H. Zackor.  Speed Limitation on Freeways: Traffic-Responsive Strategies , 1991 .

[23]  Ridha Hamila,et al.  Literature Review of Advancements in Adaptive Ramp Metering , 2016, ANT/SEIT.

[24]  Lily Elefteriadou,et al.  The Highway Capacity Manual 6th Edition: A Guide for Multimodal Mobility Analysis , 2016 .

[25]  Mohsen Ramezani,et al.  Lane density optimisation of automated vehicles for highway congestion control , 2019, Transportmetrica B: Transport Dynamics.

[26]  Prashant Doshi,et al.  Freeway Merging in Congested Traffic based on Multipolicy Decision Making with Passive Actor Critic , 2017, ArXiv.

[27]  Matthijs T. J. Spaan,et al.  Traffic flow optimization: A reinforcement learning approach , 2016, Eng. Appl. Artif. Intell..

[28]  Chaoyang Wu,et al.  Review of Ramp Metering Methodologies for Urban Expressway , 2019 .

[29]  Chang Liu,et al.  Path planning for autonomous vehicles using model predictive control , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[30]  Wei Wang,et al.  Evolutionary V2X Technologies Toward the Internet of Vehicles: Challenges and Opportunities , 2020, Proceedings of the IEEE.

[31]  Prakash Ranjitkar,et al.  A fuzzy logic‐based variable speed limit controller , 2015 .

[32]  Michael W. Levin,et al.  Effects of Variable Speed Limit on Energy Consumption with Autonomous Vehicles on Urban Roads Using Modified Cell-Transmission Model , 2020 .

[33]  Chris Lee,et al.  Evaluation of Variable Speed Limits to Improve Traffic Safety , 2006 .

[34]  Ye Li,et al.  Evaluating the safety impact of adaptive cruise control in traffic oscillations on freeways. , 2017, Accident; analysis and prevention.

[35]  Péter Gáspár,et al.  Control strategy of the ramp metering in the mixed traffic flow , 2019 .

[36]  Andreas Hegyi,et al.  SPECIALIST: A dynamic speed limit control algorithm based on shock wave theory , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[37]  Walid Gomaa,et al.  Freeway ramp-metering control based on Reinforcement learning , 2014, 11th IEEE International Conference on Control & Automation (ICCA).

[38]  Baher Abdulhai,et al.  Application of reinforcement learning with continuous state space to ramp metering in real-world conditions , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[39]  Miao Yu,et al.  Optimal Variable Speed Limit Control in Connected Autonomous Vehicle Environment for Relieving Freeway Congestion , 2019, Journal of Transportation Engineering, Part A: Systems.

[40]  Nathan H. Gartner,et al.  Collaborative merging strategy for freeway ramp operations in a connected and autonomous vehicles environment , 2017, J. Intell. Transp. Syst..

[41]  M. Papageorgiou,et al.  Effects of Variable Speed Limits on Motorway Traffic Flow , 2008 .

[42]  Leslie L Robison,et al.  Trends in leukemia incidence and survival in the United States (1973–1998) , 2003, Cancer.

[43]  Xiaobo Qu,et al.  On the Impact of Cooperative Autonomous Vehicles in Improving Freeway Merging: A Modified Intelligent Driver Model-Based Approach , 2017, IEEE Transactions on Intelligent Transportation Systems.

[44]  Guoyuan Wu,et al.  Distributed Consensus-Based Cooperative Highway On-Ramp Merging Using V2X Communications , 2018 .

[45]  Bin Ran,et al.  Differential variable speed limits control for freeway recurrent bottlenecks via deep actor-critic algorithm , 2020 .

[46]  Markos Papageorgiou,et al.  Toll Plaza Merging Traffic Control for Throughput Maximization , 2010 .

[47]  Markos Papageorgiou,et al.  Freeway ramp metering: an overview , 2002, IEEE Trans. Intell. Transp. Syst..

[48]  Lina Kattan,et al.  Variable speed limit: an overview , 2015 .

[49]  Robert Ziolkowski,et al.  Effectiveness of Automatic Section Speed Control System Operating on National Roads in Poland , 2019, PROMET - Traffic&Transportation.

[50]  Jia Hu,et al.  Parsimonious shooting heuristic for trajectory design of connected automated traffic part II: Computational issues and optimization , 2017 .

[51]  Lina Kattan,et al.  Variable speed limit: A microscopic analysis in a connected vehicle environment , 2015 .

[52]  Ashish Bhaskar,et al.  Optimal Vehicle Trajectory Planning With Control Constraints and Recursive Implementation for Automated On-Ramp Merging , 2019, IEEE Transactions on Intelligent Transportation Systems.

[53]  Simona Sacone,et al.  Ramp metering control for two vehicle classes to reduce traffic emissions in freeway systems , 2014, 2014 European Control Conference (ECC).

[54]  Walid Gomaa,et al.  Multi-Agent Reinforcement Learning Control for Ramp Metering , 2014, ICSEng.

[55]  Alexandre M. Bayen,et al.  Lagrangian Control through Deep-RL: Applications to Bottleneck Decongestion , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[56]  Martin Gregurić,et al.  Ramp Metering on Urban Motorways , 2018 .

[57]  Stef Smulders,et al.  Control of freeway traffic flow by variable speed signs , 1990 .

[58]  Yuchuan Du,et al.  Advanced Self-Improving Ramp Metering Algorithm based on Multi-Agent Deep Reinforcement Learning , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[59]  Francesc Soriguera,et al.  Assessment of Dynamic Speed Limit Management on Metropolitan Freeways , 2013, J. Intell. Transp. Syst..

[60]  P. Rämä.  Effects of Weather-Controlled Variable Speed Limits and Warning Signs on Driver Behavior , 1999 .

[61]  Markos Papageorgiou,et al.  Heuristic Ramp-Metering Coordination Strategy Implemented at Monash Freeway, Australia , 2010 .

[62]  Xiaoliang Ma,et al.  Analysis of a cooperative variable speed limit system using microscopic traffic simulation , 2015 .

[63]  Byoung-Yong Ryu,et al.  An evaluation of the ramp metering effectiveness in reducing carbon dioxide emissions , 2012, Simul..

[64]  Liu Yan,et al.  Methodology for Variable Speed Limit Activation in Active Traffic Management , 2013 .

[65]  Martin Gregurić,et al.  An Overview of Reinforcement Learning Methods for Variable Speed Limit Control , 2020, Applied Sciences.

[66]  Prashant Doshi,et al.  Merging in Congested Freeway Traffic Using Multipolicy Decision Making and Passive Actor-Critic Learning , 2019, IEEE Transactions on Intelligent Vehicles.

[67]  Mohamed Abdel-Aty,et al.  Evaluation of variable speed limits for real-time freeway safety improvement. , 2006, Accident; analysis and prevention.

[68]  Shaofang Wen,et al.  Reinforcement Learning On-Ramp Metering with or without Complete Information , 2010 .

[69]  Markos Papageorgiou,et al.  Feedback-Based Mainstream Traffic Flow Control for Multiple Bottlenecks on Motorways , 2015, IEEE Transactions on Intelligent Transportation Systems.

[70]  Stijn Daniels,et al.  Safety effects of dynamic speed limits on motorways. , 2018, Accident; analysis and prevention.

[71]  Per Strömgren,et al.  Harmonization with Variable Speed Limits on Motorways , 2016 .

[72]  Jian Sun,et al.  Trajectory optimization of connected and autonomous vehicles at a multilane freeway merging area , 2019, Transportation Research Part C: Emerging Technologies.

[73]  Baher Abdulhai,et al.  Traffic capacity implications of automated vehicles mixed with regular vehicles , 2018, J. Intell. Transp. Syst..

[74]  Hwasoo Yeo,et al.  Estimation of Capacity Drop in Highway Merging Sections , 2012 .

[75]  Panos G Michalopoulos,et al.  Minnesota's New Ramp Control Strategy: Design Overview and Preliminary Assessment , 2004 .

[76]  Martin Gregurić,et al.  Variable Speed Limit Control Based on Deep Reinforcement Learning: A Possible Implementation , 2020, 2020 International Symposium ELMAR.

[77]  Werner Kraus,et al.  Cooperative Mainstream Traffic Flow Control on Freeways , 2016 .

[78]  Markos Papageorgiou,et al.  Local Feedback-Based Mainstream Traffic Flow Control on Motorways Using Variable Speed Limits , 2011, IEEE Transactions on Intelligent Transportation Systems.

[79]  Satish V. Ukkusuri,et al.  Accounting for dynamic speed limit control in a stochastic traffic environment: a reinforcement learning approach , 2014 .

[80]  Markos Papageorgiou,et al.  Optimal Motorway Traffic Flow Control Involving Variable Speed Limits and Ramp Metering , 2010, Transp. Sci..

[81]  Albania Nissan,et al.  Evaluation of the Impact of Advisory Variable Speed Limits on Motorway Capacity and Level of Service , 2011 .

[82]  Wei Wang,et al.  Reinforcement Learning-Based Variable Speed Limit Control Strategy to Reduce Traffic Congestion at Freeway Recurrent Bottlenecks , 2017, IEEE Transactions on Intelligent Transportation Systems.

[83]  Zhang Jue.  Review of Freeway On-ramp Metering Methodologies , 2005 .

[84]  Bart De Schutter,et al.  Optimal coordination of variable speed limits to suppress shock waves , 2005, IEEE Transactions on Intelligent Transportation Systems.

[85]  Markos Papageorgiou,et al.  Modelling and real-time control of traffic flow on the southern part of Boulevard Peripherique in Paris: Part II: Coordinated on-ramp metering , 1990 .

[86]  Xian-Sheng Hua,et al.  City brain: practice of large-scale artificial intelligence in the real world , 2019 .

[87]  Andreas A. Malikopoulos,et al.  Automated and Cooperative Vehicle Merging at Highway On-Ramps , 2017, IEEE Transactions on Intelligent Transportation Systems.

[88]  A. Soret,et al.  Air pollution impacts of speed limitation measures in large cities: The need for improving traffic data in a metropolitan area , 2010 .

[89]  Steven E Shladover,et al.  Review of Variable Speed Limits and Advisories , 2014 .

[90]  John M. Dolan,et al.  Intention estimation for ramp merging control in autonomous driving , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[91]  Zhexian Li,et al.  Model-based Predictive Variable Speed Limit Control on Multi-lane Freeways with A Line of Connected Automated Vehicles , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[92]  Peter Wagner,et al.  A Novel Approach for Mixed Manual/Connected Automated Freeway Traffic Management , 2020, Sensors.