Multi-Agent Look-Ahead Traffic-Adaptive Control

The objective of this thesis is to create a distributed, multi-agent, approach to traffic control. This PhD thesis' focus is on the control of a network instrumented by traffic signals.A thorough literature study has been performed, reviewing the current state of the art in traffic signal control. On the basis of this literature survey, a taxonomy of existing systems was constructed. The design of a traffic-adaptive control system is as well a science as an art. Along the way compromises have to be made in order to end up with a workable system that is not only able to come up with good signal timings, but is also able to deliver them on time. The taxonomy constructed of the various traffic-adaptive control algorithms is based both on the underlying principles and on the compromises that were made to come up with a workable, albeit less optimal system. A new adaptive control algorithm is subsequently developed that incorporates the strong points of each of the algorithms reviewed. The algorithm determines a short term policy on the basis of a long-term analysis and considers the individual signal groups as the smallest controllable entity. Although state of the practice in vehicle-actuated control, look-ahead adaptive control still use stages as the smallest controllable entity, which reduced the flexibility of this approach. The developed algorithm is capable of controlling a single intersection, but can be configured for use in a network. When configured for use in a network the controller shares its intentions regarding its control plan with nearby intersection controllers and informs them of traffic that it plans to release. In order to enable cooperation controllers must be willing to adjust their locally optimal control plan for the benefit of the network. In order to achieve this controllers are informed about the cost inflicted by them to nearby controllers. Using this information, intersection controllers can iteratively adjust their plan to the benefit of the network. In order to evaluate the developed control algorithms a test bed was developed during the course of this thesis. The test bed was essential in the development and testing of the algorithm. The test bed was also used in a proof-of-concept study for the N470, whereas the performance of the algorithm was benchmarked for a corridor against freshly optimized traffic-actuated controllers.

[1]  Nathan H. Gartner,et al.  OPAC: A DEMAND-RESPONSIVE STRATEGY FOR TRAFFIC SIGNAL CONTROL , 1983 .

[2]  Ivar Jacobson,et al.  The unified modeling language reference manual , 2010 .

[3]  G. S. Y. Koelemeijer,et al.  ON THE BEHAVIOUR OF CLASSES OF MIN-MAX-PLUS SYSTEMS , 2003 .

[4]  M. Papageorgiou,et al.  OPTIMAL SIGNAL CONTROL OF URBAN TRAFFIC NETWORKS , 1992 .

[5]  Paolo Dell'Olmo,et al.  REALBAND : an approach for real-time coordination of traffic flows on networks , 1995 .

[6]  W. Bockstael-Blok Chains and Networks in Multimodal Passenger Transport: Exploring a design approach , 2001 .

[7]  Thomas Urbanik,et al.  Enhanced Genetic Algorithm for Signal-Timing Optimization of Oversaturated Intersections , 2000 .

[8]  J. J. Klijnhout,et al.  MOTORWAY CONTROL AND SIGNALLING , 1987 .

[9]  Benjamin Heydecker,et al.  Optimising the control performance of traffic signals at a single junction , 1988 .

[10]  Jacobus P. H. Wessels,et al.  The art and theory of dynamic programming , 1977 .

[11]  Markos Papageorgiou,et al.  Applications of the urban traffic control strategy TUC , 2006, Eur. J. Oper. Res..

[12]  G. Muilerman,et al.  Time-based logistics: An analysis of the relevance, causes and impacts , 2001 .

[13]  D. Ngoduy Macroscopic discontinuity modeling for multiclass multilane traffic flow operations , 2006 .

[14]  Markos Papageorgiou,et al.  An integrated control approach for traffic corridors , 1995 .

[15]  José Cuena,et al.  Knowledge-based models for adaptive traffic management systems , 1995 .

[16]  Leon W P Peeters,et al.  Cyclic Railway Timetable Optimization , 2003 .

[17]  Peter T Martin,et al.  Adaptive Signal Control II , 2003 .

[18]  Luís Botelho A control structure for agent interaction , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[19]  GROUP-BASED SAFETY CONSTRAINTS DESCRIPTION OF AN INTERSECTION , 2003 .

[20]  Arjen Zoeteman Railway design and maintenance from a life-cycle cost perspective : a decision-support approach , 2004 .

[21]  S R Sunkari,et al.  EVALUATION OF ADVANCE COORDINATION FEATURES IN TRAFFIC SIGNAL CONTROLLERS , 2004 .

[22]  Carlos F. Daganzo,et al.  Using Input-Output Diagram To Determine Spatial and Temporal Extents of a Queue Upstream of a Bottleneck , 1997 .

[23]  Cornelia Jacoba Geertje van Driel,et al.  Driver support in congestion : an assessment of user needs and impacts on driver and traffic flow , 2007 .

[24]  Jean-Loup Farges,et al.  Decentralization vs Hierarchy in Optimal Traffic Control , 1987 .

[25]  F. C. Van Westrenen The maritime pilot at work: Evaluation and use of a time-to-boundary model of mental workload in human-machine systems , 1999 .

[26]  Ronald van Katwijk,et al.  COORDINATION OF TRAFFIC MANAGEMENT INSTRUMENTS USING AGENT TECHNOLOGY , 2002 .

[27]  Makoto Yokoo,et al.  Distributed Constraint Satisfaction: Foundations of Cooperation in Multi-agent Systems , 2000 .

[28]  W. A. M. Weijermars Analysis of Urban Traffic Patterns Using Clustering , 2007 .

[29]  Wijnand Veeneman,et al.  Mind The Gap: Bridging theories and practice for the organisation of metropolitan public transport , 2002 .

[30]  F. Webster TRAFFIC SIGNAL SETTINGS , 1958 .

[31]  Alan J. Miller,et al.  A COMPUTER CONTROL SYSTEM FOR TRAFFIC NETWORKS. , 1963 .

[32]  Chris M.J. Tampère,et al.  Human-kinetic multiclass traffic flow theory and modelling. With application to Advanced Driver Assistance Systems in congestion , 2004 .

[33]  H. Runhaar,et al.  Freight transport: At any price? Effects of transport costs on book and newspaper supply chains in the Netherlands , 2002 .

[34]  Pitu B. Mirchandani,et al.  A REAL-TIME TRAFFIC SIGNAL CONTROL SYSTEM: ARCHITECTURE, ALGORITHMS, AND ANALYSIS , 2001 .

[35]  B. Krause,et al.  A COMPLETE FUZZY LOGIC CONTROL APPROACH FOR EXISTING TRAFFIC CONTROL SYSTEMS , 1997 .

[36]  Sandy Irani,et al.  Scheduling with conflicts, and applications to traffic signal control , 1996, SODA '96.

[37]  Liu Xiaoming,et al.  Study of intersection traffic flow control on the basis of agents , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[38]  Philip J Tarnoff,et al.  DEVELOPMENT OF ADVANCED TRAFFIC SIGNAL CONTROL STRATEGIES FOR INTELLIGENT TRANSPORTATION SYSTEMS: MULTILEVEL DESIGN , 1995 .

[39]  H. Geerlings,et al.  Innovation and Regulatory Reform in Public Transport , 2002 .

[40]  Jean-Loup Farges,et al.  PRODYN: on site evaluation , 1990 .

[41]  Steven G Shelby Single-Intersection Evaluation of Real-Time Adaptive Traffic Signal Control Algorithms , 2004 .

[42]  D J Quinn A REVIEW OF QUEUE MANAGEMENT STRATEGIES , 1992 .

[43]  S. Chandana Wirasinghe,et al.  DETERMINATION OF TRAFFIC DELAYS FROM SHOCK-WAVE ANALYSIS , 1978 .

[44]  Stéphane Lafortune,et al.  A decentralized scheme for real-time optimization of traffic signals , 1996, Proceeding of the 1996 IEEE International Conference on Control Applications IEEE International Conference on Control Applications held together with IEEE International Symposium on Intelligent Contro.

[45]  Dusica Joksimovic,et al.  Dynamic bi-level optimal toll design approach for dynamic traffic networks , 2002 .

[46]  Maria Johanna Wilhelmina Antoinette Vanderschuren,et al.  Intelligent transport systems for South Africa : impact assessment through microscopic simulation in the South African context , 2006 .

[47]  K.A.P.C. Van Wees Intelligente voertuigen, veiligheidsregulering en aansprakelijkheid: Een onderzoek naar juridische aspecten van Advanced Driver Assistance Systems in het wegverkeer , 2004 .

[48]  Ivar Jacobson,et al.  The Unified Modeling Language User Guide , 1998, J. Database Manag..

[49]  Marcel Westerman PILOT REISTIJD DRIP A13 : VALIDATIE EN TUNING VAN DE REISTIJDSCHATTER [DYNAMIC ROUTE INFORMATION PANEL (DRIP) PROJECT] , 1997 .

[50]  Francesco Viti,et al.  The dynamics and the uncertainty of delays at signals , 2006 .

[51]  Fritz Busch,et al.  MOTION for SITRAFFIC - a modern approach to urban traffic control , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[52]  A.A.J. Nederveen Ruimtelijke inpassing van lijninfrastructuur: Een onderzoek naar de geschiktheid van inspraakreacties voor het beoordelen van lijninfrastructuurontwerpen , 2007 .

[53]  Subiono On classes of min-max-plus systems and their applications , 2000 .

[54]  Giulio Erberto Cantarella,et al.  CAPACITY FACTOR OR CYCLE TIME OPTIMIZATION FOR SIGNALIZED JUNCTIONS: A GRAPH THEORY APPROACH , 1988 .

[55]  Francois Dion,et al.  A rule-based real-time traffic responsive signal control system with transit priority: application to an isolated intersection , 2002 .

[56]  Markos Papageorgiou,et al.  Efficiency and equity properties of freeway network-wide ramp metering with AMOC , 2004 .

[57]  Theo H J Muller,et al.  New Method to Design Traffic Control Programs , 2006 .

[58]  Giovanni Huisken Inter-urban short-term traffic congestion prediction , 2006 .

[59]  H. Van Dyke Parunak,et al.  Representing Agent Interaction Protocols in UML , 2000, AOSE.

[60]  J. W. Oosten Ruimte voor een democratische rechtsstaat: geschakelde sturing bij ruimtelijke investeringen , 2005 .

[61]  Ramon M Lentink,et al.  Algorithmic Decision Support for Shunt Planning , 2006 .

[62]  Hans van Lint,et al.  Reliable travel time prediction for freeways , 2004 .

[63]  R. de Feijter,et al.  Controlling High Speed Automated Transport Network Operations , 2006 .

[64]  Stephen G. Ritchie,et al.  A KNOWLEDGE-BASED DECISION SUPPORT ARCHITECTURE FOR ADVANCED TRAFFIC MANAGEMENT , 1990 .

[65]  Jeroen Valk Coordination among autonomous planners , 2005 .

[66]  Nathan H. Gartner,et al.  Implementation of the OPAC adaptive control strategy in a traffic signal network , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[67]  Winnie Daamen,et al.  Modelling passenger flows in public transport facilities , 2004 .

[68]  Henk J van Zuylen,et al.  The most likely trip matrix estimated from traffic counts , 1980 .

[69]  M. M. De Weerdt,et al.  Plan Merging in Multi-Agent Systems , 2003 .

[70]  Nathan H. Gartner,et al.  MULTIBAND--A VARIABLE-BANDWIDTH ARTERIAL PROGRESSION SCHEME , 1990 .

[71]  R. Rooij,et al.  The Mobile City: The Planning and Design of the Network City from a Mobility Point of View , 2005 .

[72]  B. De Schutter,et al.  Test Bed for Multiagent Control Systems in Road Traffic Management , 2005 .

[73]  Francois Dion,et al.  REAL-TIME TRAFFIC SIGNAL COORDINATION WITH TRANSIT PRIORITY : RECENT ADVANCES IN THE SPPORT MODEL , 1998 .

[74]  Dipti Srinivasan,et al.  REAL-TIME COORDINATED SIGNAL CONTROL USING AGENTS WITH ONLINE REINFORCEMENT LEARNING , 2003 .

[75]  Seungmin Kang,et al.  Assessing the Benefits and Costs of Intelligent Tranportation Systems: Ramp Meters , 1999 .

[76]  Vincent Marchau,et al.  Technology Assessment of Automated Vehicle Guidance: Prospects for automated driving implementation , 2000 .

[77]  Kevin Fehon Adaptive Traffic Signals Are we missing the boat , 2004 .

[78]  Iisakki Kosonen,et al.  Multi-agent fuzzy signal control based on real-time simulation , 2001 .

[79]  A Mekky ON ESTIMATING TURNING FLOWS AT ROAD JUNCTIONS , 1979 .

[80]  M. M. Minderhoud,et al.  Supported driving: impacts on motorway traffic flow , 1999 .

[81]  van Zuylen,et al.  THE ESTIMATION OF TURNING FLOWS ON A JUNCTION , 1979 .

[82]  Bart De Schutter,et al.  A Test Bed for Multi-Agent Control Systems in Road Traffic Management , 2005, Applications of Agent Technology in Traffic and Transportation.

[83]  C. Bielefeldt,et al.  MOTION-a new on-line traffic signal network control system , 1994 .

[84]  Giulio Erberto Cantarella,et al.  Control system design for an individual signalized junction , 1984 .

[85]  Marc Miska,et al.  Microscopic online simulation for real-time traffic management , 2007 .

[86]  M. G. H. Bell THE ESTIMATION OF JUNCTION TURNING VOLUMES FROM TRAFFIC COUNTS: THE ROLE OF PRIOR INFORMATION , 1984 .

[87]  R. D. Bretherton,et al.  Optimizing networks of traffic signals in real time-the SCOOT method , 1991 .

[88]  Giovanni Caire,et al.  JADE Programmer's Guide , 2002 .

[89]  Rudy R. Negenborn,et al.  Multi-agent model predictive control with applications to power networks , 2007 .

[90]  S. Dekker Port Investment: Towards an Integrated Planning of Port Capacity , 2005 .

[91]  Pmj Pol,et al.  A RENAISSANCE OF STATIONS, RAILWAYS AND CITIES. ECONOMIC EFFECTS, DEVELOPMENT STRATEGIES AND ORGANISATIONAL ISSUES OF EUROPEAN HIGH-SPEED-TRAIN STATIONS , 2002 .

[92]  Gary A. Davis,et al.  Application of Prediction-Error Minimization and Maximum Likelihood to Estimate Intersection O-D Matrices from Traffic Counts , 1989, Transp. Sci..

[93]  Makoto Yokoo,et al.  Adopt: asynchronous distributed constraint optimization with quality guarantees , 2005, Artif. Intell..

[94]  D. M. Bos CHANGING SEATS: A BEHAVIOURAL ANALYSIS OF P&R USE , 2004 .

[95]  H Taale OPTIMISING TRAFFIC SIGNAL CONTROL WITH EVOLUTIONARY ALGORITHMS , 2000 .

[96]  Averill M. Law,et al.  The art and theory of dynamic programming , 1977 .

[97]  D. C. Dashfield HER MAJESTY'S STATIONERY OFFICE , 1954 .

[98]  E. J. Friedman-hill. Jess,et al.  The expert system shell for the java platform , 2002 .

[99]  R. D. Bretherton,et al.  AGEING OF FIXED-TIME TRAFFIC SIGNAL PLANS , 1986 .

[100]  S. P. Hoogendoorn,et al.  Multiclass continuum modelling of multilane traffic flow , 1999 .

[101]  B. De Schutter,et al.  Look-ahead traffic adaptive control of a single intersection - A taxonomy and a new hybrid algorithm ∗ , 2006 .

[102]  B. A. Pielage Conceptual design of automated freight transport systems , 2005 .

[103]  E.C.-P. Chang Improving traffic estimation and prediction through dynamic traffic assignment development , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[104]  Pitu B. Mirchandani,et al.  HIERARCHICAL FRAMEWORK FOR REAL-TIME TRAFFIC CONTROL , 1992 .

[105]  John D. C. Little,et al.  Simultaneous optimization of offsets, splits, and cycle time , 1976 .

[106]  Jianxin Yuan,et al.  Stochastic modelling of train delays and delay propagation in stations , 2006 .

[107]  Y. M. Bontekoning,et al.  Hub exchange operations in intermodal hub-and spoke networks: A performance comparison of rail-rail exchange facilities , 2006 .

[108]  Pim M J Warffemius,et al.  Modeling the Clustering of Distribution Centers around Amsterdam Airport Schiphol , 2007 .

[109]  Suvrajeet Sen,et al.  Controlled Optimization of Phases at an Intersection , 1997, Transp. Sci..

[110]  Rob M.P. Goverde,et al.  Punctuality of railway operations and timetable stability analysis , 2005 .

[111]  C.G.J.M. van der Nat A Knowledge-Based Concept Exploration Model for Submarine Design , 1999 .

[112]  M. Maher INFERENCES ON TRIP MATRICES FROM OBSERVATIONS ON LINK VOLUMES: A BAYESIAN STATISTICAL APPROACH , 1983 .

[113]  D. Noyce,et al.  TRAFFIC SIGNALS , 1934 .

[114]  J Y Luk,et al.  TRANSYT: traffic network study tool , 1990 .

[115]  O. Koppius Information Architecture and Electronic Market Performance , 2002 .

[116]  E. A. Mueller Aspects of the history of traffic signals , 1970 .

[117]  R D Bretherton,et al.  SCOOT-a Traffic Responsive Method of Coordinating Signals , 1981 .

[118]  Jean-Loup Farges,et al.  THE PRODYN REAL TIME TRAFFIC ALGORITHM , 1983 .

[119]  Markos Papageorgiou,et al.  Motorway network traffic control systems , 2004, Eur. J. Oper. Res..

[120]  M. Bliemer Analytical dynamic traffic assignment with interacting user-classes: Theoretical advances and applications using a variational inequality approach , 2001 .

[121]  Matthijs Wolters,et al.  The Business of Modularity and the Modularity of Business , 1999 .

[122]  A. J. Van Binsbergen,et al.  Innovation Steps Towards Efficient Goods Distribution Systems for Urban Areas , 2001 .

[123]  K. Stoffers Scheduling of traffic lights—A new approach☆ , 1968 .

[124]  Eswaran Subrahmanian,et al.  Intelligent agents in decentralized traffic control , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[125]  José Cuena,et al.  A structure of problem-solving methods for real-time decision support in traffic control , 1998, Int. J. Hum. Comput. Stud..

[126]  Markos Papageorgiou,et al.  Motorway network control via nonlinear optimization , 1995 .

[127]  Stephen G. Ritchie,et al.  A real-time decision-support system for freeway management and control , 1992 .

[128]  Nathan H. Gartner,et al.  A multi-band approach to arterial traffic signal optimization , 1991 .

[129]  Χριστίνα Διακάκη,et al.  Integrated control of traffic flow in corridor networks , 1999 .

[130]  M. Calisti,et al.  FOUNDATION FOR INTELLIGENT PHYSICAL AGENTS , 2000 .

[131]  M. D. Bok,et al.  Infrastructure and firm dynamics: A micro simulation approach , 2006 .

[132]  John D. C. Little,et al.  MAXBAND: A PROGRAM FOR SETTING SIGNALS ON ARTERIES AND TRIANGULAR NETWORKS , 1981 .

[133]  Umit Ozguner,et al.  Decentralized hybrid intersection control , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[134]  M J Lighthill,et al.  On kinematic waves II. A theory of traffic flow on long crowded roads , 1955, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[135]  Pieter Antoine van Reeven Competition in scheduled transport , 2003 .

[137]  J J Klijnhout MOTORWAY CONTROL AND SIGNALLING: THE TEST OF TIME , 1984 .

[138]  Sophie Midenet,et al.  Real-life CRONOS evaluation , 2000 .

[139]  Francois Dion,et al.  A METHODOLOGY FOR OBTAINING SIGNAL COORDINATION WITHIN A DISTRIBUTED REAL-TIME NETWORK SIGNAL CONTROL SYSTEM WITH TRANSIT PRIORITY , 2001 .

[140]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[141]  M.B.M. de Koster,et al.  Intelligent Control of Vehicle-Based Internal Transport Systems , 2001 .

[142]  Ashley Nuttall,et al.  Design aspects of multiple driven belt conveyors , 2007 .

[143]  Nicholas V. Findler,et al.  A semi-autonomous decentralized system for controlling street traffic signals , 1995, Proceedings ISADS 95. Second International Symposium on Autonomous Decentralized Systems.

[144]  T. Verduijn,et al.  DYNAMISM IN SUPPLY NETWORKS: ACTOR SWITCHING IN A TURBULENT BUSINESS ENVIRONMENT , 2004 .

[145]  A. Schaafsma,et al.  Dynamisch Railverkeersmanagement besturingsconcept voor railverkeer op basis van het Lagenmodel Verkeer en Vervoer , 2001 .

[146]  R. D. Bretherton,et al.  SCOOT URBAN TRAFFIC CONTROL SYSTEM: PHILOSOPHY AND EVALUATION , 1990 .

[147]  Carroll J Messer,et al.  MAXBAND-86: Program for optimizing left-turn phase sequence in multiarterial closed networks. , 1988 .

[148]  M. S. Fiorenzo-Catalano Choice set generation in multi-modal transportation networks , 2007 .

[149]  W Blok CHAINS AND NETWORKS IN MULTIMODAL PASSENGER TRANSPORT. EXPLORING A DESIGN APPROACH , 2002 .

[150]  E Hauer,et al.  ESTIMATION OF TURNING FLOWS FROM AUTOMATIC COUNTS , 1981 .

[151]  Roman van der Krogt,et al.  Plan Repair in Single-Agent and Multi-Agent Systems , 2005 .

[152]  R. van Nes,et al.  Design of multimodal transport networks: A hierarchical approach , 2002 .

[153]  黒田 孝次,et al.  Highway Capacity Manual改訂の動向--テイラ-教授の講演より , 1984 .

[154]  B. De Schutter,et al.  TRAFFIC ADAPTIVE CONTROL OF A SINGLE INTERSECTION: A TAXONOMY OF APPROACHES , 2006 .

[155]  Azhar Al-Mudhaffar,et al.  Impacts of Traffic Signal Control Strategies , 2006 .

[156]  Markos Papageorgiou,et al.  COORDINATED AND INTEGRATED CONTROL OF MOTORWAY NETWORKS VIA NON-LINEAR OPTIMAL CONTROL , 2002 .