Distributed and adaptive traffic signal control within a realistic traffic simulation

As traffic congestion rises within urban centers around the world, the intelligent control of traffic signals within cities is becoming increasingly important. Previous research within the area of intelligent traffic signal control has several shortcomings, including a reliance on historical data, the use of centralized systems which cannot handle city-sized problem instances and solutions which are not capable of addressing real-world traffic scenarios (e.g., constantly varying volumes and complex network structures). The research reported here proposes algorithms capable of controlling traffic signals that rely on traffic observations made by available sensor devices and local communication between traffic lights. This solution allows signals to be updated frequently to match current traffic demand, while also allowing for significantly large problem sizes to be addressed. To evaluate the developed system, a realistic traffic model was developed using information supplied by the City of Ottawa, Canada. It was found, through simulation within the SUMO traffic simulation environment, that the proposed adaptive system resulted in higher overall network performance when compared to the current fixed signal plan controllers, which were recreated using information from the City of Ottawa. This work also includes examples of why fixed signal controllers are inferior to an adaptive control system.

[1]  Khaled Almejalli,et al.  An intelligent multi-agent approach for road traffic management systems , 2009, 2009 IEEE Control Applications, (CCA) & Intelligent Control, (ISIC).

[2]  Dipti Srinivasan,et al.  REAL-TIME COORDINATED SIGNAL CONTROL USING AGENTS WITH ONLINE REINFORCEMENT LEARNING , 2003 .

[3]  Wu Wei,et al.  Traffic signal control using fuzzy logic and MOGA , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[4]  John D. Owens,et al.  GPU Computing , 2008, Proceedings of the IEEE.

[5]  Dipti Srinivasan,et al.  Multi-Agent System in Urban Traffic Signal Control , 2010, IEEE Computational Intelligence Magazine.

[6]  Dirk Helbing,et al.  Analytical investigation of oscillations in intersecting flows of pedestrian and vehicle traffic. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Ali A. Ghorbani,et al.  A multiagent system for optimizing urban traffic , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[8]  Javier J. Sánchez Medina,et al.  Applying a Traffic Lights Evolutionary Optimization Technique to a Real Case: “Las Ramblas” Area in Santa Cruz de Tenerife , 2008, IEEE Transactions on Evolutionary Computation.

[9]  Javier J. Sánchez Medina,et al.  Traffic Signal Optimization in "La Almozara" District in Saragossa Under Congestion Conditions, Using Genetic Algorithms, Traffic Microsimulation, and Cluster Computing , 2010, IEEE Trans. Intell. Transp. Syst..

[10]  Hyung Lee-Kwang,et al.  Distributed and cooperative fuzzy controllers for traffic intersections group , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[11]  Bram Bakker,et al.  Reinforcement Learning of Traffic Light Controllers Adapting to Traffic Congestion , 2005, BNAIC.

[12]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[13]  Ana L. C. Bazzan,et al.  A Swarm-Based Approach for Selection of Signal Plans in Urban Scenarios , 2004, ANTS Workshop.

[14]  Chih-Hsun Chou,et al.  A fuzzy logic controller for traffic junction signals , 2002, Inf. Sci..

[15]  Michael P. Wellman A Market-Oriented Programming Environment and its Application to Distributed Multicommodity Flow Problems , 1993, J. Artif. Intell. Res..

[16]  Carlos Gershenson,et al.  Self-organizing Traffic Lights , 2004, Complex Syst..

[17]  Felix A. Fischer,et al.  An integrated framework for adaptive reasoning about conversation patterns , 2005, AAMAS '05.

[18]  Josef Stoer,et al.  Numerische Mathematik 1 , 1989 .

[19]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[20]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[21]  David J. Montana,et al.  Evolving control laws for a network of traffic signals , 1996 .

[22]  R. D. Bretherton,et al.  Optimizing networks of traffic signals in real time-the SCOOT method , 1991 .

[23]  Ana L. C. Bazzan,et al.  Learning in groups of traffic signals , 2010, Eng. Appl. Artif. Intell..

[24]  D. C. Chin,et al.  Traffic-responsive signal timing for system-wide traffic control , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[25]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[26]  U. Netlogo Wilensky,et al.  Center for Connected Learning and Computer-Based Modeling , 1999 .

[27]  Marco Wiering,et al.  Intelligent Trac Light Control , 2004 .

[28]  Paulo Martins Engel,et al.  Dealing with non-stationary environments using context detection , 2006, ICML.

[29]  E. Mamdani,et al.  FUZZY LOGIC CONTROLLER FOR A TRAFFIC JUNCTION , 1977 .

[30]  Denise de Oliveira,et al.  Swarm Intelligence Applied to Traffic Lights Group Formation , 2007 .

[31]  A. Koopman,et al.  Simulation and optimization of traffic in a city , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[32]  Peter Stone,et al.  Multiagent traffic management: an improved intersection control mechanism , 2005, AAMAS '05.

[33]  Carlos Gershenson,et al.  Self-organizing traffic lights: A realistic simulation , 2013 .

[34]  José García-Nieto,et al.  Swarm intelligence for traffic light scheduling: Application to real urban areas , 2012, Eng. Appl. Artif. Intell..

[35]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[36]  A. Rathi A CONTROL SCHEME FOR HIGH TRAFFIC DENSITY SECTORS , 1988 .

[37]  Ana L. C. Bazzan,et al.  Traffic Lights Control with Adaptive Group Formation Based on Swarm Intelligence , 2006, ANTS Workshop.

[38]  B. De Schutter,et al.  A multi-agent case-based traffic control scenario evaluation system , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[39]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[40]  Chien-Hung Wei Analysis of artificial neural network models for freeway ramp metering control , 2001, Artif. Intell. Eng..

[41]  Peter Stone,et al.  Multiagent Traffic Management: Opportunities for Multiagent Learning , 2005, LAMAS.

[42]  José Cuena,et al.  Knowledge-based models for adaptive traffic management systems , 1995 .

[43]  Peter Stone,et al.  A Multiagent Approach to Autonomous Intersection Management , 2008, J. Artif. Intell. Res..

[44]  Marco Wiering,et al.  Multi-Agent Reinforcement Learning for Traffic Light control , 2000 .

[45]  Peter Stone,et al.  Traffic Intersections of the Future , 2006, AAAI.

[46]  Yu-Fai Fung,et al.  Coordinated road-junction traffic control by dynamic programming , 2005, IEEE Trans. Intell. Transp. Syst..

[47]  Peter Stone,et al.  Multiagent traffic management: a reservation-based intersection control mechanism , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[48]  I Okutani,et al.  Dynamic prediction of traffic volume through Kalman Filtering , 1984 .

[49]  M. Lighthill,et al.  On kinematic waves I. Flood movement in long rivers , 1955, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[50]  Wu Wei,et al.  FL-FN based traffic signal control , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[51]  Katia P. Sycara,et al.  Designing behaviors for information agents , 1997, AGENTS '97.

[52]  Dirk Helbing,et al.  Self-control of traffic lights and vehicle flows in urban road networks , 2008, 0802.0403.

[53]  Y. Sugiyama,et al.  Traffic jams without bottlenecks—experimental evidence for the physical mechanism of the formation of a jam , 2008 .

[54]  Robert Hoyer,et al.  An Advanced fuzzy controller for Traffic Lights , 1994, AIRTC.

[55]  C. Reinsch Smoothing by spline functions , 1967 .

[56]  Nicholas V. Findler,et al.  Distributed Approach to Optimized Control of Street Traffic Signals , 1992 .

[57]  G. Theraulaz,et al.  Response threshold reinforcements and division of labour in insect societies , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[58]  Dipti Srinivasan,et al.  Neural Networks for Real-Time Traffic Signal Control , 2006, IEEE Transactions on Intelligent Transportation Systems.

[59]  Arne Koopman,et al.  Intelligent Traffic Light Control , 2004 .

[60]  Yetis Sazi Murat,et al.  A FUZZY LOGIC MULTI-PHASED SIGNAL CONTROL MODEL FOR ISOLATED JUNCTIONS , 2005 .

[61]  R. D. Bretherton,et al.  AGEING OF FIXED-TIME TRAFFIC SIGNAL PLANS , 1986 .

[62]  Christian Goerick,et al.  Evolutionary Algorithms for Optimizing Tra?c Signal Operation , 2000 .

[63]  Khaled Almejalli,et al.  GA-Based Learning Algorithms to Identify Fuzzy Rules for Fuzzy Neural Networks , 2007, Seventh International Conference on Intelligent Systems Design and Applications (ISDA 2007).

[64]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[65]  Jordi Sabater-Mir,et al.  Reputation and social network analysis in multi-agent systems , 2002, AAMAS '02.

[66]  Jarkko Niittymäki,et al.  Signal control using fuzzy logic , 2000, Fuzzy Sets Syst..

[67]  Khaled Almejalli,et al.  Intelligent Traffic Control Decision Support System , 2007, EvoWorkshops.

[68]  Wang,et al.  Review of road traffic control strategies , 2003, Proceedings of the IEEE.

[69]  Khaled Almejalli,et al.  Real Time Identification of Road Traffic Control Measures , 2008 .

[70]  C. P. Pappis,et al.  A Fuzzy Logic Controller for a Trafc Junction , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[71]  M J Lighthill,et al.  ON KINEMATIC WAVES.. , 1955 .

[72]  Sean Luke,et al.  History-based traffic control , 2006, AAMAS '06.

[73]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[74]  Javier J. Sánchez Medina,et al.  Genetic algorithms and cellular automata: a new architecture for traffic light cycles optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[75]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[76]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[77]  S. Chiu,et al.  Adaptive traffic signal control using fuzzy logic , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[78]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[79]  Sascha Ossowski,et al.  A market-inspired approach to reservation-based urban road traffic management , 2009, AAMAS.

[80]  S. Chand,et al.  Self-organizing traffic control via fuzzy logic , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[81]  A. Hegyi,et al.  A fuzzy decision support system for traffic control centers , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[82]  Dipti Srinivasan,et al.  Cooperative, hybrid agent architecture for real-time traffic signal control , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[83]  James C. Spall,et al.  A model-free approach to optimal signal light timing for system-wide traffic control , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[84]  Lúcio S. Passos,et al.  Traffic light control using reactive agents , 2010, 5th Iberian Conference on Information Systems and Technologies.

[85]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[86]  John P. Lewis,et al.  The Future of Disaster Response: Humans Working with Multiagent Teams using DEFACTO , 2005, AAAI Spring Symposium: AI Technologies for Homeland Security.