A Multiagent Approach to Autonomous Intersection Management

Artificial intelligence research is ushering in a new era of sophisticated, mass-market transportation technology. While computers can already fly a passenger jet better than a trained human pilot, people are still faced with the dangerous yet tedious task of driving automobiles. Intelligent Transportation Systems (ITS) is the field that focuses on integrating information technology with vehicles and transportation infrastructure to make transportation safer, cheaper, and more efficient. Recent advances in ITS point to a future in which vehicles themselves handle the vast majority of the driving task. Once autonomous vehicles become popular, autonomous interactions amongst multiple vehicles will be possible. Current methods of vehicle coordination, which are all designed to work with human drivers, will be outdated. The bottleneck for roadway efficiency will no longer be the drivers, but rather the mechanism by which those drivers' actions are coordinated. While open-road driving is a well-studied and more-or-less-solved problem, urban traffic scenarios, especially intersections, are much more challenging. We believe current methods for controlling traffic, specifically at intersections, will not be able to take advantage of the increased sensitivity and precision of autonomous vehicles as compared to human drivers. In this article, we suggest an alternative mechanism for coordinating the movement of autonomous vehicles through intersections. Drivers and intersections in this mechanism are treated as autonomous agents in a multiagent system. In this multiagent system, intersections use a new reservation-based approach built around a detailed communication protocol, which we also present. We demonstrate in simulation that our new mechanism has the potential to significantly outperform current intersection control technology--traffic lights and stop signs. Because our mechanism can emulate a traffic light or stop sign, it subsumes the most popular current methods of intersection control. This article also presents two extensions to the mechanism. The first extension allows the system to control human-driven vehicles in addition to autonomous vehicles. The second gives priority to emergency vehicles without significant cost to civilian vehicles. The mechanism, including both extensions, is implemented and tested in simulation, and we present experimental results that strongly attest to the efficacy of this approach.

[1]  Risto Miikkulainen,et al.  Evolving a real-world vehicle warning system , 2006, GECCO.

[2]  A. Watanabe,et al.  Lane detection for a steering assistance system , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[3]  Marco Wiering,et al.  Multi-Agent Reinforcement Learning for Traffic Light control , 2000 .

[4]  Peter Stone,et al.  Multiagent traffic management: a reservation-based intersection control mechanism , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[5]  Richard Bishop,et al.  Intelligent Vehicle Technology and Trends , 2005 .

[6]  Steven A. Shafer,et al.  A computational model of driving for autonomous vehicles , 1993 .

[7]  M. Rizzo,et al.  Simulated Car Crashes at Intersections in Drivers With Alzheimer Disease , 2001, Alzheimer disease and associated disorders.

[8]  Adam Jacoff,et al.  RoboCup 2005: Robot Soccer World Cup IX , 2006, RoboCup.

[9]  Pat Langley,et al.  An adaptive interactive agent for route advice , 1999, AGENTS '99.

[10]  Craig W. Reynolds.  Steering Behaviors For Autonomous Characters , 1999 .

[11]  Simon Hallé,et al.  A collaborative driving system based on multiagent modelling and simulations , 2005 .

[12]  Thomas A. Dingus,et al.  IDENTIFICATION AND EVALUATION OF DRIVER ERRORS: OVERVIEW AND RECOMMENDATIONS , 2002 .

[13]  Jussi Suomela,et al.  Positioning an autonomous off-road vehicle by using fused DGPS and inertial navigation , 1996, Int. J. Syst. Sci..

[14]  Patrick T McCoy,et al.  ESTIMATION OF SAFETY AT TWO-WAY STOP-CONTROLLED INTERSECTIONS ON RURAL HIGHWAYS , 1993 .

[15]  Umit Ozguner,et al.  Steering and lane change: a working system , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[16]  Peter Stone,et al.  Multiagent Traffic Management: Opportunities for Multiagent Learning , 2005, LAMAS.

[17]  Sean Luke,et al.  History-based traffic control , 2006, AAMAS '06.

[18]  Ana L. C. Bazzan,et al.  A Distributed Approach for Coordination of Traffic Signal Agents , 2005, Autonomous Agents and Multi-Agent Systems.

[19]  Kai She,et al.  Vehicle tracking using on-line fusion of color and shape features , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[20]  F. Lindner,et al.  Robust recognition of traffic signals , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[21]  D.M. Gavrila,et al.  Vision-based pedestrian detection: the PROTECTOR system , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[22]  T. Bucher,et al.  Real-time detection and classification of cars in video sequences , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[23]  Chao-Jung Chen,et al.  The automated lane-keeping design for an intelligent vehicle , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[24]  Bhagwant Persaud,et al.  Safety Effect of Roundabout Conversions in the United States: Empirical Bayes Observational Before-After Study , 2001 .

[25]  D. Schrank,et al.  THE 2004 URBAN MOBILITY REPORT , 2002 .

[26]  Baher Abdulhai,et al.  Reinforcement learning for true adaptive traffic signal control , 2003 .

[27]  J Y Luk,et al.  TRANSYT: traffic network study tool , 1990 .

[28]  Jerry Werner.  INSIDE THE USDOT'S "INTELLIGENT INTERSECTION" TEST FACILITY , 2003 .

[29]  M. Mahlisch,et al.  A multiple detector approach to low-resolution FIR pedestrian recognition , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[30]  R D Bretherton,et al.  SCOOT-a Traffic Responsive Method of Coordinating Signals , 1981 .

[31]  Lily Elefteriadou,et al.  Safety Effectiveness of Intersection Left- and Right-Turn Lanes , 2003 .

[32]  Xia Liu,et al.  Pedestrian detection using stereo night vision , 2004, IEEE Transactions on Vehicular Technology.

[33]  D. Roozemond.  USING INTELLIGENT AGENTS FOR URBAN TRAFFIC CONTROL SYSTEMS , 1999 .

[34]  R Naumann,et al.  INTERSECTION COLLISION AVOIDANCE BY MEANS OF DECENTRALIZED SECURITY AND COMMUNICATION MANAGEMENT OF AUTONOMOUS VEHICLES , 1997 .

[35]  Rolf Naumann,et al.  Validation and simulation of a decentralized intersection collision avoidance algorithm , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[36]  Dean A. Pomerleau,et al.  Neural Network Perception for Mobile Robot Guidance , 1993 .

[37]  Roberto Horowitz,et al.  Traffic Flow Control in Automated Highway Systems , 1997 .

[38]  O. Svenson.  ARE WE ALL LESS RISKY AND MORE SKILLFUL THAN OUR FELLOW DRIVERS , 1981 .

[39]  Larry Bull,et al.  Towards distributed adaptive control for road traffic junction signals using learning classifier systems , 2004 .

[40]  Tarek Sayed,et al.  Traffic conflict standards for intersections , 1999 .

[41]  Ljubo B. Vlacic,et al.  Cooperative Autonomous Driving at the Intelligent Control Systems Laboratory , 2003, IEEE Intell. Syst..

[42]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[43]  Pat Langley,et al.  Learning Cooperative Lane Selection Strategies for Highways , 1998, AAAI/IAAI.

[44]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.