Learning Cooperative Lane Selection Strategies for Highways

This paper presents a novel approach to traffic management by coordinating driver behaviors. Current traffic management systems do not consider lane organization of the cars and only affect traffic flows by controlling traffic signals or ramp meters. However, drivers should be able to increase traffic throughput and more consistently maintain desired speeds by selecting lanes intelligently. We pose the problem of intelligent lane selection as a challenging and potentially rewarding problem for artificial intelligence, and we propose a methodology that uses supervised and reinforcement learning to form distributed control strategies. Initial results are promising and demonstrate that intelligent lane selection can better approximate desired speeds and reduce the total number of lane changes.

[1]  David E. Moriarty,et al.  Symbiotic Evolution of Neural Networks in Sequential Decision Tasks , 1997 .

[2]  Farokh Eskafi,et al.  Modeling And Simulation Of The Automated Highway System , 1996 .

[3]  Harold C. Forbes,et al.  KNOWLEDGE-BASED ADVANCED TRAFFIC MANAGEMENT SYSTEM , 1994 .

[4]  Eugenio Morello,et al.  ADVANCED CONTROL STRATEGIES AND METHODS FOR MOTORWAY OF THE FUTURE : THE DRIVE PROJECT "DOMINC" : NEW CONCEPTS AND RESEARCH UNDER WAY , 1990 .

[5]  P J Tarnoff,et al.  RT-TRACS: DEVELOPMENT OF THE REAL-TIME CONTROL LOGIC , 1996 .

[6]  Andrew McCallum,et al.  Learning to Use Selective Attention and Short-Term Memory in Sequential Tasks , 1996 .

[7]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[8]  Rahul Sukthankar,et al.  Evolving an intelligent vehicle for tactical reasoning in traffic , 1997, Proceedings of International Conference on Robotics and Automation.

[9]  Jonathan Baxter,et al.  Learning internal representations , 1995, COLT '95.

[10]  H. B. Smartt,et al.  AN INTELLIGENT TRAFFIC CONTROLLER , 1995 .

[11]  Stuart J. Russell,et al.  The BATmobile: Towards a Bayesian Automated Taxi , 1995, IJCAI.

[12]  Maja J. Matarić,et al.  Learning to Use Selective Attention and Short-Term Memory in Sequential Tasks , 1996 .

[13]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 1996, Machine Learning.

[14]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .