Cooperation-Aware Lane Change Maneuver in Dense Traffic based on Model Predictive Control with Recurrent Neural Network

This paper presents a real-time lane change control framework of autonomous driving in dense Traffic, which exploits cooperative behaviors of other drivers. This paper focuses on heavy Traffic where vehicles cannot change lanes without cooperating with other drivers. In this case, classical robust controls may not apply since there is no "safe" area to merge to without interacting with the other drivers. That said, modeling complex and interactive human behaviors is highly non-trivial from the perspective of control engineers. We propose a mathematical control framework based on Model Predictive Control (MPC) encompassing a state-of-the-art Recurrent Neural network (RNN) architecture. In particular, RNN predicts interactive motions of other drivers in response to potential actions of the autonomous vehicle, which are then systematically evaluated in safety constraints. We also propose a real-time heuristic algorithm to find locally optimal control inputs. Finally, quantitative and qualitative analysis on simulation studies are presented to illustrate the benefits of the proposed framework.

[1]  Masayoshi Tomizuka,et al.  Interaction-aware Decision Making with Adaptive Strategies under Merging Scenarios , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Mykel J. Kochenderfer,et al.  Cooperation-Aware Reinforcement Learning for Merging in Dense Traffic , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[3]  José Eugenio Naranjo,et al.  Lane-Change Fuzzy Control in Autonomous Vehicles for the Overtaking Maneuver , 2008, IEEE Transactions on Intelligent Transportation Systems.

[4]  Nikolce Murgovski,et al.  Safe autonomous lane changes in dense traffic , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[5]  David Isele,et al.  Safe Reinforcement Learning on Autonomous Vehicles , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Suman Jana,et al.  DeepTest: Automated Testing of Deep-Neural-Network-Driven Autonomous Cars , 2017, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[7]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[8]  Francesco Borrelli,et al.  Scenario model predictive control for lane change assistance on highways , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[9]  Francesco Borrelli,et al.  Kinematic and dynamic vehicle models for autonomous driving control design , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[10]  Hani S. Mahmassani,et al.  Modeling Lane-Changing Behavior in a Connected Environment: A Game Theory Approach , 2015 .

[11]  Markus Maurer,et al.  Probabilistic online POMDP decision making for lane changes in fully automated driving , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[12]  Amnon Shashua,et al.  Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving , 2016, ArXiv.

[13]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Lie Guo,et al.  Trajectory planning and tracking control for autonomous lane change maneuver based on the cooperative vehicle infrastructure system , 2015, Expert Syst. Appl..

[15]  Maxim Likhachev,et al.  Driving in Dense Traffic with Model-Free Reinforcement Learning , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Keith Redmill,et al.  Automated lane change controller design , 2003, IEEE Trans. Intell. Transp. Syst..

[17]  Silvio Savarese,et al.  Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Srikanth Malla,et al.  DROGON: A Causal Reasoning Framework for Future Trajectory Forecast , 2019, ArXiv.

[19]  Javier García,et al.  A comprehensive survey on safe reinforcement learning , 2015, J. Mach. Learn. Res..

[20]  Dirk Helbing,et al.  General Lane-Changing Model MOBIL for Car-Following Models , 2007 .

[21]  Lawrence D. Jackel,et al.  Explaining How a Deep Neural Network Trained with End-to-End Learning Steers a Car , 2017, ArXiv.

[22]  Bruce A. Francis,et al.  Feedback Control Theory , 1992 .

[23]  Brigitte d'Andréa-Novel,et al.  The kinematic bicycle model: A consistent model for planning feasible trajectories for autonomous vehicles? , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[24]  Francesco Borrelli,et al.  Real-time Ecological Velocity Planning for Plug-in Hybrid Vehicles with Partial Communication to Traffic Lights , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[25]  Jianxiong Xiao,et al.  DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  Anca D. Dragan,et al.  Planning for Autonomous Cars that Leverage Effects on Human Actions , 2016, Robotics: Science and Systems.

[27]  Francesco Borrelli,et al.  Design and Implementation of Ecological Adaptive Cruise Control for Autonomous Driving with Communication to Traffic Lights , 2018, 2019 American Control Conference (ACC).

[28]  Sebastian Thrun,et al.  Towards fully autonomous driving: Systems and algorithms , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[29]  Claire J. Tomlin,et al.  A probabilistic approach to planning and control in autonomous urban driving , 2013, 52nd IEEE Conference on Decision and Control.